IPUMS-WEB

Releases between April 22, 2025 and December 22, 2025 were lost during a upgrade

Deployed 4/21 for DHS

Deployed 4/17 for all

Deployed 3/26 for all

Deployed 9/6 for DHS

• Removed message from samples page that said full count not available via API for USA (it is now available.)

• Bug fix for https://redmine.pop.umn.edu/issues/22149

• Bug fix for https://redmine.pop.umn.edu/issues/22126

• Upgrade microdata_extract_serializer gem to v1.2.3 (version makes DDI citation dynamic)

• Bump ipums-extract-core

• Bump ipums-extract-core to v1.5.10

• https://github.com/umn-isrdi/ipums-web/commit/f8425d3cfe8e2ad0044ddf028d63f3d5a6760c65

• https://github.com/umn-isrdi/ipums-web/pull/405

• https://github.com/umn-isrdi/ipums-extract-core/commit/b2b20cbe3f4ac551a36789046b9d7be98d6f57f9

• Enable SQLite metadata loading for IPUMSI live

• Change of microdata_deployment directory (and revert)
• DHS guest login
• sample_rename_task (https://github.com/umn-isrdi/ipums-web/pull/395)
• UTC migration (https://github.com/umn-isrdi/ipums-web/pull/396)

• PMA wide extracts: https://github.com/umn-isrdi/ipums-web/pull/370

• Return metadata load time in status endpoint
• Re-verify registration at submission time
• Fixed DHS guest login link
• Switch DHS to SQLite-based metadata imports
• SDA runner fix
• Better source doc import

• https://github.com/umn-isrdi/ipums-web/pull/386

• https://github.com/umn-isrdi/ipums-web/pull/387

• https://github.com/umn-isrdi/ipums-web/commit/b7e9fcf4e6f453f7f5a2803f8103f3f011493d63

• https://github.com/umn-isrdi/ipums-web/pull/384

• https://github.com/umn-isrdi/ipums-web/pull/383

• https://github.com/umn-isrdi/ipums-web/pull/382
• https://github.com/umn-isrdi/ipums-web/pull/381

• Popup to inform user about effect of COVID in 2020 ACS data. https://github.com/umn-isrdi/ipums-web/pull/379, https://redmine.pop.umn.edu/issues/21928

• https://github.com/umn-isrdi/ipums-web/pull/378

• https://github.com/umn-isrdi/ipums-web/pull/377

• https://github.com/umn-isrdi/ipums-web/pull/365
• remove 'image' link from survey text page PMA/MICS/DHS

• https://github.com/umn-isrdi/ipums-web/pull/360

• https://github.com/umn-isrdi/ipums-web/pull/359

• Move USA to sqlite metadata

• Move MEPS to sqlite metadata

• https://github.com/umn-isrdi/ipums-web/pull/348

• https://github.com/umn-isrdi/ipums-web/pull/358

• SDA task runner: https://github.com/umn-isrdi/ipums-web/pull/347
• Fix sda detailed links: https://github.com/umn-isrdi/ipums-web/pull/356
• Add dummy MetadataLoadHistory record for non-sqlite projects in metadata load

• https://github.com/umn-isrdi/ipums-web/pull/357

• https://github.com/umn-isrdi/ipums-web/pull/354

• https://github.com/umn-isrdi/ipums-web/pull/355
• Upgrade ExceptionNotification gem
• Enable Slack notifications for errors (only) on live sites

• Fix further issue with general/detail frequencies count
• Fix state problem for "add to cart" button on variable description page

• Fix traefik middleware issue
• Fix longitudinal sample_type bug
• Bump to 20 extract workers for live CPS
• Fix uma login flow issue
• Fix bug in JS for general/detailed frequencies

• Fix bug in JS for general/detailed frequencies (first released in v20.11.4)
• Add MICS as a new microdata product

• Listing extracts for a TUV (https://github.com/umn-isrdi/ipums-web/pull/349)
• faq tags regex (https://github.com/umn-isrdi/ipums-web/pull/350)
• longitudional data support (relevant to CPS) (https://github.com/umn-isrdi/ipums-web/pull/208)
• Hiding of sample_variables based upon production/development mode in the API for EE consumption (https://github.com/umn-isrdi/microdata_metadata_api/pull/2)

• includes all changes from v20.11.00 going out for the first time
• Fix mount for PMA task runner

• Move MTUS to sqlite metadata

• Move AHTUS to sqlite metadata

• Bugfix for page that shows extracts containing custom Time Use variable

• Reformat page that shows extracts containing custom Time Use variable

• Page that shows extracts containing custom Time Use variable

• Upgrade to StatsPackageSyntaxFileGenerator v1.1.8 (Stata syntax fix)
• Upgrade to IpumsExtractCore v1.3.1

• Metadata parser "ignore_memos" bugfixes
• DDI codebook updates
• Remove used capacity parameter from status endpoint

• Point task runner volume at new storage

• Add Dockerized cron jobs (extract file reaper, extract db records reaper, checkbot)

• Set stable names for nsf mounts
• run db:migrate with task runner instead of local machine

• Refactor task runner to work on dhs without password-less sudo

• Disable the resubmit link once clicked for the first time.

• PR: https://github.com/umn-isrdi/ipums-web/pull/322
• refactor DHS "original name" preference to behave like other view preferences

• Enabled master_sub for PMA

• Resubmit extract scripts refactor
• DHS admin site cleanup

• Disable DHS old login page
• Static content commit should handle newly deleted files

• Deploy new units of analysis for PMA
• contains same content as v20.9.11

• Fix a login ping endpoint for DHS login

Deployed Apr. 19 2021 for DHS

• Fix reference to removed rake task: user @db:sessions:trim@ rather than @db:sessions:prune@
• Exclude NSF mount config from compose file in live deployments (fixes containerized tasks in DHS)

• Show special message for questionnaire text for multiyear ACS samples for USA
• original record types + weights + insertHTML parser sqlite work
• Robust handling of the case if the ER tractor ID is incorrect
• Add variable group migrations for 2 new PMA units of analysis
• Fix small worker classification in status endpoint
• enable checksum files for extract files

• Small change to displayed text for USA multiyear samples questionnaire

• Working on data problem with MEPS rec-up extracts

• Need to oercent-encode URLs from links metadata due to spaces in AHTUS filenames

• Bug in extract serializer gem was causing erroneous codebooks and syntax files to be created for MEPS rec-up extracts

• Corrects the URL for connecting to APM and disables SSL cert verification
• May also be the first release for all v20.9.0 functionality in DHS. It's not clear what version is currently deployed there.

• DHS was not ready for master deployment (i.e. v20.9.4)

• Tagged version of code previously released as part of rollout for 2 new production servers
• Cut out ActiveRecord ExtractRequests to use Tractor data driven through Microdata Extract Serializer.
• Implement DDS
• Deploys to 2 new prod servers (usa.pop.umn.edu for USA and microdata.pop.umn.edu for AHTUS, ATUS, CPS, HIGHERED, MEPS, MTUS, NAPP, NHIS, PMA)

• Cut out ActiveRecord ExtractRequests to use Tractor data driven through Microdata Extract Serializer.
• Implement DDS
• Deploys to 2 new prod servers (usa.pop.umn.edu for USA and microdata.pop.umn.edu for AHTUS, ATUS, CPS, HIGHERED, MEPS, MTUS, NAPP, NHIS, PMA)

Deployed March 19, 2021 for USA production server rollout

• Cut out ActiveRecord ExtractRequests to use Tractor data driven through Microdata Extract Serializer.
• Implement DDS
• Deploys to 2 new prod servers (usa.pop.umn.edu for USA and microdata.pop.umn.edu for AHTUS, ATUS, CPS, HIGHERED, MEPS, MTUS, NAPP, NHIS, PMA)

• Cut out ActiveRecord ExtractRequests to use Tractor data driven through Microdata Extract Serializer.
• Support SDA missing variables.

• Don't query failed jobs for status endpoint. (This was undesirable and reverted in v.20.8.14)
• SDA bugfixes
• Setup script bugfix with "~" being interpreted literally instead of as reference to homedir
• Implements DDS.

• Bump timeout for extract engine status endpoint from 5 to 15 seconds.

Deployed to all projects Feb 19 2021

• Better error handling for cookie parse errors
• Bump tractor_client version to ensure task_parameters are correctly saved for data request jobs

• Bots were making requests with a manipulated cookie and causing cookie parsing to throw an error. So many error emails were sent by ipums-external-web that OIT banned it from sending emails. Cookie parsing was made more robust and the error email was changed to ipums+fail@umn.edu.

• Reverted error emails to send from ipums@umn.edu again due to a problem sending from ipums+fail@umn.edu

• DHS: use ipums@umn.edu as email sender, use same SMTP settings as for other products
• Migrate all products from SSL to TLS SMTP

• downloads page: disable resubmit link for failed extract
• add Cap task for migration-free code deployment

• Add database migrations to the code deployment script
• Performance fix for a slow migrations for the questionnaires variable column
• Fix problem with site Javascript for IE11 users

• extract engine compose file was hardcoded to mount a fixed version of StatTransfer, the license of which expired today, rather than mounting the always-current symlink; this was changed to mount the symlink instead

• Extract resubmit bug: was possible to delete extract files in user extract area while another instance of the exact same extract was still processing

• CPS samples page redesign
• Fix StatTransfer resubmission fix (don't allow duplicate rsubmissions)
• IPUMSI user trans tables and editing rules (currently turned off on live)
• Remove references to fonts.com
• MetadataDisplay mode UI

• Rectangularize-up: support deployment for MEPS MVP (merged into master)
• Fix IPUMSI sample links: https://redmine.pop.umn.edu/issues/21110
• Fix IPUMSI Survey Sample links: https://trello.com/c/vbbJmz2P/170-fix-survey-sample-links-for-ipumsi
• Bump up default max heap size to 3GB: https://github.com/umn-isrdi/ipums-web/commit/d4cfae386c28333cada4518bc51e160c16dba29a
• Add FAILED extract status: https://github.com/umn-isrdi/ipums-web/commit/34a529a64ef91a3ff5fc79bdfef93ee8be9421fe

• Rectangularize-up: support deployment for MEPS MVP: https://redmine.pop.umn.edu/issues/20676

• Bug fixes:
  • Fix frequencies import code when for negative-integer codes: https://redmine.pop.umn.edu/issues/10233

• don't show hidden unharmonized vars: https://redmine.pop.umn.edu/issues/21082

• StatTransfer encoding fix from v20.2.3 wasn't included in EE v2 rollout (v20.3.0). This release merges the v20.2.3 fix into master.

• Re-raise binary data generation errors caught by StatTransfer class: https://redmine.pop.umn.edu/issues/21073

• The ATUS v20.3.0 extract engine was throwing errors due to null secondary time column values, so we rolled back to v20.2.3: https://redmine.pop.umn.edu/issues/21063

• The CPS v20.3.0 extract workers were throwing errors during Metadata API access due to CPS samples exceeding a hard coded max query string length in Puma: https://redmine.pop.umn.edu/issues/21062

• Fix bug in ATUS extract engine code in which null secondary time column values were not being handled gracefully: https://redmine.pop.umn.edu/issues/21063

• New features and characteristics:
  • the extract engine (EE) is now a gem
  • EE lives in its own GitHub repo: https://github.com/umn-isrdi/ipums-extract-core
  • same EE codebase for all microdata products
  • EE gets 100% of metadata from Metadata API, gets no metadata from ipums-web databases
  • EE produces CSVs natively
  • EE includes support for reading Parquet data samples
  • Extract worker is still pulling extract definitions from the web app database, serializing them, and passing them to the EE

• Fix max extract USA full count bug: https://redmine.pop.umn.edu/issues/21054

• Fix StatTransfer encoding bug: https://redmine.pop.umn.edu/issues/20908

• Bump up heap: https://github.com/umn-isrdi/oipums-web/commit/8b5421d46ced718543bb56d9f0e44ecb58481b12
• Index for source docs: https://github.com/umn-isrdi/ipums-web/commit/40d28d4bfba4da868589627558dc7cc2deffa885
• Show real IPs in NGINX logs: https://github.com/umn-isrdi/ipums-web/commit/60455de33111ea61d63d9aa96af2ba7bbd424b27

• ATUS nested category fix: https://redmine.pop.umn.edu/issues/20859

Deployed February 27, 2020 for all but DHS

• Fix bug(s) in master-sub parsing code: https://redmine.pop.umn.edu/issues/20748
• Remove superfluous REPWT-to-MASTER_SUB backwards-compatibility code: https://redmine.pop.umn.edu/issues/20674

• Fix syntax file decimal formatting issue: https://redmine.pop.umn.edu/issues/20568
• Check for valid TUV by name/id before displaying "show" view: https://redmine.pop.umn.edu/issues/20745
• Make get_category_tree_children a GET instead of POST: https://redmine.pop.umn.edu/issues/20639
• Adjust some deploy permissions to fix a DHS problem: https://github.com/umn-isrdi/ipums-web/commit/f2245dcc0ef6bd04fddff172df572a60aab0850a
• New extract management options in admin: https://github.com/umn-isrdi/ipums-web/commit/da696219bcbeeb010d82f8d6711f790446da20e4

• Refactored TUV DataDescription to use Webapp's menu generation logic: https://github.com/umn-isrdi/ipums-web/commit/8c9054b084af8df185d99411c807d8ace5004597
• Better error reporting from load_var_descs: https://redmine.pop.umn.edu/issues/20488
• Added paging to admin user extracts: https://github.com/umn-isrdi/ipums-web/commit/14f0f164a5dfcfd3b37d22efd14a117de8d649fe

• Rename time-use help link: https://redmine.pop.umn.edu/issues/20554

• Support dynamic downtime site notices that are editable/publishable, persistent across app reloads: https://redmine.pop.umn.edu/issues/20510

IPUMS Release Notes (pre-2020)

• TUV documentation: support metadata-driven description text: https://redmine.pop.umn.edu/issues/20497
• PMA CSS fix: https://redmine.pop.umn.edu/issues/20480
• Tractorize admin UI for managing users' extracts: https://redmine.pop.umn.edu/issues/20475
• Fix path helpers broken by v19.0.0 release: https://redmine.pop.umn.edu/issues/20423

• User-facing changes:
  • Predeploy/promote: make "samples" flag behavior consistent: https://redmine.pop.umn.edu/issues/17218

• migrate all extract histories to Tractor: https://redmine.pop.umn.edu/issues/18383
• populate extract activity exclusively with Tractor data: https://redmine.pop.umn.edu/issues/18443
• user extract downloads page should be driven by Tractor: https://redmine.pop.umn.edu/issues/18387
• move extract request serialization into separate gem: https://redmine.pop.umn.edu/issues/18406

• Add downtime notice for "Tractorized Extract History" rollout: https://redmine.pop.umn.edu/issues/20450

• User-facing changes:
  • Enable SSO (Shibboleth) in web app: https://redmine.pop.umn.edu/issues/8770

• Extract engine optimization: don't compress fixed-width file for StatTransfer extracts: https://redmine.pop.umn.edu/issues/19689
• Status app: some of the project-specific extract-activity metrics are computed incorrectly and/or poorly labeled: https://redmine.pop.umn.edu/issues/20223
• PMA: add number banner: https://redmine.pop.umn.edu/issues/19866

• Show RECTYPE value-labels in codebooks for time-use: https://redmine.pop.umn.edu/issues/19709
• Handle gracefully (in CPS var desc code) case in which a variable is unavailable for any samples: https://redmine.pop.umn.edu/issues/20050

• Upgrade TractorClient to support pagination and other upcoming changes to Tractor
• Fix broken Puerto Rico enum text in IPUMS-USA: https://redmine.pop.umn.edu/issues/19770
• Variable import: always derive availability from control file, not trans tables, for source variables: https://redmine.pop.umn.edu/issues/19801
• New variable debugging tool at /admin/debug_variable/[varname] (e.g. https://usa.ipums.org/usa-action/admin/debug_variable/FARM)
• Supergroups for ATUS

• Adjusted max allowed jobs for USA: 12 total with 3 fast jobs
• StatTransfer file handling fix: https://redmine.pop.umn.edu/issues/19647

• IPUMSI IEPM portal/skin sample selection and LFS tab: https://redmine.pop.umn.edu/issues/19289

• Modify "nontab" parsing behavior in CsvVariablesParser: https://redmine.pop.umn.edu/issues/18556
• IPUMSI accents not displaying in variable descriptions, source docs: https://redmine.pop.umn.edu/issues/18607
• IPUMSI Labor Force Surveys functionality: https://redmine.pop.umn.edu/issues/18228

• Fix bug in which UofA without a default respondent type wasn't being handled: https://redmine.pop.umn.edu/issues/18701

• Modify "nontab" parsing behavior in CsvVariablesParser: https://redmine.pop.umn.edu/issues/18556
• IPUMSI Labor Force Surveys functionality: https://redmine.pop.umn.edu/issues/18228

• Support PMA name change: https://redmine.pop.umn.edu/issues/18588

• Variable search: source variables showing up in search for projects that hide source variables: https://redmine.pop.umn.edu/issues/18544

• Fix bug in new "too many running extracts implementation: https://redmine.pop.umn.edu/issues/18512
• DHS: citation text missing from extract-is-ready email: https://redmine.pop.umn.edu/issues/18473
• DHS: disable "show all groups" display option: https://redmine.pop.umn.edu/issues/18499

• DHS variable selection: authorized sample names should display in green, unauthorized in gray: https://redmine.pop.umn.edu/issues/18380
• Reimplement "too many enqueued or currently processing extracts" functionality to use Tractor data: https://redmine.pop.umn.edu/issues/18474

• DHS sample selection: authorized sample names should display in green, unauthorized in gray
• Harden extract submission: https://redmine.pop.umn.edu/issues/18428

• CPS: unharmonized variables: https://redmine.pop.umn.edu/issues/18177

• Fix extract resubmit: https://redmine.pop.umn.edu/issues/18386
• Remove Shibboleth from ipums-web: https://redmine.pop.umn.edu/issues/17776
• Fix variable sorting bug in USA: https://redmine.pop.umn.edu/issues/18389
• Add endpoint for citation text (for static pages): https://redmine.pop.umn.edu/issues/18028

• NHIS: implement rectangularization-down on injury records: https://redmine.pop.umn.edu/issues/18039
• Sort by N of Samples overwritten? (feature accidentally removed from last release): https://redmine.pop.umn.edu/issues/18366
• DHS: admin system: get show_user working: https://redmine.pop.umn.edu/issues/18226
• Fix bug in use of variables in ERB maintenance template (Rails variables not available to template in this case)
• Various changes support reporting capabilities
• Add Docker support for Jenkins and app deployment (changes migrates from Docker sprint branch)

• Redesign variable selection page: https://redmine.pop.umn.edu/issues/16966
• Make display options and country abbreviations dialog boxes: https://redmine.pop.umn.edu/issues/16966
• Fix frequencies promote for DHS: https://redmine.pop.umn.edu/issues/18277
• Better maintenance page: https://redmine.pop.umn.edu/issues/18295

• Implement GTM on all dynamic product sites: https://redmine.pop.umn.edu/issues/18155

• Implemented ViewPreferences::VariableSortOrder: https://redmine.pop.umn.edu/issues/17322
• Make effect of case selection on extract size explicit: https://redmine.pop.umn.edu/issues/17403
• Made citation text metadata driven: https://redmine.pop.umn.edu/issues/11972
• Enabled rectangularize on activity for AHTUS, MTUS (MEPS got it enabled in live earlier): https://redmine.pop.umn.edu/issues/17306

• Rectangularizing parent rectype data down to child rectype on MEPS: https://redmine.pop.umn.edu/issues/17306

• Add to Google Tag Manager snippets to layout views for IPUMSI : https://redmine.pop.umn.edu/issues/18124

• Harden tractor job submission code: https://redmine.pop.umn.edu/issues/18052

• Tractor: extract workers eventually die on DHS live: https://redmine.pop.umn.edu/issues/18070
• Fix capitalization of links to Stata files on extract downloads page: https://redmine.pop.umn.edu/issues/18022

• User-facing changes:
  • Bump up concurrent jobs for ATUS, MTUS: https://redmine.pop.umn.edu/issues/18065

• User-facing changes:
  • Tractor: implement cross-product extract queue orchestrator (aka Orca): https://redmine.pop.umn.edu/issues/16732

• User-facing changes:
  • Improve query performance of extract_requests#variables: https://redmine.pop.umn.edu/issues/17912
• Bug fixes:
  • A failed StatTransfer job should result in an extract with completion_status="failed": https://redmine.pop.umn.edu/issues/17972

• User-facing changes:
  • Cap default max allowed extract size at 12GB: https://redmine.pop.umn.edu/issues/18009

• Non-user-facing-changes:
  • Include contents of StatTransfer log in notification emails: https://redmine.pop.umn.edu/issues/17768
• Bug fixes:
  • Fix issue in which login status checks would sometimes throw exceptions: https://redmine.pop.umn.edu/issues/17836

• User-facing-changes:
  • Metadata-driven display of shared MEPS & NHIS integrated variables: https://redmine.pop.umn.edu/issues/17319, https://redmine.pop.umn.edu/issues/16922

• User-facing-changes:
  • Update USA citation: https://redmine.pop.umn.edu/issues/17802

• User-facing-changes:
  • Variable search improvements: introducing Advanced Search: https://redmine.pop.umn.edu/issues/16946

• User-facing-changes:
  • Updatde MTUS citation: https://redmine.pop.umn.edu/issues/17744

• User-facing-changes:
  • Enable PMA survey text: https://redmine.pop.umn.edu/issues/17695

• Bug fixes:
  • Sample Members selected in Samples page gets reset: https://redmine.pop.umn.edu/issues/17534
  • Glitch in sample case selection IPUMS PMA: https://redmine.pop.umn.edu/issues/17645
  • Live PMA extract summary page error: https://redmine.pop.umn.edu/issues/17469

• Bug fixes:
  • Sample Members selected in Samples page gets reset: https://redmine.pop.umn.edu/issues/17534
  • Glitch in sample case selection IPUMS PMA: https://redmine.pop.umn.edu/issues/17645
  • Live PMA extract summary page error: https://redmine.pop.umn.edu/issues/17469

• Non-user-facing changes:
  • Extract engine/queue: add more lanes: https://redmine.pop.umn.edu/issues/17656
  • Abacus metadata update

• Bug fixes:
  • Sample Members selected in Samples page gets reset: https://redmine.pop.umn.edu/issues/17534
  • Glitch in sample case selection IPUMS PMA: https://redmine.pop.umn.edu/issues/17645
  • Live PMA extract summary page error: https://redmine.pop.umn.edu/issues/17469

• Non-user-facing changes:
  • Migrate web apps from Tomcat to Passenger: https://redmine.pop.umn.edu/issues/15882

• User-facing changes:
  • Metadata-driven variable renaming: https://redmine.pop.umn.edu/issues/17263

• Non-user-facing changes:
  • USA live: limit max allowed simultaneous extract jobs to 8: https://redmine.pop.umn.edu/issues/17386
  • MTUS live: MTUS live: restore max concurrent jobs to 3: https://redmine.pop.umn.edu/issues/17406
• Bug fixes:
  • Restore missing ATUS cog image on with whom for time use variable creation: https://redmine.pop.umn.edu/issues/17287
  • Fix Abacus label bug: https://redmine.pop.umn.edu/issues/17326

• User-facing changes:
  • Make variable search case insensitive: https://redmine.pop.umn.edu/issues/1710
• Non-user facing changes:
  • Simplify handling of common variables in syntax files: https://redmine.pop.umn.edu/issues/17058
• Bug fixes:
  • Resubmit shouldn't be available for a processing extract: https://redmine.pop.umn.edu/issues/17254
  • Fix doubles round issue with new syntax file gem version: https://redmine.pop.umn.edu/issues/17162

• User-facing changes:
  • Update "keyvar" metadata attribute for IHIS and MEPS: https://redmine.pop.umn.edu/issues/17268
  • General improvements to variable search: https://redmine.pop.umn.edu/issues/16921
• Bug fixes:
  • Fix typo in text for link to SPSS command files: https://redmine.pop.umn.edu/issues/17259
  • Fix doubles round issue with new syntax file gem version: https://redmine.pop.umn.edu/issues/17162

• User-facing changes:
  • Updated citation.

• Non-user facing changes:
  • cleaned up MarkupTransform URL generation; fixed abacus enum text serializer SHA: a6108e7f162ff6ebe1a45691bdc25d8fa24fe562

• User-facing changes:
  • CPS: Fixed the typo in DOI version : https://redmine.pop.umn.edu/issues/17126
  • Made search case insensitive: https://redmine.pop.umn.edu/issues/17105 (NOTE: The database has not been migrated)
• Non-user facing changes:
  • Added handling for general_detailed subpopulations in abacus: SHA c56cb65912646c1fd80c0e879625c9f8abf8eba7

• Non-user-facing changes:
  • DHS: add endpoint to ping external DHS Program login service: https://redmine.pop.umn.edu/issues/17108
  • Time-use: provide more detailed context information in TUV-construction-related error messages: https://redmine.pop.umn.edu/issues/17109

• User-facing changes:
  • MTUS variable descriptions: hide flags tab, clean up tabs code: https://redmine.pop.umn.edu/issues/17005
• Non-user-facing changes:
  • MTUS: bump max extract jobs to 16 (temporarily for 10/22-10/23 MTUS worksop): https://redmine.pop.umn.edu/issues/17060

• User-facing changes:
  • IPUMSI: fix class extract route to instructor extract data: https://redmine.pop.umn.edu/issues/16927

• User-facing changes:
  • New unit of analysis: https://redmine.pop.umn.edu/issues/16133
  • Change codes tab display on IPUMS PMA to 4-digit years: https://redmine.pop.umn.edu/issues/16994
• Bug fixes:
  • Only add "derived" common variable to extract request if "primary" form is also present in request: https://redmine.pop.umn.edu/issues/16989

• Bug fixes:
  • DHS: login not working: https://redmine.pop.umn.edu/issues/17043

• Bug fixes:
  • Add missing derived common variables at extract submission: https://redmine.pop.umn.edu/issues/16980

• User-facing changes:
  • IPUMSI: update citation in extract email: https://redmine.pop.umn.edu/issues/16913
• Bug fixes:
  • Only add "derived" common variable to extract request if "primary" form is also present in request: https://redmine.pop.umn.edu/issues/16989

• Non-user-facing changes:
  • Route for downloading gzipped supplemental datasets: https://redmine.pop.umn.edu/issues/16358
  • Rename "frequency_types" table to "respondents":https://redmine.pop.umn.edu/issues/16135
  • Respondents (a.k.a "sample members") now scoped by unit of analysis: https://redmine.pop.umn.edu/issues/16135
• User-facing changes:
  • Support popup EULA for supplemental datasets : https://redmine.pop.umn.edu/issues/16358

• Bug fixes:
  • Fix banner display issue on internal/live NHIS/MEPS: https://redmine.pop.umn.edu/issues/16737

• Bug fixes:
  • MEPS: common variables misnamed in IPUMS extract codebook: https://redmine.pop.umn.edu/issues/16734
  • MEPS: hierarchical preselect variables not getting added to extract requestsL https://redmine.pop.umn.edu/issues/16723

• Non-user-facing changes:
  • variables control file: use display_mnemonic field to support duplicate variable names across subprojects: https://redmine.pop.umn.edu/issues/16478

• User-facing changes:
  • Left align narrow layout to more closely resemble wide layout: https://redmine.pop.umn.edu/issues/16499
• Bug fixes:
  • Fix vertical alignment problem with the narrow layout: https://redmine.pop.umn.edu/issues/16499
  • Fix error encountered when predeploying mixed compressed and uncompressed data: https://redmine.pop.umn.edu/issues/16620
• User-facing changes:
  • Fix performance of extract_requests/status API endpoint

• User-facing changes:
  • Support R syntax files as a downloadable extract artifact: https://redmine.pop.umn.edu/issues/14796

• User-facing changes:
  • Generalize former replicate weight function with master/subordinate variables feature: https://redmine.pop.umn.edu/issues/14913
  • Master/subordinate variables: allow subordinate variables to be selectable via sub_show metadata flag: https://redmine.pop.umn.edu/issues/14911
  • PMA: enable dynamic revisions feature: https://redmine.pop.umn.edu/issues/15904
  • Predeploy: support compressed data in output/current: https://redmine.pop.umn.edu/issues/16140
  • Manual weights support: https://redmine.pop.umn.edu/issues/15589
• Bug fixes:
  • Variable search: source variables from hidden samples showing up in search: https://redmine.pop.umn.edu/issues/16188

• Bug fixes:
  • Fix StatTransfer/Stata long string performance bug: https://redmine.pop.umn.edu/issues/16048

• Bug fixes:
  • Handle bad metadata more robustly in MarkupTransform#load_link : https://redmine.pop.umn.edu/issues/16086
  • Excessive logging was causing disk to fill up and extract engine performance problems: https://redmine.pop.umn.edu/issues/16111

• User-facing changes:
  • Update NAPP registration page [1]: https://redmine.pop.umn.edu/issues/16016
  • PMA: add Gates attribution: https://redmine.pop.umn.edu/issues/15970
• Non-user-facing changes:
  • Close standard out and standard error when running extract engine in production: https://redmine.pop.umn.edu/issues/16077
  • Refactor sample header partials for codes pages: https://redmine.pop.umn.edu/issues/16033
  • Abacus API support
• Bug fixes:
  • IPUMS USA codes page rendering issue: https://redmine.pop.umn.edu/issues/15788

• Non-user-facing changes:
  • Configurable fast lanes: https://redmine.pop.umn.edu/issues/15955

• Bug fixes:
  • DDI Fixes: https://redmine.pop.umn.edu/issues/15567, https://redmine.pop.umn.edu/issues/15774, https://redmine.pop.umn.edu/issues/15802

• User-facing changes:
  • DHS Household members unit of analysis: https://redmine.pop.umn.edu/issues/15336
  • Enable dynamic revisions for DHS: https://redmine.pop.umn.edu/issues/15948

• Non-user-facing changes:
  • Configurable fast lanes

• Bug fixes:
  • variable-sample availability header display broken for data products that do not have countries: https://redmine.pop.umn.edu/issues/15877

• Bug fixes:
  • DDI Fixes: https://redmine.pop.umn.edu/issues/15567, https://redmine.pop.umn.edu/issues/15774, https://redmine.pop.umn.edu/issues/15802
• User-facing changes:
  • Added new header for skins in dynamic side: https://redmine.pop.umn.edu/issues/15858

• User-facing changes:
  • Support for IAPM Portal: https://redmine.pop.umn.edu/issues/15858
• Bug fixes:
  • Increase the width of DHS unit-of-analysis selection dialog to get rid of horizontal scroll: https://redmine.pop.umn.edu/issues/15855

• Bug fixes:
  • NAPP sample years in variable availability not working: https://redmine.pop.umn.edu/issues/15863

• Changes:
  • Merge NAPP historical samples into IPUMSI: https://redmine.pop.umn.edu/issues/116, https://redmine.pop.umn.edu/issues/15714

• User-facing changes:
  • UX and UI revamp for top banner of all projects: https://redmine.pop.umn.edu/issues/14418

• User-facing changes:
  • Redirect WTSUPP variable page to info page about weight variable rename: https://redmine.pop.umn.edu/issues/15585
• Non-user-facing changes:
  • Support for PMA project
• Bug fixes:
  • Fixed variable availability display when multiple samples share the same year: https://redmine.pop.umn.edu/issues/15663

• User-facing changes:
  • Extend 1940 EULA to cover all USA full-count data: https://redmine.pop.umn.edu/issues/15542

• User-facing changes:
  • Enable super-groups for CPS: https://redmine.pop.umn.edu/issues/15577

• Non-user-facing changes:
  • Remove the duplicate-variable debugging alert: https://redmine.pop.umn.edu/issues/15219
• Bug fixes:
  • IPUMSI sample details should not be filtered by data cart selections: https://redmine.pop.umn.edu/issues/15510
  • Updated max household size for IPUMSI in classic extract engine: https://redmine.pop.umn.edu/issues/15477

• User-facing changes:
  • Update to IPUMS MEPS citation: https://redmine.pop.umn.edu/issues/15417

• User-facing changes:
  • NHIS: Got rid of "Coming Soon" part in MEPS-Coming Soon SHA: 0e9decd258f030e3b353acf8040872ec947d8a5e

• User-facing changes:
  • MEPS: Making Description tab as default instead of Codes: https://redmine.pop.umn.edu/issues/15302
  • Updated case selection text (e.g 3 of 10 codes) on extract summary: https://redmine.pop.umn.edu/issues/15290
• Bug fixes:
  • MEPS: use of is_preliminary to drive comparability tab: https://redmine.pop.umn.edu/issues/15037
  • MEPS: Fixed the bug of YEAR being marked as is_old following every metadata deploy: https://redmine.pop.umn.edu/issues/14746
• Non-user-facing changes:
  • PMA: Support for ipums.dhs ipums_comparability tag in variable description: https://redmine.pop.umn.edu/issues/13914
  • Guard for empty frequency file: https://redmine.pop.umn.edu/issues/15346

• User-facing changes:
  • MEPS: Enabled repwt for entire MEPS project SHA: 9c9a2578452fb91c78b2eddc5d9143f0badd0591
  • MEPS: Enabled Flags SHA: d4e767096a91e45a560aa1e303be5878b1352738
  • CPS: enable super groups for cps internal: https://redmine.pop.umn.edu/issues/15392

• User-facing changes:

  • Added countries API endpoint SHA: 32aa91d637881c229d0c0f0600083e7e6ab012ff
  • CPS variable display option and pre-selected samples: https://redmine.pop.umn.edu/issues/14128
  • PMA samples ordered in columns (similar to IPUMSI) https://redmine.pop.umn.edu/issues/14653
  • Support for in universe tab (relevant to MEPS): https://redmine.pop.umn.edu/issues/14821
  • is_preliminary column driving Description, Universe tabs (MEPS specific): https://redmine.pop.umn.edu/issues/15037

• Bug fixes:

  • Add migration to remove duplicate user unique_ids; add unique index to prevent future dupes :https://redmine.pop.umn.edu/issues/15178
  • Revised YEAR/YEAP fix for MEPS. We're now renaming YEARP to YEAR during MEPS metadata deployment https://redmine.pop.umn.edu/issues/14746
  • Guard for invalid skin strings SHA:dccec0564cb54c5b830a2fce8bbd8ef1f26ecba8

• Non-user-facing changes:

  • Subproject support to links metadata https://redmine.pop.umn.edu/issues/14931
  • Enabled :is_preliminary column for multi-project value parsing. https://redmine.pop.umn.edu/issues/15037

• User-facing changes:
  • IEPM links: https://redmine.pop.umn.edu/issues/15163
  • IECM/IEPM portal logo positioning/size https://redmine.pop.umn.edu/issues/15065

• User-facing changes:
  • Suppor both IECM and IEPM: https://redmine.pop.umn.edu/issues/15163
• Non-user-facing changes:
  • Pull new enum implementation into concern. SHA:af48aaba82e4d2f87779dced4dae155d419d75c0
  • Use intuitive strings in preselect status instead of numbers: https://redmine.pop.umn.edu/issues/14938

• User-facing changes:
  • DHS: add guest login text change: https://redmine.pop.umn.edu/issues/14751
  • DHS: add guest login functionality: https://redmine.pop.umn.edu/issues/14751
  • Enable REPWT code for IPUMS-DHS: https://redmine.pop.umn.edu/issues/14764
  • Lots of changes supporting MEPS

• User-facing changes:
  • DHS: add guest login text change: https://redmine.pop.umn.edu/issues/14751

• User-facing changes:
  • DHS: add guest login functionality: https://redmine.pop.umn.edu/issues/14751
  • Enable REPWT code for IPUMS-DHS: https://redmine.pop.umn.edu/issues/14764
  • Lots of changes supporting MEPS

• User-facing changes:
  • Banner for IECM portal site: https://redmine.pop.umn.edu/issues/14875
• Bug fixes:
  • Update syntax file gem to support StatTransfer 14: https://redmine.pop.umn.edu/issues/15010
  • CsvVariablesParser/VariableData fails to update any field in the variables table that is being changed to nil/NULL: https://redmine.pop.umn.edu/issues/14914
• Non-user-facing changes:
  • Automated test suite now runs in a Docker container. Each run spawn a new container: https://redmine.pop.umn.edu/issues/15015
  • Remove renum gem: https://redmine.pop.umn.edu/issues/15014

• User-facing changes:
  • remove link to past revisions on MTUS: https://redmine.pop.umn.edu/issues/14784
• Bug fixes:
  • Detailed variables are always dropped when an extract is revised: https://redmine.pop.umn.edu/issues/14855
  • RecordTypesParser not handling subprojects: https://redmine.pop.umn.edu/issues/14849
• Non-user-facing changes:
  • During metadata loading in projects that do not make source variables public, suppress invalid group warning for source variables: https://redmine.pop.umn.edu/issues/14865

• User-facing changes:
  • Allow projects (NHIS, MEPS) to override dynamic FAQ with a static FAQ page to which the top-nav hyperlink should point: ttps://redmine.pop.umn.edu/issues/14797
• Bug fixes:
  • focal_record_type_id not getting properly set to null in ExtractRequestController#update_structure action for hierarchical extracts: https://redmine.pop.umn.edu/issues/14725
  • Fixed repitition of request variables in extracts and rake task to delete them: https://redmine.pop.umn.edu/issues/14739
  • Cleaning up setting of subprojects in tests: https://redmine.pop.umn.edu/issues/14771
• Non-user-facing changes:
  • MEPS/NHIS: support "subprojects" field in variable groups metadata: https://redmine.pop.umn.edu/issues/14771

• Bug fixes:
  • Fixed repitition of request variables in extracts and rake task to delete them: https://redmine.pop.umn.edu/issues/14739
  • Cleaning setting of subprojects in tests: https://redmine.pop.umn.edu/issues/14771
• Non-user-facing changes:
  • MEPS/NHIS: support "subprojects" field in variable groups metadata: https://redmine.pop.umn.edu/issues/14771

• Bug fixes:
  • Fix incorrect selection of data-format and data-structure checkboxes when revising extract: https://redmine.pop.umn.edu/issues/14719
  • Add UMA API config for live DHS to enable admin email/user lookups: https://redmine.pop.umn.edu/issues/14703
• User-facing changes:
  • PMA updates: https://redmine.pop.umn.edu/issues/14652, https://redmine.pop.umn.edu/issues/14633, https://redmine.pop.umn.edu/issues/14651
• Non-user-facing changes:
  • Rename NhisNamesParser to OriginalVariableNamesParser: https://redmine.pop.umn.edu/issues/14735
  • Make has_original_record_types and has_original_variable_names project-level settings: https://redmine.pop.umn.edu/issues/14736

• User-facing changes:
  • UI/UX improvements to extract downloads page: https://redmine.pop.umn.edu/issues/13741
• Non-user-facing changes:
  • Add google analytics snippets for HigherEd, MEPS, and PMA: https://redmine.pop.umn.edu/issues/14712

• Bug fixes:
  • Fix DHS bug: unit of analysis interfering with sample selection: https://redmine.pop.umn.edu/issues/14625
  • Fix DHS bug: variable menu rendering throwing an error following a unit of analysis change, because sample were not being correctly removed from cart: https://redmine.pop.umn.edu/issues/13444
• User-facing changes:
  • DHS: make long country code the default in variable availability grid: https://redmine.pop.umn.edu/issues/14560

• User-facing changes:
  • Better handle case in which a user's email address has become invalid: https://redmine.pop.umn.edu/issues/14177
• Non user-facing changes:
  • Refactor ExtractRequest class so that variable display order and sorting functionality is better encapsulated: https://redmine.pop.umn.edu/issues/14573
• Bug fixes:
  • Restore IDHS extract email sending functionality: https://redmine.pop.umn.edu/issues/14501
  • Fix "update density" bug occurring in old versions of safari: https://redmine.pop.umn.edu/issues/14264

• Bug fixes:
  • Temporary rollback to fix: IPUMS-DHS live and internal: unit of analysis selection not properly filtering variable groups: https://redmine.pop.umn.edu/issues/14574
  • Restore IDHS extract email sending functionality: https://redmine.pop.umn.edu/issues/14501

• Bug fixes:
  • Fixed the bug of incorrect name and order of variable_groups displayed in the menu. It would always display that of "Women": https://redmine.pop.umn.edu/issues/14574

• Bug fixes:
  • Refacored cart tallies: https://redmine.pop.umn.edu/issues/14148
  • Fixed js errors on older Safari versions: https://redmine.pop.umn.edu/issues/14264
• Non user-facing changes
  • Refactored extract_request.rb by moving methods to ExtractRequest::DhsAuthorization, ExtractRequest::ExtractFiles, ExtractRequest::Variables SHA: f676ff54d0658920e803a4ad39f1dcf85b32a212

• User-facing changes:
  • NHIS, MEPS: top nav text changes: https://redmine.pop.umn.edu/issues/14528
  • Update MEPS banner on dynamic internal site to remove 'Coming Soon': https://redmine.pop.umn.edu/issues/14511
  • IPUMS-PMA: add banner to dynamic site: https://redmine.pop.umn.edu/issues/14505
• Bug fixes:
  • DHS: Logging in after selecting a variable redirects to the User Options page: https://redmine.pop.umn.edu/issues/14367

• Bug fixes:
  • NHIS work area is named '/pkg/ipums/ihis': https://redmine.pop.umn.edu/issues/14469
  • Failure in changing unit_of_analysis in the dialog window: https://redmine.pop.umn.edu/issues/14463, https://redmine.pop.umn.edu/issues/14431, https://redmine.pop.umn.edu/issues/14309
• Non user-facing changes:
  • rename sub_project to subproject for consistency: SHA: 29f0e1c7fdba99504734f33440df257e7898e0dc, 554b75c5b0bc29f9966de05fe8073b181881fc15

• User-facing changes:
  • Get DDI extract codebooks working for DHS: https://redmine.pop.umn.edu/issues/14042
• Non user-facing changes:
  • DHS: add citation text and DOI to project settings: https://redmine.pop.umn.edu/issues/14397
• Bug fixes:
  • Restore citation text to DHS extract email: https://redmine.pop.umn.edu/issues/14396

• User-facing changes:
  • Upgrade DDI schema/syntax to version 2.5: https://redmine.pop.umn.edu/issues/14456
• Non user-facing changes:
  • Design and implement extract groups concept to support DOI snapshot work: https://redmine.pop.umn.edu/issues/14458
  • Redesign extract processor (a.k.a. queuing) to support extract groups: https://redmine.pop.umn.edu/issues/14459
  • Add API endpoints to support AVEC command line tool: https://redmine.pop.umn.edu/issues/14455
• Bug fixes:
  • Fix various bugs in the DDI (esp. record type problems): https://redmine.pop.umn.edu/issues/14457

• Bug fixes:
  • Fix bug in which RECTYPE is not considered a valid variable for extract in some projects: https://redmine.pop.umn.edu/issues/14376, https://redmine.pop.umn.edu/issues/14143

• Bug fixes:
  • Allow DHS routes to be defined only when DHS webapp is running to fix 'dhs_login#validate_login (RuntimeError) "Not Implemented"' error: https://redmine.pop.umn.edu/issues/14282

• User-facing changes:
  • Preliminary support for IPUMS-PMA: https://redmine.pop.umn.edu/issues/13728
• Bug fixes:
  • Allow DHS routes to be defined only when DHS webapp is running to fix 'dhs_login#validate_login (RuntimeError) "Not Implemented"' error: https://redmine.pop.umn.edu/issues/14282

• Bug fixes:
  • CPS live: fix bug in which RECTYPE was being incorrectly included in rectangular extracts: https://redmine.pop.umn.edu/issues/14259

• Bug fixes:
  • Fix possible SQL injection in search: https://redmine.pop.umn.edu/issues/14270
  • Fix Back button handling: https://redmine.pop.umn.edu/issues/14268
  • Remove spurious "Unable to get list of time use variables name in cart." error messages: https://redmine.pop.umn.edu/issues/14193

• Bug fixes:
  • Fix search bug: https://redmine.pop.umn.edu/issues/14192

• User-facing changes:
  • Support IHIS-to-NHIS rename in the codebase: https://redmine.pop.umn.edu/issues/13730

• Bug fixes:
  • Fix incorrect record type in DDI for TUVs: https://redmine.pop.umn.edu/issues/14032
• User-facing changes:
  • DHS search: only mnemonic and label should be checked by default: https://redmine.pop.umn.edu/issues/14157
  • Big performance enhancement for variable search functionality: https://redmine.pop.umn.edu/issues/13225

• Bug fixes:
  • Fix broken route and incorrect text for IPUMS-NHIS/NHIS crosswalk: https://redmine.pop.umn.edu/issues/14169

• Bug fixes:
  • Fix link generated by <comp.ipums> tag: https://redmine.pop.umn.edu/issues/14174

• Non user-facing changes:
  • Merge MEPS code into master: https://redmine.pop.umn.edu/issues/10313
  • ATUS, AHTUS to ipums-external-web: https://redmine.pop.umn.edu/issues/13491
• Bug fixes:
  • Fix variables-in-cart count: https://redmine.pop.umn.edu/issues/14105
  • Remove rectype when changing extract layout from hierarchical to rectangular: https://redmine.pop.umn.edu/issues/14039
  • Fix display issue with attached characteristics: https://redmine.pop.umn.edu/issues/14124
  • Fix functionality in which the option to change extract output formats is disabled for hierarchical extracts (introduced in https://github.com/umn-isrdi/ipums-web/commit/afa1e2d): https://redmine.pop.umn.edu/issues/14039

• User-facing changes:
  • IPUMS partner site country-based filtering for sample details page: https://redmine.pop.umn.edu/issues/13772
• Bug fixes:
  • Get rid of headers and footers in TUV description and category documentation popups: https://redmine.pop.umn.edu/issues/13836

• Bug fixes:
  • Highered samples page was blowing up, so returned AR relation in get_visible_samples. SHA: 64b5879c56ce30e9e61d3d1bd403ad2e2fb22d5a

• User-facing changes:
  • Long name display on universe, availability tabs: https://redmine.pop.umn.edu/issues/13882
  • Add a count of the number of chopped off extract options that have been added https://redmine.pop.umn.edu/issues/13821
  • Tweak the codes page to help users find the detailed codes easier https://redmine.pop.umn.edu/issues/13744
  • Improve Feedback for Extract Options (case selection, etc) https://redmine.pop.umn.edu/issues/13743
  • Expose the selected file format to the user on the summary page https://redmine.pop.umn.edu/issues/13742
  • Support shared, IHIS/MEPS or IPUMSI/NAPP content in variable descriptions https://redmine.pop.umn.edu/issues/11376
  • addition of 'common'/default sample selection for cps https://redmine.pop.umn.edu/issues/13118
• Non user-facing changes:
  • Get ipumsi premerged project working https://redmine.pop.umn.edu/issues/13760
  • Create script to auto-generate files required for a new IPUMS data project : https://redmine.pop.umn.edu/issues/13745
  • Don't overload display_group column for use as sub_project https://redmine.pop.umn.edu/issues/13720
• Bug fixes:
  • Fix performance of ExtractRequest#add_weights https://redmine.pop.umn.edu/issues/13644
  • ignore variables belonging to hidden record_type https://redmine.pop.umn.edu/issues/13584

• Non user-facing changes:
  • Allow fine-grained control of hierarchical sibling (e.g. eldercare in ATUS) display by making feature metadata-driven: https://redmine.pop.umn.edu/issues/13353
  • Remove 8 unused methods from VariablesHelper: https://redmine.pop.umn.edu/issues/13423
• Bug fixes:
  • Fix predeploy encoding problem when run on gp1 but not on ipums-internal-web by using UNIX cut command to parse sample names from control file: https://redmine.pop.umn.edu/issues/13690

• User-facing changes:
  • Updated citations: https://github.com/umn-isrdi/ipums-web/commit/490d0f7a987a7d384e49d8d14b879fcaa3fe2d21
  • Updated DDI codebook (bumped version to 2.5; includes DOI version; added serStmt element): https://redmine.pop.umn.edu/issues/13224
• Non user-facing changes:
  • Added several API endpoints under /api/extracts/v1 (handles both DOI tool and new status implementation): https://github.com/umn-isrdi/ipums-web/commit/96dcb092798373f9049193f654c40a510c382b0c
  • Added extract_request_group model + associations to extract_request: https://redmine.pop.umn.edu/issues/12339
  • Refactored extract_requests to name extract files differently if part of a group: https://redmine.pop.umn.edu/issues/12339
  • Refactored extract_worker and extract_request to use ExtractRequest#complete_extract! for marking completed extracts and sending email: https://redmine.pop.umn.edu/issues/12339
  • Performance updates to extract_request and codebooks (specially DDI) during #submit: https://redmine.pop.umn.edu/issues/13119
  • Added code to retrieve extract engine status (lib/extract_engine_status.rb): https://github.com/umn-isrdi/ipums-web/commit/96dcb092798373f9049193f654c40a510c382b0c
  • Moved DOI version string out of citation string so it's available to the DDI codebook (in project settings): https://github.com/umn-isrdi/ipums-web/commit/a6fad2cd937efac5daa666834cad3abfa0955ee7
  • Add canceled extract request completion_status: https://github.com/umn-isrdi/ipums-web/commit/96dcb092798373f9049193f654c40a510c382b0c
• Bug fixes:
  • Fix more link in var desc comparability: https://redmine.pop.umn.edu/issues/13687

• Bug fixes:
  • Work around bug in Nokogiri library: https://github.com/umn-isrdi/ipums-web/commit/aeda5d506e111ec60f69474eb4aba0ae05898e75

• Bug fixes:
  • CPS live: fix broken universe statement display for certain variables: https://redmine.pop.umn.edu/issues/13668

• User-facing changes:
  • Adde before_filter for ipums-m branch merged to master: https://redmine.pop.umn.edu/issues/12740
  • Serve codebooks as UTF8 instead of 'iso-8859-1: https://redmine.pop.umn.edu/issues/13148
• Non user-facing changes:
  • Added ci_test script; set ci DB config to use ENV vars: sha: 05bf0591b6e4fb6599b7b1c4431ca7c568c3ef10
• Bug fixes:
  • Fixed frequencies/variable edge case errors: https://redmine.pop.umn.edu/issues/13562
  • Discard empty rows in CSV while parsing: https://redmine.pop.umn.edu/issues/13585

• Bug fixes:
  • Reverted connect_to_data() invocation in ReportsConnection
  • Fixed the bug of missing css extension (required after using sprockets 3) and a javascript bug of missing quote.

• User-facing changes:
  • Update IPUMS-NHIS citation: https://redmine.pop.umn.edu/issues/13082
  • Remove dots that appear on samples pages: https://redmine.pop.umn.edu/issues/12581
• Non user-facing changes:
  • Make common variables metadata-driven: https://redmine.pop.umn.edu/issues/12332
• Bug fixes:
  • Sample Designs vs. Sample Details on Live Sample Selection menu: https://redmine.pop.umn.edu/issues/13399
  • IPUMSI: Handle additional date format(s) in revisions parser: https://redmine.pop.umn.edu/issues/13499
  • DHS live: variables#group (ActionView::Template::Error) ActiveRecord::JDBCError: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: https://redmine.pop.umn.edu/issues/13444
  • Hierarchical common variables attached to Extracts are invisible: https://redmine.pop.umn.edu/issues/13103

• User Facing changes:
  • Styling for DHS unit_of_analysis boxes: https://redmine.pop.umn.edu/issues/13311
  • Displaying enum_texts for hidden source variables in USA using project.displays_hidden_var_enum_text flag: https://redmine.pop.umn.edu/issues/13389
• Non User Facing changes:
• Bug fixes:
  • --ignore-missing-args flag in rsync for DHS: https://redmine.pop.umn.edu/issues/13043

• User Facing changes:
• Non User Facing changes:
• Bug fixes:
  • Reverted project.ignores_unharmonized_trans_tables for USA to be false
  • Bug of rsync exclude_list jammed together without space in-between during predeploy (sha: da520fa)
  • Enabled resetting of ipums_comparability by VariableDescription parser: https://redmine.pop.umn.edu/issues/13292

• User Facing changes:

  • Visible source vars for USA: https://redmine.pop.umn.edu/issues/13203, https://redmine.pop.umn.edu/issues/12807
  • Editing procedures for USA: https://redmine.pop.umn.edu/issues/11952
  • Enabled Attach characteristics for same-sex parents for USA: https://redmine.pop.umn.edu/issues/13217
  • Enabled has_notes for USA: https://redmine.pop.umn.edu/issues/13293

• Non User Facing changes:

  • cap data:predeploy_all_frequencies added
  • frequency predeploy capistrano task made smarter to clean the extra file in destination (sha: 5ec4823, f067a8e)
  • modified FrequencyParser for better handling case with sample list provided (sha: a5efa88)

• Bug fixes:

  • Added ExtractRequest locking to prevent potential race conditions when updating the cart: https://redmine.pop.umn.edu/issues/13115

• User Facing changes:

  • Increased width of IHIS logo: https://redmine.pop.umn.edu/issues/13017
  • Hide tutorial button for demo ihis
  • Switch on development mode for internal IPUMSI: https://redmine.pop.umn.edu/issues/13154
  • Replaced all occurrence of ihis by IPUMS nhis under app/views directory: https://redmine.pop.umn.edu/issues/13045

• Non User Facing changes:

  • Exclude *.layouts.text from rsync: https://redmine.pop.umn.edu/issues/13017

• Bug fixes:

  • Fixed the string comparision and nil bug in cache method RecordType#find_by_id: https://redmine.pop.umn.edu/issues/13142
  • Links parser blowing up because of empty content: https://redmine.pop.umn.edu/issues/13035
  • Reloading all variables parser when source_document for a sample gets changed: https://redmine.pop.umn.edu/issues/13128

• User Facing changes:
  • Added link to change unit of analysis when browsing variables by letter (relevant to DHS only): https://redmine.pop.umn.edu/issues/13055
  • Enabled revisions for AHTUS live: https://redmine.pop.umn.edu/issues/10374
• Non user-facing changes:
  • Fixed the csv patch which returned blank string instead of nil (SHA: e82e53eb3240ff50d31f10f743adfc0508d01e33).
  • Implemented RecordType#find_by_id method
  • Revisions parser to support multiple date formats: https://redmine.pop.umn.edu/issues/13081

• User Facing changes:

  • Restored households_only file_type for extract_requests (relevant to USA only): https://redmine.pop.umn.edu/issues/13026.
  • added health project menu to base layout (sha: c1099a91198849a52a29e3ff3e56adceff5234aa)
  • Removed background color during hover on the table at top of revisions page: https://redmine.pop.umn.edu/issues/12722
  • Remove "Past Revisions" link from the bottom of the revisions page (relevant to IPUMSI only): https://redmine.pop.umn.edu/issues/12983

• Non User Facing changes:

  • Exception notifier is a project level configuration (sha: 678b52deffd81725b78d345857876f222012220f)

• Bug fixes:

  • Fixed nil reference error when sample is missing short_description (sha: 3e4f3ddd3f6d0c36efab1ec9d143930f83c3b061)
  • Fixed the bug with trailing spaces in category code: https://redmine.pop.umn.edu/issues/13005

• Non user-facing change:
  • Support changed organization of variables control file(s), source doc tagging, and trans_tables metadata: https://redmine.pop.umn.edu/issues/12157
  • Fixed the bug in ExtractRequest#household_or_top_level?. It got introduced while implementing caching of RecordType: https://redmine.pop.umn.edu/issues/13046

• Bug fixes:
  • Bug #12609: more work on the frequencies out of memory error: don't use ActiveRecord objects in query results if not necessary.
  • Bug #12962: Fix bug in which the ATUS respondent frequencies appear to be showing for ATUS non-respondents and vice versa.
  • Extract Record Type conflict in IHIS: IHIS has R records just like ATUS, although they don't refer to eldercare. Extract engine refactor to allow per-project specification of record type. (can't find ticket!, commits are f4af7ac, aee6d35) For more info see: https://redmine.pop.umn.edu/issues/12977

• Bug fixes:
  • restore version of Java in recently compiled core.jar to Java 7 from Java 8

• Bug fixes:
  • Hierarchical syntax files producing number for record types instead of character https://redmine.pop.umn.edu/issues/12890
• Non User Facing changes:
  • Validation for record types

• Bug fixes:
  • Focal_record_type was being set to nil while updating extract structure. https://redmine.pop.umn.edu/issues/12855

• User-facing changes:
  • ATUS: Rectangularizing activity records and supporting Sibling eldercare records in hierarchical extract: https://redmine.pop.umn.edu/issues/6230
  • ATUS: Enabling has_attached_characteristics, attached_chars_same_sex_parents and attached_chars_no_head: https://redmine.pop.umn.edu/issues/12716
  • AHTUS, ATUS, MTUS: Enabling addition of all variables into cart: git sha: a7b85a3cbe3c2daf1fa0871e5c3a627dd6ebc3a7
• Non user-facing changes:
  • Addition of RecordType model and got rid of app/classes/record_types.rb, IPUMS.project.hierarchy and IPUMS.project.record_type_labels
• Bug fixes:
  • group selection bug in variables group page: https://redmine.pop.umn.edu/issues/12732
  • Add To Cart button in variables show page allows addition irrespective of cart data_structure: https://redmine.pop.umn.edu/issues/12725

• Bug fixes:
  • Fix out of memory error in frequencies display: https://redmine.pop.umn.edu/issues/12609

• User-facing changes:
  • Change text in the admin system for improved clarity: https://redmine.pop.umn.edu/issues/12753

• Bug fixes:
  • Enum tagging now supports display and jump texts from multiple files: https://redmine.pop.umn.edu/issues/12493
  • ATUS, AHTUS: Sample topic selection bug: https://redmine.pop.umn.edu/issues/12633

• User-facing changes:
  • IHIS: update citation text: https://redmine.pop.umn.edu/issues/12622
  • IHIS: update User Options page title to use new project name (IHIS to IPUMS NHIS) : https://redmine.pop.umn.edu/issues/12604

• User-facing changes:
  • Widen View Cart hover area: https://redmine.pop.umn.edu/issues/12585

• User-facing changes:
  • New look for all project web apps: https://redmine.pop.umn.edu/issues/11692

• User-facing changes:
  • DHS description text for Birth as unit of analysis in the popup: https://redmine.pop.umn.edu/issues/12188
• Non-user-facing changes:
  • Restructure shebang to work on LDAP'd machines: https://github.com/umn-isrdi/ipums-web/commit/447f9df3118bf7c5b03b6c4ca60e94d421931bf2, https://redmine.pop.umn.edu/issues/12198
  • Use of sample.data_file_name to find sample name instead of manually constructing it: https://redmine.pop.umn.edu/issues/12200
  • Rsyncing of only consolidated frequencies files (both regular and cross_tab) and importing into database from them: https://redmine.pop.umn.edu/issues/11585

• Bug fixes;
  • DHS: fix incorrect response when bad credentials are passed to login form: https://redmine.pop.umn.edu/issues/12162
  • DHS: fix logout, which was always throwing an error: https://redmine.pop.umn.edu/issues/12164
• User-facing changes:
  • DHS login text change: https://redmine.pop.umn.edu/issues/12166

• Bug fixes;
  • IPUMSI: Enum text snippets for a given variable and sample being ordered improperly: https://redmine.pop.umn.edu/issues/11854
• User-facing changes:
  • Update citation text for sites (except for IHIS): https://redmine.pop.umn.edu/issues/11939

• Bug fix:
  • fixed a regression rsync in cap metadata:deploy broken in v11.14.0 : https://redmine.pop.umn.edu/issues/11832

• Bug fixes:
  • Fix Workflow for Resubmitting a Denied Registration: https://redmine.pop.umn.edu/issues/11787
• Non-user-facing changes:
  • Add capistrano task for provisioning directory structure inside /web/ directory: https://redmine.pop.umn.edu/issues/11512

• User-facing changes:
  • CPS universe display: "ASEC" should replace "March" in universe statements (for ASEC samples): https://redmine.pop.umn.edu/issues/114

• Non-user-facing changes:
  • Rename 'metadata2' parsing code and associated directories to 'metadata': https://redmine.pop.umn.edu/issues/1117

• Bug fix:
  • Fix typo in registration groups feature: https://redmine.pop.umn.edu/issues/11492

• User-facing changes:
  • Support attached characteristics without explicit inclusion of family pointers: https://redmine.pop.umn.edu/issues/11452
  • Fix [list] in IHIS universes: https://redmine.pop.umn.edu/issues/11395
  • Change data types in Stata code delivered with extracts: https://redmine.pop.umn.edu/issues/11334

• User-facing changes:
  • MTUS: sample selection page: make checkbox labels hyperlinks to sample documentation: https://redmine.pop.umn.edu/issues/10980
  • AHTUS, ATUS, MTUS: include values for uber categories (rather than only the values of their leaf nodes) in time-use filters: https://redmine.pop.umn.edu/issues/11255
  • MTUS: allow "all" selection in secondary activity filter: https://redmine.pop.umn.edu/issues/11329

• Non-user_facing changes:
  • Point web app Gemfile at renamed syntax file gem on rubygems.org: https://redmine.pop.umn.edu/issues/11247

• User-facing changes:
  • Enable sample notes in IPUMS-USA sample selection: https://redmine.pop.umn.edu/issues/11089
• Non-user_facing changes:
  • Modify mpc_shib_auth and user_management_api to point to mpc github repo instead of rubygems: https://redmine.pop.umn.edu/issues/11080
  • Universe statement in trans table parsing: comment out error message: https://redmine.pop.umn.edu/issues/11060
• Bug fixes:
  • Fix authentication redirect target when attempting to submit an extract while not logged in: https://redmine.pop.umn.edu/issues/11157

• User-facing changes:
  • IHIS: enable attached characteristics with same-sex parents: https://redmine.pop.umn.edu/issues/10336
  • IHIS: enable attached characteristics in extract system: https://redmine.pop.umn.edu/issues/10332
  • IHIS: enable dynamic revisions: https://redmine.pop.umn.edu/issues/10995
• Bug fixes:
  • Upgrade to syntax_file gem 1.7.1: ensure iso-8859-1 output encoding: https://redmine.pop.umn.edu/issues/11021

• User-facing changes:
  • DDI codebooks: now passing the correct encoding as a header param to the browser in send_file: https://redmine.pop.umn.edu/issues/10922
• Non-user-facing changes:
  • Frequencies import code should ignore temporary DCP segment frequency files: https://redmine.pop.umn.edu/issues/10858
  • Upgrade app to Rails v4.2.7.1: https://redmine.pop.umn.edu/issues/10859
  • Refactor enumeration text code: https://redmine.pop.umn.edu/issues/10367

• User-facing changes:
  • HigherEd, MTUS: fix generated DDI codebooks: https://redmine.pop.umn.edu/issues/10814
  • IPUMS API: Include .json extension in API doc examples: https://redmine.pop.umn.edu/issues/10928
• Non-user-facing changes:
  • make predeploy.rb and samples parser differentiate between IHIS and MEPS: https://redmine.pop.umn.edu/issues/10479
  • Move citation text to project settings and share citation text between extract ready mailer and DDI codebooks: https://redmine.pop.umn.edu/issues/10828

• User-facing changes:
  • Sample details: update DDI codebook generator to use sample_details metadata instead of sample_designs: https://redmine.pop.umn.edu/issues/9991
  • CPS: Enable attached characteristics for same-sex parents (now in master): https://redmine.pop.umn.edu/issues/10874
  • ATUS: enable questionnaire text on live: https://redmine.pop.umn.edu/issues/10375
  • USA: turn on dynamic revisions: https://redmine.pop.umn.edu/issues/10867
• Non-user-facing changes:
  • Drop obsolete sample_designs table: https://redmine.pop.umn.edu/issues/9991
  • Delete UMA migration code (since UMA has been live for several weeks): https://redmine.pop.umn.edu/issues/10875

• User-facing changes:
  • CPS: Enable attached characteristics for same-sex parents: https://redmine.pop.umn.edu/issues/10874
    • Deployed from branch attach_characteristics_same_sex_parents

• User-facing changes:
  • Extract request summary page: tighten up spacing of extract revisions buttons: https://redmine.pop.umn.edu/issues/10776
• Non-user-facing changes:
  • Replace obsolete CLA servers in "allowed_compute_hosts" in config/deploy/deploytools.rb with gp1 and gp2: https://redmine.pop.umn.edu/issues/10380

• Bug Fixes:
  • Frequencies predeploy: fix "exclude" clause of rsync: https://redmine.pop.umn.edu/issues/10749

• User-facing changes:
  • Update web app to reflect UMA change (max extract size is now a first-class attribute in UMA): https://redmine.pop.umn.edu/issues/10781
  • Extract request summary page: reorder option buttons: https://redmine.pop.umn.edu/issues/1073
  • ATUS: remove "past revisions" link on revisions page: https://redmine.pop.umn.edu/issues/10597
  • Allow dq flags to be selectable in attached chars interface: https://redmine.pop.umn.edu/issues/10274

• User-facing changes:
  • Support UMA in web app (initial rollout of uma-integration branch was on 7/13/16; this releases merges the branch into master): https://redmine.pop.umn.edu/issues/10698
• Non-user-facing changes:
  • For projects that don't offer source vars for selection, exclude trans table that start with a capital letter from predeploy: https://redmine.pop.umn.edu/issues/10701
• Bug:
  • DHS extract_requests/download page not working in UMA-migrated codebase: https://redmine.pop.umn.edu/issues/10601

• User-facing changes:
  • Metadata API: rename "Snippet" to "SourceDocumentSnippet": https://redmine.pop.umn.edu/issues/10512
• Non-user-facing changes:
  • Rename sestat project to highered in the web app: https://redmine.pop.umn.edu/issues/9246

• User-facing changes:
  • IDHS: Implement rebranded banner for documentation pages: https://redmine.pop.umn.edu/issues/10389
  • IDHS: Implement rebranded banner for extract pages: https://redmine.pop.umn.edu/issues/10390
• Bug fixes:
  • Sample details: Changing the tab in sample_details/country/ does not update the url: https://redmine.pop.umn.edu/issues/9997

• User-facing changes:
  • ATUS: enable dynamic revisions for live site: https://redmine.pop.umn.edu/issues/10312
  • MTUS: add link to topical filters for MTUS samples: https://redmine.pop.umn.edu/issues/10291
  • IHIS: rename domain to ihis.ipums.org: https://redmine.pop.umn.edu/issues/10100
• Non-user-facing changes:
  • Static content deploy task should do a 'git add' before running 'git commit': https://redmine.pop.umn.edu/issues/10307

• User-facing changes:
  • Update MTUS extract-ready email citation: https://redmine.pop.umn.edu/issues/10193
• Non-user-facing changes:
  • Delete extract request with completion_status = "pending_user_login" status older than one month: https://redmine.pop.umn.edu/issues/10174

• User-facing changes:
  • Revisions page: add anchor for each added revision: https://redmine.pop.umn.edu/issues/10122
  • Revisions page: year links should jump to the first entry in a year rather than the last: https://redmine.pop.umn.edu/issues/10123
• Non-user-facing changes:
  • Extract revisions should initially have a completion status of "not_submitted" so that they eventually get purged if abandoned by user: https://redmine.pop.umn.edu/issues/10164

• User-facing changes:
  • Support float/double type in variable metadata: https://redmine.pop.umn.edu/issues/10119

• User-facing changes:
  • IDHS: add "births" unit_of_analysis: https://redmine.pop.umn.edu/issues/9816

• User-facing changes:
  • ** IHIS: Update citation in automatically generated extract emails: https://redmine.pop.umn.edu/issues/10088
• Bug fixes:
  • Remove unused parameter and default value in data_cart.js: https://redmine.pop.umn.edu/issues/10115

• User-facing changes:
  • Get predefined TUV selection working with the browser's back button: https://redmine.pop.umn.edu/issues/9962
  • Select all TUVs in group (internal-only feature): https://redmine.pop.umn.edu/issues/9880
  • Implement MTUS registration in pre-UMA codebase (dormant until MTUS is live): https://redmine.pop.umn.edu/issues/10057
• Non-user-facing changes:
  • Bump up max USA extract jobs to 7: https://redmine.pop.umn.edu/issues/10046
• Bug fixes:
  • ATUS: show correct frequencies for Respondent Households, Respondent and Non-respondent Households: https://redmine.pop.umn.edu/issues/9927

• Non-user-facing changes:
  • Upgrade to Rails 4.2.6: https://redmine.pop.umn.edu/issues/9766

• Non-user-facing changes:
  • Migrate web app from LATIS smtp server to UMN smtp server: https://redmine.pop.umn.edu/issues/9769
  • CPS live: enable dynamic revisions: https://redmine.pop.umn.edu/issues/9792
  • CPS: turn on supplemental datasets feature on for CPS: https://redmine.pop.umn.edu/issues/9694

• Bug fixes:
  • Fix incorrect reference to MTUS in ATUS registration page: https://redmine.pop.umn.edu/issues/9713

• User-facing changes:
  • Admin system: Fix calculation of various user collections: https://redmine.pop.umn.edu/issues/9580
  • Admin system: Fix off-by-one index calculation for tabs with pagination broken: https://redmine.pop.umn.edu/issues/9580
  • Admin system: Increase page size to 20 items for user collections: https://redmine.pop.umn.edu/issues/9580
• Non-user-facing changes:
  • Refactor NotificationMailer: break into separate classes based on mailer type: https://redmine.pop.umn.edu/issues/9563

• User-facing changes:
  • SESTAT: rename survey groups: https://redmine.pop.umn.edu/issues/9577
  • SESTAT: strip out "-X" from survey group names when displaying universes in variable descriptions:
  • SESTAT survey groups: respect order field: https://redmine.pop.umn.edu/issues/9576
  • SESTAT variable descriptions: make universe statement behave like IPUMSI (i.e. one line per sample): https://redmine.pop.umn.edu/issues/9575
  • SESTAT: year in email citation text should be 2016, not 2014: https://redmine.pop.umn.edu/issues/9467
  • CPS: update email citation: https://redmine.pop.umn.edu/issues/9466
• Non-user-facing changes:
  • Upgrade IPUMS to latest Rails 4.2.x release: https://redmine.pop.umn.edu/issues/9450

• User-facing changes:
  • IDHS: Small UI updates: https://redmine.pop.umn.edu/issues/7249
  • IDHS: Support alternative units of analysis in groups metadata:https://redmine.pop.umn.edu/issues/7266
  • Dynamic revisions page: https://redmine.pop.umn.edu/issues/4464
• Non-user-facing changes:
  • Support for Github-based static content deployment: https://redmine.pop.umn.edu/issues/8331
• Bug fixes
  • Time-use projects: Fix bug in TUV name uniqueness: https://redmine.pop.umn.edu/issues/8243
  • Time-use projects: Get crvar tags working in notes.xml: https://redmine.pop.umn.edu/issues/9386
  • Respect hide_status of preselect variables: https://redmine.pop.umn.edu/issues/9472
  • Static content deployment cap task should do a 'git push' regardless of whether it has first done a commit: https://redmine.pop.umn.edu/issues/9553

• Non-user-facing changes:
  • Deploy IPUMSI, SESTAT, CPS, NAPP, and IHIS to ipums-external-web instead of bender: https://redmine.pop.umn.edu/issues/9254
• Bug fixes:
  • IHIS concordance generation: permit "constructed" variables to belong to top-level variable groups: https://redmine.pop.umn.edu/issues/9399
  • DHS: variable description availability tab throwing error because hidden samples aren't being excluded: https://redmine.pop.umn.edu/issues/9402

• User-facing changes:
  • SESTAT: new "Higher Ed" banner image: https://redmine.pop.umn.edu/issues/9039

• Bug fixes:
  • Fix AHTUS, AHTUS, MTUS, IHIS regression: syntax files no longer using numeric values for record types: https://redmine.pop.umn.edu/issues/9294

• Bug fixes:
  • IDHS: extract resubmit action causing request samples and request variables to be pruned from extract requests table: https://redmine.pop.umn.edu/issues/9317
  • Metadata import of variables list can cause source vars to become dissociated from integrated vars, breaking enum text: https://redmine.pop.umn.edu/issues/9287
  • Only add preselected hierarchical variables (common) if their top-level analog has also been selected: https://redmine.pop.umn.edu/issues/9333

• Non-user-facing changes:
  • Move project-level attributes out of environment-level config and into project-level config: https://redmine.pop.umn.edu/issues/7530
  • Generalize AHTUS fixed-start-time time filter to work for other time-use projects: https://redmine.pop.umn.edu/issues/9200

• Non-user-facing changes:
  • IPUMSI sample details: use CSV control file from appropriate stage instead of fixed path: https://redmine.pop.umn.edu/issues/8950

• Bug fixes:
  • Ajax enum text: render 404 for projects that don't have this feature: https://redmine.pop.umn.edu/issues/9050

• Bug fixes:
  • StatTransfer is incorrectly capitalizing mnemonics for some Stata variables: https://redmine.pop.umn.edu/issues/3097

• User-facing changes:
  • IPUMSI: migrate UI (variable availability and variable description codes tab) to use 4-digit years: https://redmine.pop.umn.edu/issues/3582
  • NAPP: migrate UI (variable availability and variable description codes tab) to use 4-digit years: https://redmine.pop.umn.edu/issues/3069

• User-facing changes:
  • IPUMSI: update citation text in extract email and DDI codebooks: https://redmine.pop.umn.edu/issues/8945

• User-facing changes:
  • Change color of non-error flash messages to green rather than red: https://redmine.pop.umn.edu/issues/8659
  • Handle incomplete and expired registration in multi-site login scenarios involving extract submission: https://redmine.pop.umn.edu/issues/8836

• User-facing changes:
  • Make extract email alerts HTML; change email text and IPUMS-USA citation text: https://redmine.pop.umn.edu/issues/8757

• User-facing changes:
  • Remove "remember last selected tab on the variable detail popup for duration of session" feature: https://redmine.pop.umn.edu/issues/8772

• User-facing changes:
  • IPUMS-USA: update citation message in DDI yaml: https://redmine.pop.umn.edu/issues/8762
• Non-user-facing changes:
  • Refactor VarsParser to use CSV instead of XML: https://redmine.pop.umn.edu/issues/6963
  • Remove :has_new_enum_tagging feature toggle and old_system: https://redmine.pop.umn.edu/issues/7263
  • Get rid of Metadata2Parser: https://redmine.pop.umn.edu/issues/6964
• Bug fixes:
  • Code deployment to live fails for IDHS (when attempting to deploy for all projects): https://redmine.pop.umn.edu/issues/8695
  • Deployment staging code cleanup causing error under certain circumstances: https://redmine.pop.umn.edu/issues/8696
  • Extract engine deployment broken: https://redmine.pop.umn.edu/issues/8722

• Bug fix:
  • Exclude is_old variables when adding hierarchical preselected variables to extract: https://redmine.pop.umn.edu/issues/8739

• Bug fix:
  • Increase max household size to 8000 to accommodate very large household in newly released Great Britain 1911 full-count sample: https://redmine.pop.umn.edu/issues/8725

• User-facing changes:
  • Remember last selected tab on the variable detail popup for duration of session: https://redmine.pop.umn.edu/issues/4023
• Non-user-facing changes:
  • Add rollback functionality for webapp, extract_engine and database: https://redmine.pop.umn.edu/issues/8192
  • Move all variable tabs configuration to a project level setting: https://redmine.pop.umn.edu/issues/8427
  • Refactor enumeration tagging display logic into a view-model: https://redmine.pop.umn.edu/issues/7262
  • NAPP: turn on new enum tagging system for live: https://redmine.pop.umn.edu/issues/8322
  • Optimize code deployment (esp. when deploying code for all projects): https://redmine.pop.umn.edu/issues/7441
  • Update to the latest code in branch when deploying just extract engine code: https://redmine.pop.umn.edu/issues/7281
• Bug fixes:
  • Fix bug in variable search: https://redmine.pop.umn.edu/issues/8411
  • Fix YRMARR case selection bug: https://redmine.pop.umn.edu/issues/8466
  • Fix weights bug for custom sample sizes: https://redmine.pop.umn.edu/issues/8495

• Bug fixes:
  • IPUMSI: Weights not updating for custom sample sizes: https://redmine.pop.umn.edu/issues/8495

• Non-user-facing changes:
  • Ignore memo file for sample_details_parser: https://redmine.pop.umn.edu/issues/8415
• Bug fixes:
  • Do not allow a variable be its own source variable: https://redmine.pop.umn.edu/issues/8410
  • CPS samples parser not properly recognizing new ASEC samples as belonging to March: https://redmine.pop.umn.edu/issues/8412
  • Web server not starting after task deploy:data_and_metadata: https://redmine.pop.umn.edu/issues/8414
  • SystemStackError: https://redmine.pop.umn.edu/issues/8416

• User-facing changes:
  • IPUMSI: dynamically generated sample details/designs: https://redmine.pop.umn.edu/issues/3559
• Non-user-facing changes:
  • Supplemental datasets: improve automated deployment: https://redmine.pop.umn.edu/issues/8370

• User-facing changes:
  • ATUS: new logo/banner: https://redmine.pop.umn.edu/issues/8300
• Non-user-facing changes:
  • Get rid of XML parsers and tests wherever possible: https://redmine.pop.umn.edu/issues/8136

• Non-user-facing changes:
  • Assigned port 14669 for SESTAT extract engine
  • Updated dev_setup scripts
• User-facing changes:
  • SESTAT: release data dissemination system: https://redmine.pop.umn.edu/issues/6242
  • AHTUS/ATUS: show codes in TUV filter trees for ATUS but not for AHTUS or other time-use projects: https://redmine.pop.umn.edu/issues/8233
  • AHTUS/ATUS: allow “alone” selection without requiring additional filters: https://redmine.pop.umn.edu/issues/8234
  • AHTUS: remove sample members section: https://redmine.pop.umn.edu/issues/8269
  • Remove "Attach characteristics" capability from the extract review: https://redmine.pop.umn.edu/issues/8093
  • AHTUS: update email citation message: https://redmine.pop.umn.edu/issues/8270
• Bug fixes:
  • Only raise RectypeMismatch in VarsParser if a variable has a group: https://redmine.pop.umn.edu/issues/8238

• Non-user-facing changes:
  • Parse frequency CSV files with column headers:: https://redmine.pop.umn.edu/issues/8142
• Bug fixes:
  • DDI/IHSN (International Household Survey Network) not including preselected person-level hierarchical variables (e.g. SERIALP, YEAR): https://redmine.pop.umn.edu/issues/8138
  • DDI/IHSN extract generation: web app only saving ~161 out 277 extract requests when extract generation feature invoked: https://redmine.pop.umn.edu/issues/8193
  • DHS internal/demo: unable to connect to auth database: https://redmine.pop.umn.edu/issues/8144
  • Variable-level metadata import: prevent case in which a variables record type does not match with its group's record type: https://redmine.pop.umn.edu/issues/8204

• Bug fixes:
  • SSL::SSLError when trying to send email via ActionMailer on bender under jruby 1.7.20+: https://redmine.pop.umn.edu/issues/8092

• User-facing changes:
  • Annual IPUMSI DDI codebook/extract generation (on internal): allow one-click extraction of all visible samples: https://redmine.pop.umn.edu/issues/8076
• Bug fixes:
  • Move db backup implementation out of capistrano and into rake: https://redmine.pop.umn.edu/issues/8030
  • Informational category duplication in trans table parser: https://redmine.pop.umn.edu/issues/7976
  • Header mismatch for case-count view: https://redmine.pop.umn.edu/issues/7985

• User-facing changes:
  • Make long/Short country_codes in display options works for the codes page: https://redmine.pop.umn.edu/issues/7054
• Non-user-facing changes:
  • Refactor password management in database.yml: https://redmine.pop.umn.edu/issues/7838
  • Prefer class instance variables to class variables in config/ipums.rb: https://redmine.pop.umn.edu/issues/7969

• User-facing changes:
  • Admin page where IPUMS.project and IPUMS.project.config can be changed: https://redmine.pop.umn.edu/issues/7771
• Non-user-facing changes:
  • Refactor ipums-web config: https://redmine.pop.umn.edu/issues/7760
• Bug fixes:
  • IHIS: get 2014 weights, nhis sources, and concordance to show up (nulls for original_record_type_id in db): https://redmine.pop.umn.edu/issues/7821

• Bug fixes:
  • Admin system: fix user/extract reports: https://redmine.pop.umn.edu/issues/7843

• User-facing changes:
  • IPUMS-USA: migrate to new enum tagging system: https://redmine.pop.umn.edu/issues/7479

• Non-user-facing changes:
  • IPUMS-USA: convert to source variables: https://redmine.pop.umn.edu/issues/120
  • Upgrade to Rails 4.2: https://redmine.pop.umn.edu/issues/6610
• Bug fixes:
  • IPUMS-USA: fix DDI parsing bug: https://redmine.pop.umn.edu/issues/7579

• User-facing changes:
  • Remove 'no small geography' EULA field from IPUMS-USA registration: https://redmine.pop.umn.edu/issues/7467
• Non-user-facing changes:
  • Remove db production/internal/demo db credentials (in database.yml) from VCS/Git: https://redmine.pop.umn.edu/issues/7432
• Bug fixes:
  • Remove Student action is broken in ClassGroups controller: https://redmine.pop.umn.edu/issues/7450

• Back-end work and bug fixes:
  • Change user auth live credentials: https://redmine.pop.umn.edu/issues/7430

• Back-end work and bug fixes:
  • Variables parser 'is_old' functionality not working as expected: https://redmine.pop.umn.edu/issues/7273

• Back-end work and bug fixes:
  • Fix CPS checkboxes alignment in "Supplement Topics" tab: https://redmine.pop.umn.edu/issues/7131 (sha: 385fccc)

• Back-end work and bug fixes:
  • "Flex" extracts fail when rectangular structure and no variables in request of "root" record type: https://redmine.pop.umn.edu/issues/7074
  • Fix CPS samples page layout problems: https://redmine.pop.umn.edu/issues/7131, https://redmine.pop.umn.edu/issues/6874

• User-facing work and features:
  • IDHS: alternative unit of analysis: https://redmine.pop.umn.edu/issues/5701
  • IDHS: activate variable super groups: https://redmine.pop.umn.edu/issues/3787
• Back-end work and bug fixes:
  • IDHS: use flex-extract feature: https://redmine.pop.umn.edu/issues/7175

• Back-end work and bug fixes:
  • Add new google analytics code to dynamic sites still using the old JS code snippet.: https://redmine.pop.umn.edu/issues/6730
  • IHIS: fix NHIS-IHIS concordance problems: https://redmine.pop.umn.edu/issues/6859
  • IHIS: fix problems with variable description NHIS sources tab: https://redmine.pop.umn.edu/issues/6866
  • Remove X-Frame-Options header in ApplicationController: https://redmine.pop.umn.edu/issues/6924

• Back-end work and bug fixes:
  • ATUS, AHTUS: get TUV activity tree documentation to show up in IE and Firefox (works fine in Chrome): https://redmine.pop.umn.edu/issues/687

• Back-end work and bug fixes:
  • NAPP: codes pages: fix header alignment problems:https://redmine.pop.umn.edu/issues/6712

• Back-end work and bug fixes:
  • Fix tabbed sample display for European and African mirror sites: https://redmine.pop.umn.edu/issues/6678

• Back-end work and bug fixes:
  • IHIS: turn on new enum tagging system for live site: https://redmine.pop.umn.edu/issues/4735

• Back-end work and bug fixes:
  • Deploy to live from Git master: https://redmine.pop.umn.edu/issues/6374
  • Fix code display bug: https://redmine.pop.umn.edu/issues/6656
  • CPS: add feature toggle to suppress tabbed sample display: https://redmine.pop.umn.edu/issues/6667

• Back-end work and bug fixes:
  • Code and frequencies: respect indent values for general variables: https://redmine.pop.umn.edu/issues/6290

• Back-end work and bug fixes:
  • CPS: fix display order of samples on variable groups page: https://redmine.pop.umn.edu/issues/6315

• Back-end work and bug fixes:
  • Move web codebase from SVN to Git: https://redmine.pop.umn.edu/issues/6578

• User-facing work and features:
  • Disable extract request size limit for users that have selected 1940 full-count data for IPUMS-USA: https://redmine.pop.umn.edu/issues/6277
  • IPUMS-USA: variable group view: show available variables above unavailable variables.: https://redmine.pop.umn.edu/issues/6278
  • ATUS: extract_requests/variables: don't show TUV header unless there are TUVs in cart: https://redmine.pop.umn.edu/issues/6284
• Back-end work and bug fixes:
  • Fix CSV-parsing code to handle commas in hrecord and precord fields: https://redmine.pop.umn.edu/issues/6266
  • Time use: make ACTIVITY and WHERE variable configurable by project: https://redmine.pop.umn.edu/issues/6183
  • Strip out semicolons from svar_doc tags: https://redmine.pop.umn.edu/issues/6279
  • Add Rails 4 secret token: https://redmine.pop.umn.edu/issues/6309

Deployed December 18, 2014 for IPUMS-USA ONLY

• User-facing work and features:
  • Disable extract request size limit for users that have selected 1940 full-count data for IPUMS-USA: https://redmine.pop.umn.edu/issues/6277
  • IPUMS-USA: variable group view: show available variables above unavailable variables.: https://redmine.pop.umn.edu/issues/6278
  • ATUS: extract_requests/variables: don't show TUV header unless there are TUVs in cart: https://redmine.pop.umn.edu/issues/6284
• Back-end work and bug fixes:
  • Fix CSV-parsing code to handle commas in hrecord and precord fields: https://redmine.pop.umn.edu/issues/6266
  • Time use: make ACTIVITY and WHERE variable configurable by project: https://redmine.pop.umn.edu/issues/6183
  • Strip out semicolons from svar_doc tags: https://redmine.pop.umn.edu/issues/6279

• Back-end work and bug fixes:
  • Enum text: if project displays unharmonized variables, filter out hidden source variables: https://redmine.pop.umn.edu/issues/6311

• Back-end work and bug fixes:
  • Fix SQL sanitization problems in search: https://redmine.pop.umn.edu/issues/6220
  • Don't attempt to load categories for nontabulated variables: https://redmine.pop.umn.edu/issues/6227

• Back-end work and bug fixes:
  • ATUS, IHIS: disable CSV-only extracts: https://redmine.pop.umn.edu/issues/6212
  • Fix problem in which search returns unharmonized variables for projects that suppress them: https://redmine.pop.umn.edu/issues/6214

• Back-end work and bug fixes:
  • IHIS: turn back on hierarchical extractsL https://redmine.pop.umn.edu/issues/6197

• Features:
  • Add config to indicate whether project requires registrant approval, and suppress approval tabs in admin system: https://redmine.pop.umn.edu/issues/6180
  • IHIS enum text: show informative message if a variable was not based on an actual question asked of respondents: https://redmine.pop.umn.edu/issues/6188
• Back-end work and bug fixes:
  • Make variable search faster and function in a more logical manner: https://redmine.pop.umn.edu/issues/1070

• Back-end work and bug fixes:
  • Improve admin interface: add more information to display, add tabs for better organization: https://redmine.pop.umn.edu/issues/5750
  • Refactor routes file: https://redmine.pop.umn.edu/issues/5956
  • upgrade to new country_select gem: https://redmine.pop.umn.edu/issues/5992

• Features:
  • Turn on new questionnaire text (using new tagging system) for live CPS site: https://redmine.pop.umn.edu/issues/6148

• Back-end work and bug fixes:
  • IHIS: change hover text for rectangular/hierarchical radio buttons on the variable menu page (is ATUS-specific right now): https://redmine.pop.umn.edu/issues/6089
  • Upgrade to Rails 4.1.8: https://redmine.pop.umn.edu/issues/6078

• Back-end work and bug fixes:
  • Add Google Analytics instrumentation to ATUS and DHS: https://redmine.pop.umn.edu/issues/5997

• Back-end work and bug fixes:
  • ATUS: add link to "[Alone]" option in TUV creation: https://redmine.pop.umn.edu/issues/5997

• Back-end work and bug fixes:
  • ATUS: fix relative roots: https://redmine.pop.umn.edu/issues/5995

• Back-end work and bug fixes:
  • upgrade to Rails 4.1.7: https://redmine.pop.umn.edu/issues/5928
  • refactor "joins" usage in codebase: https://redmine.pop.umn.edu/issues/5749

• Features:
  • CPS: add links to sample topics: https://redmine.pop.umn.edu/issues/3546
  • IPUMSI: add tabbed geographical view for sample selection: https://redmine.pop.umn.edu/issues/5723
  • USA: sample selection: add tabbed selection of full-count datasets: https://redmine.pop.umn.edu/issues/5724
  • IHIS: change webapp config to reflect metadata name change (survey_sections.xml to original_record_types.xml): https://redmine.pop.umn.edu/issues/5754
  • Variable group metadata: implement toggle for selection of all variables in group: https://redmine.pop.umn.edu/issues/5831

• Back-end work and bug fixes:
  • Fix bug in show class groups query: https://redmine.pop.umn.edu/issues/5834

• Features:
  • Add text for 1940b user agreement: https://redmine.pop.umn.edu/issues/5201
• Back-end work and bug fixes:
  • Extract request validation: prevent submission of hierarchical extract request with additional (e.g. Stata or CSV) data formats: https://redmine.pop.umn.edu/issues/5732
  • IHIS: Disable variable group selection: https://redmine.pop.umn.edu/issues/5752

• Back-end work and bug fixes:
  • Old enum text system: limit extract variables for enum text to unharmonized variables: https://redmine.pop.umn.edu/issues/5738

• Features:
  • IHIS: enable hierarchical injury records in UI and extract engine: https://redmine.pop.umn.edu/issues/3549
  • Admin system: modify resubmit button to execute ExtractRequest#submit instead of ExtractRequest#enqueue: https://redmine.pop.umn.edu/issues/5698
• Back-end work and bug fixes:
  • IPUMSI: make "become user" work for denied user: https://redmine.pop.umn.edu/issues/5660

• Back-end work and bug fixes:
  • ATUS: fix TUV sorting error in extract engine: https://redmine.pop.umn.edu/issues/5692
  • ATUS: fix broken TUV time filter: https://redmine.pop.umn.edu/issues/5693

• Back-end work and bug fixes:
  • IHIS: fix injury records heading in variable menu view; should read "INJURY": https://redmine.pop.umn.edu/issues/5598
  • Use default configurations in database.yml: https://redmine.pop.umn.edu/issues/5622
  • Fix field truncation errors in registration forms: turn off MySQL strict mode: https://redmine.pop.umn.edu/issues/5619

• Features:
• Back-end work and bug fixes:
  • Get IPUMS-USA site to show up in Molecular Workbench: https://redmine.pop.umn.edu/issues/5606
  • Manual codes pages: (some) browsers (occasionally) vertically align page somewhere in the middle instead of the top: https://redmine.pop.umn.edu/issues/5607

• Back-end work and bug fixes:
  • Codes pages: for large tables of code and frequencies, (some) browsers (occasionally) vertically align page somewhere in the middle instead of the top: https://redmine.pop.umn.edu/issues/5593

• Features
  • Admin system: add mechanism to send extract completion emails on demand: https://redmine.pop.umn.edu/issues/5581
• Back-end work and bug fixes:
  • ATTEMPT to fix database connection problems with Rails for and IPUMS app: https://redmine.pop.umn.edu/issues/5580

• Features
  • Admin system: always show extract details
• Back-end work and bug fixes:
  • ACTUALLY fix database connection problems with Rails for and IPUMS app: https://redmine.pop.umn.edu/issues/5580

• Features
  • Make codes the default tab for variable descriptions: https://redmine.pop.umn.edu/issues/5536
  • Add "select all variables in group" feature to all projects: https://redmine.pop.umn.edu/issues/5550
• Back-end work and bug fixes:
  • Upgrade to Rails 4.1.5: https://redmine.pop.umn.edu/issues/3567
  • Enable Rails Strong Parameters: https://redmine.pop.umn.edu/issues/5490
  • Upgrade to JRuby 1.7.15: https://redmine.pop.umn.edu/issues/5509
  • Refactor enum text rendering code for performance: https://redmine.pop.umn.edu/issues/4402

• Features
  • IPUMS-USA: make "codes" tab the default again: https://redmine.pop.umn.edu/issues/5578

• Back-end work and bug fixes:
  • DQ flags addition/removal misbehaving because of request variable cache: https://redmine.pop.umn.edu/issues/5213

• Back-end work and bug fixes:
  • Enum text: gracefully handle case in which jump metadata is missing.

• Features
  • When no enum text is available for select samples show "Questionnaire text not available." message: https://redmine.pop.umn.edu/issues/5128
• Back-end work and bug fixes:
  • Displayed tagged enum text using the 'display doc' field instead of the 'jump doc' field for the 'view entire document' link and anchor. Use jump doc field instead: https://redmine.pop.umn.edu/issues/5123
  • Generalize hierarchical record types in web application config and infrastructure: https://redmine.pop.umn.edu/issues/5162

• Back-end work and bug fixes:
  • IPUMSI: @jump_maps and @display_maps must be non-nil for new enum tagging: https://redmine.pop.umn.edu/issues/5098
  • IPUMSI: extract summary page for revised extracts: add message indicating that old geography variable names were changed in July 2014: https://redmine.pop.umn.edu/issues/5100

• Back-end work and bug fixes:
  • IHIS: restore old-style enum text parsing functionality: https://redmine.pop.umn.edu/issues/5080
  • IPUMSI live: turn on new enum tagging system: https://redmine.pop.umn.edu/issues/5084
  • IPUMSI: update extract email citation text: https://redmine.pop.umn.edu/issues/5082
  • IHIS/ATUS: hierarchical RECTYPE variables now added dynamically based on configuration: https://redmine.pop.umn.edu/issues/5078

• Back-end work and bug fixes:
  • IPUMSI: extract engine returning bad values for source variables when integrated variable with highest column location is "is_old": https://redmine.pop.umn.edu/issues/5032
  • IPUMSI: enum text errors possible integrated variables with no source variables: https://redmine.pop.umn.edu/issues/5044
  • IHIS: concordance throwing errors when variables (even if "is_old") in db are missing mnemonics: https://redmine.pop.umn.edu/issues/5045

• Back-end work and bug fixes:
  • Add constraint to prevent duplicate SampleVariables from getting added during metadata loading: https://redmine.pop.umn.edu/issues/4931
  • Improved IDHS metadata deployment system: https://redmine.pop.umn.edu/issues/4907

• Back-end work and bug fixes:
  • Performance optimization for adding variables to extract requests
  • Remove references to invars from code: https://redmine.pop.umn.edu/issues/4947

• Back-end work and bug fixes:
  • Suppress error notifications for invalid byte sequences: https://redmine.pop.umn.edu/issues/4911
  • Vertically align to top text in variable grid rows: https://redmine.pop.umn.edu/issues/4900

• Back-end work and bug fixes:
  • Add utf8-cleaner middleware to prevent 'invalid byte sequence' errors: https://redmine.pop.umn.edu/issues/4888
  • IDHS: fix bug in which frequencies weren't showing up on the live site: https://redmine.pop.umn.edu/issues/4893
  • Fix bug in which enum text wasn't working for certain projects and environments: https://redmine.pop.umn.edu/issues/4892

• Back-end work and bug fixes:
  • Switch back to non-authenticated SMTP for email: https://redmine.pop.umn.edu/issues/4727
  • Convert IHIS to source variables: https://redmine.pop.umn.edu/issues/962
  • Reintegrate ATUS branch with trunk: https://redmine.pop.umn.edu/issues/3773
  • ATUS: hierarchical extract selection should disable Data Format option: https://redmine.pop.umn.edu/issues/4875
  • ATUS: create and implement banner for extract pages: https://redmine.pop.umn.edu/issues/4808
  • ATUS: suppress questionnaire and source variable tabs for variable descriptions: https://redmine.pop.umn.edu/issues/4840

• Back-end work and bug fixes:
  • Switch back to non-authenticated SMTP for email: https://redmine.pop.umn.edu/issues/4727

• Back-end work and bug fixes:
  • Switch to smtp.umn.edu for email: https://redmine.pop.umn.edu/issues/4604

• Back-end work and bug fixes:
  • DHS: fix variable menu pagination: https://redmine.pop.umn.edu/issues/4445

• Features:
  • DHS: amend citation text in extract email: https://redmine.pop.umn.edu/issues/4332
• Back-end work and bug fixes:
  • DHS: fix wonky alphabetical drop down menu in original DHS variable mode: https://redmine.pop.umn.edu/issues/4325

• Features
  • Add explanation of X's meaning to variable availability page.
• Back-end work and bug fixes:
  • Codebooks not showing sample names for some projects.
  • Country metadata parsing should delete all old metadata for each loading.
  • Use streaming database connection to prevent Java heap space errors on large queries.

• Back-end work and bug fixes:
  • Use non-authenticated mail.socsci.umn.edu for SMTP on CLA-OIT servers while using authenticated gmail.umn.edu SMTP for IDHS at AWS: https://redmine.pop.umn.edu/issues/3990

• Features:
  • Include IPUMS and general comparability in full text variable searches: https://redmine.pop.umn.edu/issues/3533

• Back-end work and bug fixes:
  • Fix reset password feature

• Back-end work and bug fixes:
  • Upgrade to Rails 3.2.17
  • Refactor enum text view code for clarity and maintainability: https://redmine.pop.umn.edu/issues/3785

• Back-end work and bug fixes:
  • Remove parentheses from variable descriptions showing up as side effect of recent DHS changes.

• Features:
  • Rename header on /menu page to " User Options.": https://redmine.pop.umn.edu/issues/3665
  • Turn on supplemental datasets for CPS: https://redmine.pop.umn.edu/issues/3696
  • Whitelist *.txt files for supplemental dataset downloads: https://redmine.pop.umn.edu/issues/3697

• Features:
  • Simplify IPUMSI registration form: https://redmine.pop.umn.edu/issues/3570
• Back-end work and bug fixes:
  • Fix bug in extract request summary: https://redmine.pop.umn.edu/issues/3648

• Back-end work and bug fixes:
  • Upgrade to JRuby 1.7.10; also upgrade any associated gems

• Back-end work and bug fixes:
  • IPUMS-USA: Fix sorting of Puerto Rican samples on sample selection page.

• Back-end work and bug fixes:
  • Upgrade to Rails 3.2.16.
  • Fix bug in which db flags could be added to an extract request multiple times: https://redmine.pop.umn.edu/issues/3356

• Back-end work and bug fixes:
  • Refactor extract queue so that both large and small extracts are allowed in the slow lane: https://redmine.pop.umn.edu/issues/3292

• Back-end work and bug fixes:
  • Explicitly sort enqueued extracts by 'requested_at' field: https://redmine.pop.umn.edu/issues/3277
  • Remove 'CSV frequencies' and 'use built-in queue' feature toggles: https://redmine.pop.umn.edu/issues/3056

• Back-end work and bug fixes:
  • Bump up session timeout time to two hours.

• Back-end work and bug fixes:
  • Reduce max number of allowed extract jobs to 3 for IPUMS-USA.

• Back-end work and bug fixes:
  • Upgrade to Rails 3.2.15
  • Extract queue wasn't FIFO in some cases: https://redmine.pop.umn.edu/issues/3118
  • Hidden sample and/or variables should be excluded from extract revisions: https://redmine.pop.umn.edu/issues/3140
  • Add submitted_at timestamp and migrate older timestamps where possible: https://redmine.pop.umn.edu/issues/3123

• Back-end work and bug fixes:
  • Turn on CSV frequencies for IHIS.

• Features:
  • In the absence of a prescribed session-stored destination, send logged-in user to the menu page when they click the submit button on the login page. Fixes: https://redmine.pop.umn.edu/issues/3070

• Back-end work and bug fixes:
  • Full source document text wasn't showing up on the web; code didn't reflect move of source docs to the database.

• Features:
  • Import XML metadata into database on arbitrary compute servers rather than deployment server.

• Back-end work and bug fixes:
  • Reduce max allowed extract jobs to 4 for IPUMS-USA.

• Back-end work and bug fixes:
  • Remove case selection exception from user-specific extract size constraint.

• Features
  • Enable supplement topic sample selection for CPS.
• Back-end work and bug fixes:
  • Switch deployed repos roots to https://svn.cla.umn.edu

• Back-end work and bug fixes:
  • Allow *.dct files to be downloadable (for USA supplemental datasets)

• Back-end work and bug fixes:
  • Protect against condition in which a non-integer is passed in a controller (via query string) as a page number.
  • Since IPUMS-USA is now running on dedicated hardware, bump up the max allowed jobs to 5.

• Features:
  • Turn on supplemental datasets for IPUMS-USA so that 1880 linked dataset`s now live behind a login.
• Back-end work and bug fixes:
  • Make flexo.cla.umn.edu the deployment target for IPUMS-USA.