Closed Bug 1251653 Opened 10 years ago Closed 10 years ago

parquet2hive should create an external table that links to the most recent version of a dataset

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: rvitillo, Unassigned)

References

Details

Parquet datasets can have multiple versions. To allow jobs to not depend on a specific version, parquet2hive should create a table that links to the most recent one. E.g. the "longitudinal" table should link to the most recent dataset, e.g. "longitudinal_v20160213".
https://github.com/vitillo/parquet2hive/commit/26345874418b8b1e6fd9a6623f24d476f101e1ee
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.