Skip to content

Release 2.1.0
Compare
Choose a tag to compare
@tkakantousis tkakantousis released this 12 Feb 09:23
· 3 commits to branch-2.1 since this release
v2.1.0
8f64925
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Release notes - Hopsworks - Version 2.1.0

Bug

HOPSWORKS-2359 Always show GPU configuration fields for Jobs and Jupyter
HOPSWORKS-2358 Remove ROCM GPU monitoring code
HOPSWORKS-2346 Identifying if a project is using the base image on ECR does not work
HOPSWORKS-2338 handle empty tfrecord files in TFDataEngine
HOPSWORKS-2333 create_training_dataset method throws Connector not found exception
HOPSWORKS-2311 Template required ec2-init parameters for the unmanaged version
HOPSWORKS-2307 Docker garbage collection should not remove base or python37 images for any hopsworks version
HOPSWORKS-2302 Hide python pip search bar as underlying pip search is now deprecated
HOPSWORKS-2294 Installing a python library from git should enclose the url in quotes
HOPSWORKS-2283 Reading from the online feature store doesn't work on Databricks
HOPSWORKS-2249 provenance elasticsearch - count and aggregations should be separate methods
HOPSWORKS-2248 Python file path is not shown in Job details
HOPSWORKS-2238 Feature Group schema primary key info not set for partition keys
HOPSWORKS-2219 Remove NaN from statistics
HOPSWORKS-2202 Docker registry caches deleted manifests
HOPSWORKS-2199 Glassfish consul domain should be included in Kafka super.users
HOPSWORKS-2198 Cannot get the schema of a shared kafka topic
HOPSWORKS-2187 Add anaconda user to hadoop group only if the group exists. Create hops-system Anaconda env conditionally
HOPSWORKS-2182 Disable unattended-upgrades in Ubuntu
HOPSWORKS-2174 issues attaching xattr to shared files
HOPSWORKS-2164 Add API Key annotation on the commits endpoint
HOPSWORKS-2159 ruby tests fix
HOPSWORKS-2158 Query constructor ignores more than 2 joining conditions
HOPSWORKS-2151 Tag validation doesn't work for key only tags
HOPSWORKS-2145 Flask (sklearn) race condition when reading pid file
HOPSWORKS-2102 Conversion of Jupyter notebooks to Python programs should consider notebook kernel
HOPSWORKS-1984 Exception when creating online feature group without primary key

Task

HOPSWORKS-2348 Disable storage and compute quota by default
HOPSWORKS-2337 Upgrade hudi to 0.7.0 version
HOPSWORKS-2327 Ui fixed for generating training datasets
HOPSWORKS-2324 Display alert if project is using older docker image
HOPSWORKS-2320 Set PARQUET as default for non-hudi offline feature groups
HOPSWORKS-2287 Bump up docker.io version for ubuntu
HOPSWORKS-2275 Remove InodeEncodingStatus Bean
HOPSWORKS-2274 Feature store "NOT FOUND" errors should return 404
HOPSWORKS-2241 Consul security recipe should not try to get Hopsworks IP if not needed
HOPSWORKS-2206 HSFS profile to install with and without Hive dependencies
HOPSWORKS-2196 Remove hudiEnabled flag and sync endpoint from hopsworks
HOPSWORKS-2189 Update spark-avro package for to_avro/from_avro methods
HOPSWORKS-2188 Remove partition key requirements for HUDI feature groups and allow users to set precombine keys
HOPSWORKS-2178 Remove leftover ldconfig in hops::install
HOPSWORKS-2163 Add missing chef changes of HOPSWORKS-2057 in master
HOPSWORKS-2144 Bump hops dependencies to 3.2.0.2-RC0
HOPSWORKS-2138 remove slider and LLAP
HOPSWORKS-2132 Check that base environment does not contain broken requirements when building docker
HOPSWORKS-2131 Add pip check command to Python service
HOPSWORKS-2127 Bump TensorFlow to 2.4 and PyTorch to 1.7
HOPSWORKS-2103 Add documentation for connecting to the Hopsworks Kafka cluster from an external client

Improvement

HOPSWORKS-2341 allow hsfs to get all metadata from feature store within experiment function
HOPSWORKS-2315 [hops-hadoop-chef] Template in Chef application key size
HOPSWORKS-2280 Save statistics configuration also for training datasets
HOPSWORKS-2277 Add VARBINARY(N) to proposed types for online features
HOPSWORKS-2201 Move to delete API for removing images from local docker registry
HOPSWORKS-2200 set fs.azure.skipUserGroupMetadataDuringInitialization to true for ADLSv2
HOPSWORKS-2183 Add feature group, training dataset, storage connector counters to FeaturestoreDTO summary
HOPSWORKS-2180 Disable transactions when Spark writes to the online feature store
HOPSWORKS-2177 extend on-demand feature groups parquet/orc/delta/hudi/csv tables
HOPSWORKS-2176 Add API key annotations to provenance endpoint
HOPSWORKS-2172 Reduce default varchar size for string features
HOPSWORKS-2168 Add keyword support to feature groups and training datasets
HOPSWORKS-2157 Store information about primary and precombine keys for time travel enabled feature groups separately from Hive Metastore
HOPSWORKS-2143 experiments/models list for any user with access (including shared)
HOPSWORKS-2129 Should run conda clean after installing a package
HOPSWORKS-2120 enable full provenance by default
HOPSWORKS-2119 Create an admin rest endpoint for user registration
HOPSWORKS-2101 Add resource to download files using api key
HOPSWORKS-2026 Add "converting notebook" job state
HOPSWORKS-1817 Replace influxdb with prometheus + pushgateway for Spark applications
HOPSWORKS-1591 UI improvements for storage connectors
HOPSWORKS-1193 Make deleting a project more intuitive
HOPSWORKS-288 Allow editing a job's configuration property without clearing the rest

New Feature

HOPSWORKS-2197 Add ADLS storage connector for the feature store
HOPSWORKS-2184 Install Python libraries from Anaconda environment file
HOPSWORKS-2165 Support installing python libraries using requirements.txt
HOPSWORKS-2134 Extend Query constructor with filter capability
HOPSWORKS-2118 Add download method to hops-util-py
HOPSWORKS-2085 Add assume role support for redshift connector
HOPSWORKS-1971 HSFS Python support

Assets 2
Loading