LMdiff: A Visual Diff Tool to Compare Language Models
code demo
[Read More]
AWS Lambda: Keeping Functions Warm
Built-in keep-alive for Lambda functions at deployment
AWS generally terminates Lambda functions after 30-60 mins of inactivity and sometimes shorter. The long wake-up time could create service reliability issues during times when usages are low. And if the Lambda function is deployed using Docker images, the warm up time will literally be in minutes even for simple...
[Read More]
List All Columns in a Table in Redshift
Useful SQL queries, part 1
This query lists all columns in a specific table on AWS Redshift.
[Read More]
Pandas fillna for Categorical Columns
Solving ValueError: fill value must be in categories
From time to time, our favorite machine learning modeling libraries will throw errors complaining about NaNs when didnt scrub our data clean enough.
[Read More]
Syncing Conda Environments with requirements.txt
Aligning Python virtual environments
There are varieties of different Python virtual environment managers out there - conda, pipenv, poetry, virtualenv, etc. And from time to time, we would need to convert or switch between different virtual environment tools. For example, AWS SageMaker deals with specifically conda while most software engineering deals with pipenv, poetry,...
[Read More]