CMU | Nutanix - Core Data Path

github

Supreet Deshpande  • Peerlist

Stragglers are slow-running tasks in the Distributed Computing Environment.
Studied various approaches to attenuate the impact of Stragglers on the overall Computation time.
Worked under a guide and presented a Seminar on The Review and Analysis of Straggler Mitigation Techniques.
Publication - http://ijcsit.com/docs/Volume%207/vol7issue5/ijcsit20160705026.pdf

Straggler Mitigation Techniques

Implemented a dynamic memory allocation library consisting of malloc, realloc, and free functions to manage heap memory.
Achieved high utilization and high throughput via footer-less segregated free lists and coalescing.

Dynamic Memory Allocator

Developed a simulation engine for the RAFT consensus algorithm leveraging RPC mechanism.
Handled leader election, server state replication, and consensus to withstand failures and network partitions.

RAFT: Consensus Algorithm

Implemented a FUSE-based hybrid file system (ext4 and S3). 
Files beyond a certain threshold size were moved to the cloud.
Implemented deduplication and caching for file storage blocks.

CloudFS

Benchmarked HTTP/3 server implementations to identify the performance gains of individual features in the QUIC specification.

Comparative study of HTTP2 and HTTP3 web performance

Implemented flash translation layer for SSDs translating logical block addresses to physical addresses. Implemented garbage collection and wear leveling owing to the asymmetry in SSD reads/writes/erases.

Flash Translation Layer for SSDs

Designed and implemented a multi-threaded HTTP proxy server in C with an LRU cache via Readers-Writers lock for consistency.