Posted by Coder.
Results > Posts Filed Under > Scalability
Jul
18
Posted by Coder.
Hadoop Summit 2010 – Agenda
Hadoop is a powerful platform for data analysis and processing, but many struggle to understand how it fits in with regard to existing infrastructure and systems. A series of common integration points, technologies, and patterns are defined and illustrated in this presentation. [slides]
Nov
1
Posted by Coder.
Performance Agora: ORACLE Scalability Oracles
Cary Milsap, “Optimizing Oracle Performance” (O’Reilly, 2003). On p. 361, there is a definition of scalability expressed in terms of the response time (R). [ed. scalability: The rate of change of response time with respect to some specified parameter. For example, one may speak of the scalability of a query with respect to the number of rows returned, the scalability of a system with respect to the number of CPUs …
Oct
4
Posted by Coder.
Nati Shalom’s Blog: Why most large-scale Web sites are not written in Java
…similar solutions for addressing the scalability challenges:
On the Data Tier we see the following:
1. Adding a caching layer to take advantage of memory resources availability and reduce I/O overhead
2. Moving from a database-centric approach to partitioning, aka shards
On the Business Logic Tier:
3. Adding parallelization semantics to the application tier (e.g., MapReduce)
4. Moving to scale-out application models to achieve linear scalability
5. Moving away from the classic two-phase commit and …
Nov
28
Posted by Coder.
Identifying MySQL slow queries | MDLog:/sysadmin
… steps in optimizing and tuning mysql is to identify the queries that are causing problems. How can we find out what queries are taking a long time tocomplete? How can we see what queries are slowing down the mysql server? Mysql has the answer for us and we only need to know where to look for it…
Apr
11
Posted by Coder.
Digg PHP’s Scalability and Performance – O’Reilly ONLamp Blog
Most scaling and performance challenges are almost always related to the data layer, and are common across all language platforms. Even as a self-proclaimed PHP evangelist, I was very startled to find out that all of the theories I was subscribing to were true. There is simply no truth to the idea that Java is better than scripting languages at writing scalable web applications. I won’t go as far as to say …
Mar
28
Posted by Coder.
Intel Developer Forum – Keynote Webcasts
Intel Developer Forum
Steve Pawlowski and Ofri Wechsler: Intel® Core™ microarchitecture and Usages
Paolo A. Gargini: Intel’s Silicon R&D Pipeline
The keynotes of Pat P. Gelsinger (Digital Enterprise), Sean M. Maloney (Mobility), Donald J. MacDonald (The Digital Home) and Justin R. Rattner (Opening Keynote)
Mar
28
Posted by Coder.
The Multicore Computer Forum Series “ explor[es] the benefits and challenges of Multicore computing.”
High Performance Throughput Computing, Dr. Marc Tremblay, Sun Fellow, Vice President, and Chief Architect, Sun’s Scalable Systems Group
Software and the Concurrency Revolution, Herb Sutter, Microsoft
Architecture Support for Parallel Programming, Dr. Kunle Olukotun, Associate Professor, Stanford University
Mar
20
Posted by Coder.
Sun Sensible
Uniform Utilization of hardware resources ensures scalability:
Uniform Hardware Utilization Through Time (All program Phases use the hardware uniformly)
Uniform Utilization of Hardware Threads (All Hardware Threads are Busy)
Uniform Use of Software Threads (There are enough threads)
Uniform Cache Set Use in the Cache Hierarchy (No cache sets are over subscribed)
Uniform Physical Memory Use (All memory boards used evenly)
Uniform Virtual Memory Use (No Hot Locks)
Feb
10
Posted by coder.
Sun Dialogue Programs
(Q): If you have to pick top 10 things that you must monitor on any server to look for performance and/or scalability issues…what would they be?
Richard McDougall (A): Off the top of my head, in no particular order:
CPU: Check idle time and run queue length.
If there’s a CPU bottleneck, check if it’s an application or kernel CPU utilization issue with mpstat: high percentages of users indicate it’s an application issue. High sys may point to high network load …
Jan
6
Posted by coder.
This case study gives a high level overview of Google’s setup for user authentication, interesting read.
… user authentication is a transactional event that requires fast, reliable, scalable, persistence and robust high-availability. To deliver this level of service, Google Accounts uses Berkeley DB HA for the storage and retrieval of user data and for replication, thereby ensuring scalability and availability.