Posted
about 4 years
ago
by
Swapnil M Mane
Happy Friday, everyone. Let's take a look at how the past week has progressed:
ASF Board – management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.- Next Board Meeting: 16 October
... [More]
2019. Board calendar and minutes http://apache.org/foundation/board/calendar.html
ApacheCon™ – the ASF's official global conference series, bringing Tomorrow's Technology Today since 1998 - Countdown to ApacheCon Europe --REGISTER TODAY! https://www.apachecon.com/ - NEW! The latest presentations from ApacheCon/Las Vegas exclusively on Feathercast https://feathercast.apache.org/
ASF Infrastructure – our distributed team on three continents keeps the ASF's infrastructure running around the clock. -
7M+ weekly checks yield uptime at 99.95%. Performance checks across 50
different service components spread over more than 250 machines in data
centers around the world. http://www.apache.org/uptime/ Apache Code Snapshot – this week, 825 Apache contributors changed 2,115,070 lines of code over 2,959 commits. Top 5 contributors, in
order, are: Mark Robert Miller, Andrea Cosentino, Stephen Mallette, Mark Thomas, and Daniel Keir Haywood.
Apache Project Announcements – the latest updates by category.
Content -- - Apache Jackrabbit 2.14.8 and Oak 1.8.17, 1.10.5 released http://jackrabbit.apache.org
Identity Management -- - Apache Syncope 2.0.14 and 2.1.5 released http://syncope.apache.org Libraries -- - Apache Commons Configuration 2.6 released https://commons.apache.org/proper/commons-configuration Web Frameworks --
- Apache Wicket 8.6.1 and 9.0.0-M3 released http://wicket.apache.org
Did You Know?
- Did you know that the Open Source Design community (ApacheCon Europe Community Partners) are holding a FREE workshop on October 25th (immediately following ApacheCon)? Register today, as space is limited! https://aceu19.apachecon.com/open-source-design-workshop
- Did you know the four things "Father of Java" James Gosling loves about Apache? Learn more in "My personal journey to Open Source", James's keynote at ApacheCon North America https://s.apache.org/0q20b
- Did you know that the ASF exceeded 7,000 code Committers https://s.apache.org/w7bw1
Apache Community Notices:
- Celebrating 20 Years Community-led Development "The Apache Way" https://s.apache.org/ASF20thAnniversary
- ASF Founders look back on 20 Years of the ASF https://blogs.apache.org/foundation/entry/our-founders-look-back-on
- The Apache Way to Sustainable Open Source Success https://s.apache.org/GhnI
- Foundation Reports and Statements http://www.apache.org/foundation/reports.html
- ApacheCon: Tomorrow's Technology Today since 1998 http://s.apache.org/ApacheCon
- ASF Annual Report for FY2019 https://s.apache.org/FY2019AnnualReport
- The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3
- Foundation Statement –Apache Is Open. https://s.apache.org/PIRA
- "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache
- Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter (https://twitter.com/TheASF) and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation
- Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity
- The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html
- Spark + AI Summit 2019 will be held 15-17 October in Amsterdam https://databricks.com/sparkaisummit/
- Registration open for ApacheCon Europe 22-24 October 2019 http://apachecon.com/
- Find out how you can participate with Apache
community/projects/activities --opportunities open with Apache Camel,
Apache HTTP Server, and more! https://helpwanted.apache.org/
- Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby
= = =
For real-time updates, sign up for Apache-related news by sending
mail to [email protected] and follow @TheASF on Twitter.
For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.
[Less]
|
Posted
about 4 years
ago
by
Swapnil M Mane
Happy Friday! We're wrapping up another great week with the following activities:
ASF Board – management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.- Next Board Meeting: 18 September
... [More]
2019. Board calendar and minutes http://apache.org/foundation/board/calendar.html
ApacheCon™ – the ASF's official global conference series, bringing Tomorrow's Technology Today since 1998 - Countdown to ApacheCon Europe -- we look forward to seeing you in Berlin -- REGISTER TODAY! https://www.apachecon.com/ - NEW! Catch the latest presentations from ApacheCon/Las Vegas exclusively on Feathercast https://feathercast.apache.org/
ASF Infrastructure – our distributed team on three continents keeps the ASF's infrastructure running around the clock. -
7M+ weekly checks yield uptime at 100.00%. Performance checks across 50
different service components spread over more than 250 machines in data
centers around the world. http://www.apache.org/uptime/
Apache Code Snapshot – this week, 857 Apache contributors changed 4,388,161 lines of code over 3,161 commits. Top 5 contributors, in
order, are: Mark Thomas, Gary Gregory, Stephen Mallette, Andrea Cosentino, and Michael Stack.
Apache Project Announcements – the latest updates by category.
Big Data -- - Apache Calcite 1.21.0 released http://calcite.apache.org/
Build Management -- - Apache Maven 3.6.2 released http://maven.apache.org Content -- - Apache Traffic Control 3.0.2 released http://trafficcontrol.apache.org
Data Management Platform -- - Apache Geode 1.9.1 released http://geode.apache.org
Enterprise Processes Automation - Apache OFBiz 16.11.06 released http://ofbiz.apache.org Libraries -- - Apache Flagon UserALE.js 2.0.2 (Incubating) released http://flagon.incubator.apache.org - Apache HttpComponents Client 4.5.10 GA released http://hc.apache.org - Apache Commons Daemon 1.2.1 released http://commons.apache.org - Apache Milagro Crypto C & JS Libraries (Incubating) 1.0.0 released http://milagro.apache.org Messaging Platform -- - Apache Pulsar 2.4.1 released http://pulsar.apache.org
Web Frameworks -- - Apache Wicket 7.15.0 and 8.6.0 released http://wicket.apache.org
Did You Know?
- Did you
know that Apple have been successfully using Apache CloudStack for the
past 6 years to power their virtual machine service for hundreds of
mission-critical internal and external applications? http://cloudstack.apache.org/
- Did you
know that during this week's ApacheCon, Apache projects added 406 new
committers, and Apache Calcite, Camel, Flink, Maven, SkyWalking,
Syncope, Tapestry, and Wicket issued new releases? https://projects.apache.org/
- Did you know that 35 new individual ASF Members elected, totaling 766 https://s.apache.org/w7bw1
Apache Community Notices:
- Celebrating 20 Years Community-led Development "The Apache Way" https://s.apache.org/ASF20thAnniversary
- ASF Founders look back on 20 Years of the ASF https://blogs.apache.org/foundation/entry/our-founders-look-back-on
- The Apache Way to Sustainable Open Source Success https://s.apache.org/GhnI
- Foundation Reports and Statements http://www.apache.org/foundation/reports.html
- ApacheCon: Tomorrow's Technology Today since 1998 http://s.apache.org/ApacheCon
- ASF Annual Report for FY2019 https://s.apache.org/FY2019AnnualReport
- The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3
- Foundation Statement –Apache Is Open. https://s.apache.org/PIRA
- "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache
- Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter (https://twitter.com/TheASF) and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation
- Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity
- The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html
- Registration is open for ApacheCon North America 9-12 September 2019 http://apachecon.com/
- Spark + AI Summit 2019 will be held 15-17 October in Amsterdam https://databricks.com/sparkaisummit/
- Registration open for ApacheCon Europe 22-24 October 2019 http://apachecon.com/
- Find out how you can participate with Apache
community/projects/activities --opportunities open with Apache Camel,
Apache HTTP Server, and more! https://helpwanted.apache.org/
- Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby
= = =
For real-time updates, sign up for Apache-related news by sending
mail to [email protected] and follow @TheASF on Twitter.
For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.
[Less]
|
Posted
about 4 years
ago
by
Geertjan
An Apache NetBeans schedule for those going to Oracle Code One 2019 next week!
Saturday, September 14
19:00 Hang out in the Thirsty Bear in Howard Street
Monday, September 16
Why You Should Be Coding with the NetBeans IDE [BOF1321]
Mark
... [More]
Stephens, Developer, IDRsolutions
Ethan Price, Developer, IDRsolutions
02:30 PM - 03:15 PM | Moscone South - Room 305
Java IDE Wars [DEV1375]
Ken Fogel, Teacher, Dawson College
Scott Selikoff, Software Developer, Selikoff Solutions, LLC
Jeanne Boyarsky, Developer, CodeRanch
04:00 PM - 04:45 PM | Moscone South - Room 304
Hacking the NetBeans IDE [BOF1338]
Mark Stephens, IDR Solutions
06:00 PM - 06:45 PM | Moscone South - Room 309
Hacking the NetBeans Profiler [BOF4170]
Ryan Cuprak, Formulation Applications R&D Development Senior Manager, Dassault Systemes
06:00 PM - 06:45 PM | Moscone South - Room 305
Tuesday, September 17
Getting Started with Deep Learning for Enterprise Java Developers [DEV2126]
Zoran Sevarac, Associate Professor, University of Belgrade, Faculty of Organisational Sciences
Suyash Joshi, Developer Marketing Director, Oracle
12:30 PM - 01:15 PM | Moscone South - Room 308
Testing on Oracle Autonomous Database with Homomorphic Encryption, Using NetBeans and Java - BYOL [HOL3196]
Simon Bain, Founder & CTO, ShieldIO
12:30 PM - 02:30 PM | Moscone West - Room 3024C
Wednesday, September 18
Apache NetBeans: Its Status and Future [DEV2506]
Geertjan Wielenga, Product Manager, Oracle
Mark Stephens, Developer, IDRsolutions
Ethan Price, Developer, IDRsolutions
06:00 PM - 06:45 PM | Moscone South - Room 206
Thursday, September 19
Testing on Oracle Autonomous Database with Homomorphic Encryption, Using NetBeans and Java - BYOL [HOL3196]
Simon Bain, Founder & CTO, ShieldIO
09:00 AM - 11:00 AM | Moscone West - Room 3024C
19:00 Hang out in the Thirsty Bear in Howard Street
[Less]
|
Posted
about 4 years
ago
by
humbedooh
What happened
On August 31st 2019, the machine hosting our subversion-to-git mirrors and synchronization process for GitHub suffered a catastrophic drive error due to a power failure at our data center in Virginia. The power failure was
... [More]
, unfortunately, of such a nature, that recovering the disk data was not possible. Four days into the failure, on September 4th 2019, we received confirmation from the data center that the data redundancy had also failed, meaning we had no measure of restoring to a new disk.
What this means right now
Currently, all GitHub mirrors that originate in subversion, and thus relied on this service, are not being synchronized with their subversion source. As git relies on on-disk subversion meta-data, as opposed to in-repo, we are not able to obtain the meta-data and continue synchronizing unless a full recreation of the mirrors is performed. This means starting from the first revision in any given subversion repository and working towards the most current one, a process that may well take a few days or weeks, depending on the size of the repository (by number of commits) and the number of running jobs at that time.
What we intend to do, going forward
Our most immediate action has been to revisit off-site backup strategies to ensure that our services are as resilient as possible, as well as re-assess and re-categorize various machines with regards to backup strategies.
With backups revisited, and on the more long-term side of things, discussions have been centered around what we want to offer, and how that will shape our design of the system. We want to balance the need for features against robustness and speed at the core of the service, as well as perform some fall cleaning of the service, and as such, the Infrastructure team has decided to restart the service with a blank slate, incorporating features as the needs arise and are discussed. We will also be reaching out to the projects with subversion-to-git mirrors currently on GitHub, and ask for a positive confirmation that they wish to continue with this service, so as to clean up the number of repositories that are no longer in use. We are also redesigning the core service, coupling it tighter with our subversion offerings.
We estimate the git mirror service to be revamped and rebooted in a matter of weeks, as cycles allow (this is occurring in tandem with other service upgrades, which puts the timeline somewhat into the future), and will add mirror repositories on an ad-hoc basis as requests come in.
Notable changes to service offering
As we are starting with a blank slate, please be advised of the following changes to the service as it starts back up:
There will no longer be a git.apache.org URL for git mirrors, to lessen the confusion with gitbox.apache.org. Projects wishing to point to a git copy of their subversion repository should use their respective GitHub URLs.
Repositories are re-created from scratch. As such, it may take days from a recreation is started till the sync process begins to kick in.
[Less]
|
Posted
about 4 years
ago
by
stack
by Toshihiro Suzuki, HBase Committer
hbtop is a real-time monitoring tool for HBase modeled after Unix's _top_ command. It can display summary information as well as metrics per Region/Namespace/Table/RegionServer. With this tool, you can see
... [More]
metrics sorted by a selected field and filter the metrics to see only metrics you are interested in. Also, with the drill-down feature, you dig in on hot-spotting Regions.
hbtop (https://issues.apache.org/jira/browse/HBASE-11062) is available in the coming hbase 2.1.7, 2.2.2, and 2.3.0 releases and is being actively backported to branch-1.
Run hbtop with the following command:
$ hbase hbtop
In this case, the values of hbase.client.zookeeper.quorum and zookeeper.znode.parent in hbase-site.xml in the classpath or their default values are used to connect. Or, specify your own zookeeper quorum and znode parent as follows:
$ hbase hbtop -Dhbase.client.zookeeper.quorum= -Dzookeeper.znode.parent=
Run hbtop and you'll see something like the following:
The top screen consists of a summary and metrics section. In the summary section, you can see HBase Version, Cluster ID, The number of region servers, Region count, Average Cluster Load and Aggregated Request/s. In the metrics portion, you can see metrics per Region/Namespace/Table/RegionServer depending on the selected mode. The top screen is refreshed on a period – 3 seconds by default.
You can scroll the metric records in the metrics section.
Command line arguments
Argument
Description
-d,--delay
The refresh delay (in seconds); default is 3 seconds
-h,--help
Print usage; for help while the tool is running press h key
-m,--mode
The mode n (Namespace)|t (Table)|r (Region)|s (RegionServer), default is r (Region) Mode
You can change mode by pressing the m key in the top screen.
Change the refresh rate by pressing d key in the top screen.
You can change the field screen by pressing f key in the top screen. In the fields screen, you can change the displayed fields by choosing a field and pressing d key or space key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the sort field by choosing a field and pressing s key. Also, you can change the sort order (ascending or descending) by pressing R key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the order of the fields.
Filters
You can filter the metric records with the filter feature. We can add filters by pressing o key for ignoring case or O key for case sensitive.
The syntax is as follows:
For example, we can add filters like the following:
NAMESPACE==default
REQ/S>1000
The operators you can specify are as follows:
Operator
Description
=
Partial match
==
Exact match
>
Greater than
>=
Greater than or equal to
<
Less than
<=
Less than and equal to
You can see the current filters by pressing ^o key and clear them by pressing = key.
Drilling down
You can drill down on a metric record by pressing i key in the top screen. With this feature, you can find hot regions easily in a top-down manner.
Help screen
You can see the help screen by pressing h key in the top screen.
How hbtop gets the metrics data
hbtop gets the metrics from ClusterMetrics which is returned as the result of a call to Admin#getClusterMetrics() on the current HMaster. To add metrics to hbtop, they will need to be exposed via ClusterMetrics.
Feedback, bugs, and enhancements are all welcome!
The Reference Guide - hbtop:
https://hbase.apache.org/book.html#hbtop
[Less]
|
Posted
about 4 years
ago
by
stack
by Toshihiro Suzuki, HBase Committer
hbtop is a real-time monitoring tool for HBase modeled after Unix's _top_ command. It can display summary information as well as metrics per Region/ Namespace/Table/RegionServer. With this tool, you
... [More]
can see metrics sorted by a selected field and filter the metrics to see only metrics you are interested in. Also, with the drill-down feature, you dig in on hot-spotting Regions.
hbtop (https://issues.apache.org/jira/browse/HBASE-11062) is available in the coming hbase 2.1.7, 2.2.2, and 2.3.0 releases and is being actively backported to branch-1.
Run hbtop with the following command:
$ hbase hbtop
In this case, the values of hbase.client.zookeeper.quorum and zookeeper.znode.parent in hbase-site.xml in the classpath or their default values are used to connect. Or, specify your own zookeeper quorum and znode parent as follows:
$ hbase hbtop -Dhbase.client.zookeeper. quorum= -Dzookeeper.znode.parent=
Run hbtop and you'll see something like the following:
The top screen consists of a summary and metrics section. In the summary section, you can see HBase Version, Cluster ID, The number of region servers, Region count, Average Cluster Load and Aggregated Request/s. In the metrics portion, you can see metrics per Region/Namespace/Table/ RegionServer depending on the selected mode. The top screen is refreshed on a period – 3 seconds by default.
You can scroll the metric records in the metrics section.
Command line arguments
a>
Argument
Description
-d,--delay
The refresh delay (in seconds); default is 3 seconds
-h,--help
Print usage; for help while the tool is running press h key
-m,--mode
The mode; n (Namespace)|t (Table)|r (Region)|s (RegionServer), default is r (Region) Modes
You can change mode by pressing the m key in the top screen.
Change the refresh rate by pressing d key in the top screen.
You can change the field screen by pressing f key in the top screen. In the fields screen, you can change the displayed fields by choosing a field and pressing d key or space code> key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the sort field by choosing a field and pressing s. Also, you can change the sort order (ascending or descending) by pressing R key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the order of the fields.
Filters
You can filter the metric records with the filter feature. We can add filters by pressing o key for ignoring case or O key for case sensitive.
The syntax is as follows:
For example, we can add filters like the following:
NAMESPACE==default
REQ/S>1000
The operators you can specify are as follows:
Operator
Description
=
Partial match
==
Exact match
>
Greater than
>=
Greater than or equal to
<
Less than
<=
Less than and equal to
You can see the current filters by pressing the ^o key and clear them by pressing the = key.
Drilling down
You can drill down on a metric record by pressing i key in the top screen. With this feature, you can find hot regions easily in a top-down manner.
Help screen
You can see the help screen by pressing the h key in the top screen.
How hbtop gets the metrics data
hbtop gets the metrics from ClusterMetrics which is returned as the result of a call to Admin#getClusterMetrics() on the current HMaster. To add metrics to hbtop, they will need to be exposed via ClusterMetrics.
hbtop sits in its own module with a README from where most of this blog post was cobbled. Feedback, bugs, and enhancements are all welcome! [Less]
|
Posted
about 4 years
ago
by
stack
by Toshihiro Suzuki, HBase Committer
hbtop is a real-time monitoring tool for HBase modeled after Unix's _top_ command. It can display summary information as well as metrics per Region/Namespace/Table/RegionServer. With this tool, you can see
... [More]
metrics sorted by a selected field and filter the metrics to see only metrics you are interested in. Also, with the drill-down feature, you dig in on hot-spotting Regions.
hbtop (https://issues.apache.org/jira/browse/HBASE-11062) is available in the coming hbase 2.1.7, 2.2.2, and 2.3.0 releases and is being actively backported to branch-1.
Run hbtop with the following command:
$ hbase hbtop
In this case, the values of hbase.client.zookeeper.quorum and zookeeper.znode.parent in hbase-site.xml in the classpath or their default values are used to connect. Or, specify your own zookeeper quorum and znode parent as follows:
$ hbase hbtop -Dhbase.client.zookeeper.quorum= -Dzookeeper.znode.parent=
Run hbtop and you'll see something like the following:
The top screen consists of a summary and metrics section. In the summary section, you can see HBase Version, Cluster ID, The number of region servers, Region count, Average Cluster Load and Aggregated Request/s. In the metrics portion, you can see metrics per Region/Namespace/Table/RegionServer depending on the selected mode. The top screen is refreshed on a period – 3 seconds by default.
You can scroll the metric records in the metrics section.
Command line arguments
Argument
Description
-d,--delay
The refresh delay (in seconds); default is 3 seconds
-h,--help
Print usage; for help while the tool is running press h key
-m,--mode
The mode n (Namespace)|t (Table)|r (Region)|s (RegionServer), default is r (Region) Mode
You can change mode by pressing the m key in the top screen.
Change the refresh rate by pressing d key in the top screen.
You can change the field screen by pressing f key in the top screen. In the fields screen, you can change the displayed fields by choosing a field and pressing d key or space key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the sort field by choosing a field and pressing s key. Also, you can change the sort order (ascending or descending) by pressing R key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the order of the fields.
Filters
You can filter the metric records with the filter feature. We can add filters by pressing o key for ignoring case or O key for case sensitive.
The syntax is as follows:
For example, we can add filters like the following:
NAMESPACE==default
REQ/S>1000
The operators you can specify are as follows:
Operator
Description
=
Partial match
==
Exact match
>
Greater than
>=
Greater than or equal to
<
Less than
<=
Less than and equal to
You can see the current filters by pressing ^o key and clear them by pressing = key.
Drilling down
You can drill down on a metric record by pressing i key in the top screen. With this feature, you can find hot regions easily in a top-down manner.
Help screen
You can see the help screen by pressing h key in the top screen.
How hbtop gets the metrics data
hbtop gets the metrics from ClusterMetrics which is returned as the result of a call to Admin#getClusterMetrics() on the current HMaster. To add metrics to hbtop, they will need to be exposed via ClusterMetrics.
Feedback, bugs, and enhancements are all welcome!
The Reference Guide - hbtop:
https://hbase.apache.org/book.html#hbtop
[Less]
|
Posted
about 4 years
ago
by
stack
by Toshihiro Suzuki, HBase Committer
hbtop is a real-time monitoring tool for HBase modeled after Unix's _top_ command. It can display summary information as well as metrics per Region/ Namespace/Table/RegionServer. With this tool, you can
... [More]
see metrics sorted by a selected field and filter the metrics to see only metrics you are interested in. Also, with the drill-down feature, you dig in on hot-spotting Regions.
hbtop (https://issues.apache.org/jira/browse/HBASE-11062) is available in the coming hbase 2.1.7, 2.2.2, and 2.3.0 releases and is being actively backported to branch-1.
Run hbtop with the following command:
$ hbase hbtop
In this case, the values of hbase.client.zookeeper.quorum and zookeeper.znode.parent in hbase-site.xml in the classpath or their default values are used to connect. Or, specify your own zookeeper quorum and znode parent as follows:
$ hbase hbtop -Dhbase.client.zookeeper. quorum= -Dzookeeper.znode.parent=
Run hbtop and you'll see something like the following:
The top screen consists of a summary and metrics section. In the summary section, you can see HBase Version, Cluster ID, The number of region servers, Region count, Average Cluster Load and Aggregated Request/s. In the metrics portion, you can see metrics per Region/Namespace/Table/ RegionServer depending on the selected mode. The top screen is refreshed on a period – 3 seconds by default.
You can scroll the metric records in the metrics section.
Command line arguments
Argument
Description
-d,--delay
The refresh delay (in seconds); default is 3 seconds
-h,--help
Print usage; for help while the tool is running press h key
-m,--mode
The mode; n (Namespace)|t (Table)|r (Region)|s (RegionServer), default is r (Region) Modes
You can change mode by pressing the m key in the top screen.
Change the refresh rate by pressing d key in the top screen.
You can change the field screen by pressing f key in the top screen. In the fields screen, you can change the displayed fields by choosing a field and pressing d key or space key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the sort field by choosing a field and pressing s. Also, you can change the sort order (ascending or descending) by pressing R key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the order of the fields.
Filters
You can filter the metric records with the filter feature. We can add filters by pressing o key for ignoring case or O key for case sensitive.
The syntax is as follows:
For example, we can add filters like the following:
NAMESPACE==default
REQ/S>1000
The operators you can specify are as follows:
Operator
Description
=
Partial match
==
Exact match
>
Greater than
>=
Greater than or equal to
<
Less than
<=
Less than and equal to
You can see the current filters by pressing the ^o key and clear them by pressing the = key.
Drilling down
You can drill down on a metric record by pressing i key in the top screen. With this feature, you can find hot regions easily in a top-down manner.
Help screen
You can see the help screen by pressing the h key in the top screen.
How hbtop gets the metrics data
hbtop gets the metrics from ClusterMetrics which is returned as the result of a call to Admin#getClusterMetrics() on the current HMaster. To add metrics to hbtop, they will need to be exposed via ClusterMetrics.
hbtop sits in its own module with a README from where most of this blog post was cobbled. Feedback, bugs, and enhancements are all welcome! [Less]
|
Posted
about 4 years
ago
by
stack
by Toshihiro Suzuki, HBase Committer
hbtop is a real-time monitoring tool for HBase modeled after Unix's _top_ command. It can display summary information as well as metrics per Region/Namespace/Table/RegionServer. With this tool, you can see
... [More]
metrics sorted by a selected field and filter the metrics to see only metrics you are interested in. Also, with the drill-down feature, you dig in on hot-spotting Regions.
hbtop (https://issues.apache.org/jira/browse/HBASE-11062) is available in the coming hbase 2.1.7, 2.2.2, and 2.3.0 releases and is being actively backported to branch-1.
Run hbtop with the following command:
$ hbase hbtop
In this case, the values of hbase.client.zookeeper.quorum and zookeeper.znode.parent in hbase-site.xml in the classpath or their default values are used to connect. Or, specify your own zookeeper quorum and znode parent as follows:
$ hbase hbtop -Dhbase.client.zookeeper.quorum= -Dzookeeper.znode.parent=
Run hbtop and you'll see something like the following:
The top screen consists of a summary and metrics section. In the summary section, you can see HBase Version, Cluster ID, The number of region servers, Region count, Average Cluster Load and Aggregated Request/s. In the metrics portion, you can see metrics per Region/Namespace/Table/RegionServer depending on the selected mode. The top screen is refreshed on a period – 3 seconds by default.
You can scroll the metric records in the metrics section.
Command line arguments
Argument
Description
-d,--delay
The refresh delay (in seconds); default is 3 seconds
-h,--help
Print usage; for help while the tool is running press h key
-m,--mode
The mode; n (Namespace)|t (Table)|r (Region)|s (RegionServer), default is r (Region) Modes
You can change mode by pressing the m key in the top screen.
Change the refresh rate by pressing d key in the top screen.
You can change the field screen by pressing f key in the top screen. In the fields screen, you can change the displayed fields by choosing a field and pressing d key or space key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the sort field by choosing a field and pressing s. Also, you can change the sort order (ascending or descending) by pressing R key.
You can move to the fields screen by pressing f key in the top screen. In the field screen, you can change the order of the fields.
Filters
You can filter the metric records with the filter feature. We can add filters by pressing o key for ignoring case or O key for case sensitive.
The syntax is as follows:
For example, we can add filters like the following:
NAMESPACE==default
REQ/S>1000
The operators you can specify are as follows:
Operator
Description
=
Partial match
==
Exact match
>
Greater than
>=
Greater than or equal to
<
Less than
<=
Less than and equal to
You can see the current filters by pressing the ^o key and clear them by pressing the = key.
Drilling down
You can drill down on a metric record by pressing i key in the top screen. With this feature, you can find hot regions easily in a top-down manner.
Help screen
You can see the help screen by pressing the h key in the top screen.
How hbtop gets the metrics data
hbtop gets the metrics from ClusterMetrics which is returned as the result of a call to Admin#getClusterMetrics() on the current HMaster. To add metrics to hbtop, they will need to be exposed via ClusterMetrics.
hbtop sits in its own module with a README from where most of this blog post was cobbled. Feedback, bugs, and enhancements are all welcome! [Less]
|
Posted
over 4 years
ago
by
khmarbaise
The Apache Maven team is pleased to announce the release of the Apache
Maven 3.6.2.
Apache Maven is a software project management and comprehension tool. Based
on the concept of a project object model (POM), Maven can manage a
project’s
... [More]
build, reporting and documentation from a central piece of
information.
You can find out more about Apache Maven at https://maven.apache.org
You can download the appropriate sources etc. from
the download page
We really value the contributions of these non committers, so this section is
focused on those individuals. Descriptions of the issues fixed can be found at
the end of these release notes.
Issue Reporters of this release:
Benoit GUERIN
Christian Schulte
Elliotte Rusty Harold
Falko Modler
Francesco Chicchiriccò
Guillaume Nodet,
guofei
Joseph Walton
Louis Mills
Mark Derricutt,
Mark McKelvy
Mickael Istria
Nicolas Echegut
Nicolas Radde
Raphael Rösch
Ray Tsang
Robert Thornton
Rohan Padhye
Sergey Chernov
Stefan Oehme
Thibaud Lepretre
zhb.
Code Contributors of this release:
Guillaume Nodet
Mickael Istria
Ray Tsang
Stefan Oehme
Joseph Walton
Bo Zhang
AElMehdi
Christian Schulte
Mao Shuai
MartinKanters
Sergey Chernov
Jesse Glick.
Many thanks to all reporters and contributors for their time and support.
(Please send an email to the dev list if we missed one to mention).
Known Issues
None.
Overview about the changes
This release focuses mostly performance improvements, better memory footprint, and less CPU usage.
We are continuing to convert Maven Core to use JSR 330 annotations instead of Plexus
(still not finished, see MNG-5577).
New support for ‘release’ qualifier (see MNG-6655).
The toolchain.xml file supports environment variables (see MNG-6665).
User visible Changes
toolchain.xml now supports usage of environment variables which looks like this:
1
2
3
4
5
6
7
8
9
10
jdk
1.8
sun
${env.JDK_HOME_8}
The detailed issue list
Bugs:
MNG-6375 – NullPointerException when pom.xml has incomplete XML tag
MNG-6626 – NullPointerException in DefaultExceptionHandler
MNG-6629 – DefaultModelValidator.validateId is inefficient
MNG-6630 – ComparableVersion.parseVersion is inefficient
MNG-6631 – DefaultArtifactVersion.parseVersion is inefficient
MNG-6632 – ArtifactHandlerManager.getArtifactHandler is inefficient
MNG-6633 – ExcludesArtifactFilter is a memory hog
MNG-6636 – NPE on reporting convertion (DefaultReportingConverter) when inheritance of with no reports
MNG-6639 – Child inherit.append.path attributes not defined in Maven POM XSD
MNG-6642 – Tycho-based modules do not build with 3.6.1 (works with 3.6.0)
MNG-6643 – Version comparison CLI does not work anymore
MNG-6644 – NPE in DefaultReportingConverter when reports has no InputLocation (using polyglot Maven)
MNG-6647 – NPE in DefaultReportingConverter (when reports injected by Repaint IO maven-tiles)
MNG-6653 – DefaultProjectBuildingRequest copy constructor does not copy all fields
MNG-6668 – Model location handling uses too much memory
MNG-6669 – Tycho cannot resolve project dependencies
MNG-6700 – Equal compile source roots are added multiple times
MNG-6703 – DefaultUrlNormalizer doesn’t normalize all relative URIs
MNG-6704 – MavenRepositorySystemUtils.newSession() misses assignment
MNG-6707 – Maven XML parser does not accept ‘>’ in XML processing instructions
MNG-6712 – Downgrade maven-resolver:1.4.0 to 1.3.3
MNG-6713 – Fix ExclusionArtifactFilter to respect wildcard
MNG-6716 – relative testSourceDirectory on macos throw duplicate class error
MNG-6720 – MultiThreadedBuilder: wait for parallel running projects when using —fail-fast
MNG-6723 – MavenProject.getParentFile() not set when using ProjectBuilder.build(List, …)
Improvements
MNG-6069 – Migrate to non deprecated parts of Commons CLI
MNG-6638 – Prevent reparsing POMs in MavenMetadataSource
MNG-6655 – Add support for “release” qualifier
MNG-6665 – toolchain.xml file should support environment variables
MNG-6667 – Hint at Maven upgrade requirement when trying to build a pom.xml with a newer modelVersion
MNG-6675 – Make Resolver debug log messages for projects and plugins consistent
MNG-6695 – Improve speed in collection merging
MNG-6696 – Speed improvements while parsing big reactor projects
MNG-6697 – Add a fast interpolator not using reflection
MNG-6698 – Lazily compute the ManagedVersionMap
MNG-6701 – Document maven.repo.local system property
MNG-6702 – Improve DefaultModelValidator performance
MNG-6705 – Speep up Artifact version check and Parent interpolation
MNG-6718 – Upgrade Plexus Utils to 3.2.1
MNG-6729 – StringSearchModelInterpolator introspects objects from Java API
MNG-6747 – Generalize ‘resume from’ message when build reactor fails
Test
MNG-6535 – Improve test coverage of org.apache.maven.model.path.DefaultUrlNormalizer
Wish
Task
MNG-6681 – improve documentation: dependency type = file classifier(optional)+extension + additional hints on dependency features
Dependency upgrade
MNG-6549 – Remove unused transitive dependencies of Guava
MNG-6627 – upgrade plexus-component-metadata to 2.0.0 to get reproducible META-INF/plexus/components.xml
MNG-6646 – Upgrade maven-assembly-plugin to 3.1.1
MNG-6671 – Upgrade Modello to 1.11
MNG-6674 – Upgrade Wagon to 3.3.3
MNG-6738 – Upgrade maven-resolver to 1.4.1
Sub Tasks
MNG-6680 – Convert Maven Settings Builder to JSR 330
MNG-6685 – Convert Maven Model Builder to JSR 330
MNG-6686 – Convert Maven Embedder to JSR 330
The full list of changes can be found in our issue management system.
Complete Release Notes
See complete release notes for all versions
The Apache Maven Team.
[Less]
|