Task 04. Crash System

Let’s learn how the cluster works when OS crash.


Crash Primary Site Node(prihana)

When System Crash occurs in primary node prihana, check whether secondary node sechana node is normally changed to primary node. image02

  1. Connect to EC2 Instance Console

  2. Select HANA-HDB-Primary instance and click Connect. image01-01

  3. Select Session Manager, click Connect and then connect to prihana instance through Session Manager. image01-02

  4. Execute fast-reboot on prihana (use root user)

    sudo su -
    echo 'b' > /proc/sysrq-trigger
    

    image04-07

  5. Check cluster and HSR status on sechana

  6. Connect to EC2 Instance Console

  7. Select HANA-HDB-Secondary instance and click Connect. image01-08

  8. Select Session Manager, click Connect and then connect to sechana instance through Session Manager. image01-02

  9. Check cluster status.

    • crm_mon is a command that provides the current state of cluster (use root user).
    • Execute the command below to check if sechana is in Master status. Unlike the previous case, prihana is in OFFLINE status.
    sudo su -
    crm_mon -rfn1
    

    image04-09

  10. Check SAP HANA System Replication (HSR)

    • As a result of executing the SAPHanaSR-showAttr command, the prihana node is in offline status (use root user).
    SAPHanaSR-showAttr
    

    image04-10

  11. After taking over, clean up the resource status

    crm resource cleanup rsc_SAPHanaTopology_HDB_HDB00
    

    image01-11

  12. Connect to Bastion Host and check the Dashboard of HAWK web (refer to Lab02)

    • Unlike the previous case, prihana is offline. image04-12
  13. Connect to EC2 Instance Console

  14. HANA-HDB-Primary instance is in stopped state. Start prihana to check if it is in a normal state. image04-13

  15. Select HANA-HDB-Primary instance, and click Action. Press Start in Instance State. Press Yes, Start. image04-14

  16. If HANA-HDB-Primary boots normally, connect to sechana instance. check cluster and HSR status.

  17. Check cluster status.

    • Execute the command below to check if prihana is in Slave status (use root user).
    sudo su -
    crm_mon -rfn1
    

    image04-26

  18. Check SAP HANA System Replication (HSR)

    • Using SAPHanaSR-showAttr, prihana node confirms SOK (use root user)
    SAPHanaSR-showAttr
    

    image01-10

  19. clean up the resource status (use root user)

    crm resource cleanup rsc_SAPHanaTopology_HDB_HDB00
    

    image01-11

  20. Connect to Bastion Host and check the Dashboard of HAWK web (refer to Lab02)

    • You can see that prihana has changed to online status. image04-16

Crash Secondary Site Node (sechana)

When System Crash occurs in primary node sechana, check whether secondary node prihana node is normally changed to primary node. image03

  1. Connect to EC2 Instance Console

  2. Select HANA-HDB-Secondary instance and click Connect. image01-08

  3. Select Session Manager, click Connect and then connect to sechana instance through Session Manager. image01-02

  4. Execute fast-reboot on sechana (use root user)

    sudo su -
    echo 'b' > /proc/sysrq-trigger
    

    image04-17

  5. Check cluster and HSR status on prihana.

  6. Connect to EC2 Instance Console

  7. Select HANA-HDB-Primary instance and click Connect. image01-01

  8. Select Session Manager, click Connect and then connect to prihana instance through Session Manager. image01-02

  9. Check cluster status.

    • crm_mon is a command that provides the current state of cluster (use root user).
    • Execute the command below to check if prihana is in Master status. Unlike the previous case, sechana is in OFFLINE status.
    sudo su -
    crm_mon -rfn1
    

    image04-27

  10. Check SAP HANA System Replication (HSR)

    • As a result of executing the SAPHanaSR-showAttr command, the sechana node is in offline status (use root user).
    SAPHanaSR-showAttr
    

    image04-19

  11. After taking over, clean up the resource status

    crm resource cleanup rsc_SAPHanaTopology_HDB_HDB00
    

    image01-11

  12. Connect to Bastion Host and check the Dashboard of HAWK web (refer to Lab02))

    • Unlike the previous case, sechana is offline. image04-20
  13. Connect to EC2 Instance Console

  14. HANA-HDB-Secondary instance is in stopped state. Start sechana to check if it is in a normal state. image04-21

  15. Select HANA-HDB-Secondary instance, and click Action. Press Start in Instance State. Press Yes, Start. image04-22

  16. If HANA-HDB-Secondary boots normally, connect to sechana instance. check cluster and HSR status.

  17. Check cluster status.

    • Execute the command below to check if sechana is in Slave status (use root user).
    sudo su -
    crm_mon -rfn1
    

    image04-23

  18. Check SAP HANA System Replication (HSR)

    • Using SAPHanaSR-showAttr, sechana node confirms SOK (use root user)
    SAPHanaSR-showAttr
    

    image04-24

  19. clean up the resource status (use root user)

    crm resource cleanup rsc_SAPHanaTopology_HDB_HDB00
    

    image01-11

  20. Connect to Bastion Host and check the Dashboard of HAWK web (refer to Lab02)

    • You can see that sechana has changed to online status image04-25

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.