Cloud Storage with Red Hat Ceph Storage
In this exercise, you will expand the cluster by adding new OSDs to each of the nodes in the cluster, and by adding an OSD node to the Ceph cluster.
Outcomes
You should be able to expand your cluster by adding new OSDs.
Start this exercise only after having successfully completed the previous Guided Exercise: Deploying Red Hat Ceph Storage:
As the student user on the workstation machine, use the lab command to prepare your system for this exercise.
[student@workstation ~]$ lab start deploy-expand
This command confirms that the Ceph cluster is reachable and provides an example service specification file.
Procedure 2.2. Instructions
In this exercise, expand the amount of storage in your Ceph storage cluster.
List the inventory of storage devices on the cluster hosts.
Log in to
servercas theadminuser and usesudoto run thecephadmshell.[student@workstation ~]$
ssh admin@clienta[admin@clienta ~]#sudo cephadm shell[ceph: root@clienta /]#Display the storage device inventory on the Ceph cluster.
[ceph: root@clienta /]#
ceph orch device lsHostname Path Type Serial Size Health Ident Fault Available clienta.lab.example.com /dev/vdb hdd f97f3019-2827-4b84-8 10.7G Unknown N/A N/A Yes clienta.lab.example.com /dev/vdc hdd fdaeb489-de2c-4165-9 10.7G Unknown N/A N/A Yes clienta.lab.example.com /dev/vdd hdd 0159ff1a-d45a-4ada-9 10.7G Unknown N/A N/A Yes clienta.lab.example.com /dev/vde hdd 69f43b17-9af3-45f1-b 10.7G Unknown N/A N/A Yes clienta.lab.example.com /dev/vdf hdd bfc36a25-1680-49eb-8 10.7G Unknown N/A N/A Yesserverc.lab.example.com/dev/vdchdd 8b06b0af-ff15-4350-b 10.7G Unknown N/A N/AYesserverc.lab.example.com/dev/vddhdd e15146bc-22dd-4970-a 10.7G Unknown N/A N/AYesserverc.lab.example.com /dev/vde hdd f24fe7d7-b400-44b8-b 10.7G Unknown N/A N/A Yes serverc.lab.example.com /dev/vdf hdd e5747c44-0afa-4918-8 10.7G Unknown N/A N/A Yes serverc.lab.example.com /dev/vdb hdd 8a8d3399-52d9-4da0-b 10.7G Unknown N/A N/A Noserverd.lab.example.com/dev/vdchdd e7f82a83-56f6-44f2-b 10.7G Unknown N/A N/AYesserverd.lab.example.com/dev/vddhdd fc290db7-fa22-4636-a 10.7G Unknown N/A N/AYesserverd.lab.example.com /dev/vde hdd 565c1d73-48c4-4448-a 10.7G Unknown N/A N/A Yes serverd.lab.example.com /dev/vdf hdd 90bf4d1f-83e5-4901-b 10.7G Unknown N/A N/A Yes serverd.lab.example.com /dev/vdb hdd 82dc7aff-3c2a-45bb-9 10.7G Unknown N/A N/A Noservere.lab.example.com/dev/vdchdd d11bb434-5829-4275-a 10.7G Unknown N/A N/AYesservere.lab.example.com/dev/vddhdd 68e406a5-9f0f-4954-9 10.7G Unknown N/A N/AYesservere.lab.example.com /dev/vde hdd 2670c8f2-acde-4948-8 10.7G Unknown N/A N/A Yes servere.lab.example.com /dev/vdf hdd 5628d1f0-bdbf-4b05-8 10.7G Unknown N/A N/A Yes servere.lab.example.com /dev/vdb hdd cb17228d-c039-45d3-b 10.7G Unknown N/A N/A No
Deploy two OSDs by using
/dev/vdcand/dev/vddonserverc.lab.example.com,serverd.lab.example.com, andservere.lab.example.com.Create the
osd_spec.ymlfile in the/var/lib/ceph/osd/directory with the correct configuration. For your convenience, you can copy and paste the content from the/root/expand-osd/osd_spec.ymlfile onclienta.[ceph: root@clienta /]#
exitexit [admin@clienta ~]#sudo cephadm shell --mount /root/expand-osd/osd_spec.yml[ceph: root@clienta /]#cd /mnt[ceph: root@clienta mnt]#cp osd_spec.yml /var/lib/ceph/osd/[ceph: root@clienta mnt]#cat /var/lib/ceph/osd/osd_spec.ymlservice_type: osd service_id: default_drive_group placement: hosts: - serverc.lab.example.com - serverd.lab.example.com - servere.lab.example.com data_devices: paths: - /dev/vdb - /dev/vdc - /dev/vddDeploy the
osd_spec.ymlfile, then run theceph orch applycommand to implement the configuration.[ceph: root@clienta mnt]#
ceph orch apply -i /var/lib/ceph/osd/osd_spec.ymlScheduled osd.default_drive_group update...
Add OSDs to
servereby using devices/dev/vde, and/dev/vdf.Display the
serverestorage device inventory on the Ceph cluster.[ceph: root@clienta mnt]#
ceph orch device ls --hostname=servere.lab.example.comHostname Path Type Serial Size Health Ident Fault Available servere.lab.example.com /dev/vdb hdd 4f0e87b2-dc76-457a-a 10.7G Unknown N/A N/A No servere.lab.example.com /dev/vdc hdd b8483b8a-13a9-4992-9 10.7G Unknown N/A N/A No servere.lab.example.com /dev/vdd hdd ff073d1f-31d8-477e-9 10.7G Unknown N/A N/A No servere.lab.example.com/dev/vdehdd 705f4daa-f63f-450e-8 10.7G Unknown N/A N/AYesservere.lab.example.com/dev/vdfhdd 63adfb7c-9d9c-4575-8 10.7G Unknown N/A N/AYesCreate the OSDs by using
/dev/vdeand/dev/vdfonservere.[ceph: root@clienta mnt]#
ceph orch daemon add osd \ servere.lab.example.com:/dev/vdeCreated osd(s) 9 on host 'servere.lab.example.com'[ceph: root@clienta mnt]#
ceph orch daemon add osd \ servere.lab.example.com:/dev/vdfCreated osd(s) 10 on host 'servere.lab.example.com'
Verify that the cluster is in a healthy state and that the OSDs were successfully added.
Verify that the cluster status is
HEALTH_OK.[ceph: root@clienta mnt]#
ceph statuscluster: id: 29179c6e-10ac-11ec-b149-52540000fa0c health: HEALTH_OK services: mon: 4 daemons, quorum serverc.lab.example.com,clienta,servere,serverd (age 12m) mgr: serverc.lab.example.com.dwsvgt(active, since 12m), standbys: serverd.kdkmia, servere.rdbtge, clienta.etponq osd: 11 osds: 11 up (since 11m), 11 in (since 29m) ...output omitted...Use the
ceph osd treecommand to display the CRUSH tree. Verify that the new OSDs' location in the infrastructure is correct.[ceph: root@clienta mnt]#
ceph osd treeID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 0.10776 root default -3 0.02939 host serverc 2 hdd 0.00980 osd.2 up 1.00000 1.00000 5 hdd 0.00980 osd.5 up 1.00000 1.00000 8 hdd 0.00980 osd.8 up 1.00000 1.00000 -7 0.02939 host serverd 1 hdd 0.00980 osd.1 up 1.00000 1.00000 4 hdd 0.00980 osd.4 up 1.00000 1.00000 7 hdd 0.00980 osd.7 up 1.00000 1.00000 -5 0.04898 host servere 0 hdd 0.00980 osd.0 up 1.00000 1.00000 3 hdd 0.00980 osd.3 up 1.00000 1.00000 6 hdd 0.00980 osd.6 up 1.00000 1.00000 9 hdd 0.00980 osd.9 up 1.00000 1.00000 10 hdd 0.00980 osd.10 up 1.00000 1.00000Use the
ceph osd dfcommand to verify the data usage and the number of placement groups for each OSD.[ceph: root@clienta mnt]#
ceph osd dfID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2 hdd 0.00980 1.00000 10 GiB 16 MiB 2.1 MiB 0 B 14 MiB 10 GiB 0.15 1.05 38 up 5 hdd 0.00980 1.00000 10 GiB 15 MiB 2.1 MiB 0 B 13 MiB 10 GiB 0.15 1.03 28 up 8 hdd 0.00980 1.00000 10 GiB 20 MiB 2.1 MiB 0 B 18 MiB 10 GiB 0.20 1.37 39 up 1 hdd 0.00980 1.00000 10 GiB 16 MiB 2.1 MiB 0 B 14 MiB 10 GiB 0.16 1.08 38 up 4 hdd 0.00980 1.00000 10 GiB 16 MiB 2.1 MiB 0 B 14 MiB 10 GiB 0.15 1.06 34 up 7 hdd 0.00980 1.00000 10 GiB 15 MiB 2.1 MiB 0 B 13 MiB 10 GiB 0.15 1.04 33 up 0 hdd 0.00980 1.00000 10 GiB 16 MiB 2.1 MiB 0 B 14 MiB 10 GiB 0.15 1.05 22 up 3 hdd 0.00980 1.00000 10 GiB 16 MiB 2.1 MiB 0 B 14 MiB 10 GiB 0.15 1.05 25 up 6 hdd 0.00980 1.00000 10 GiB 16 MiB 2.1 MiB 0 B 14 MiB 10 GiB 0.15 1.05 23 up 9 hdd 0.00980 1.00000 10 GiB 16 MiB 2.1 MiB 0 B 14 MiB 10 GiB 0.15 1.05 24 up 10 hdd 0.00980 1.00000 10 GiB 16 MiB 2.1 MiB 0 B 14 MiB 10 GiB 0.15 1.05 26 up TOTAL 110 GiB 330 MiB 68 MiB 2.8 KiB 262 MiB 110 GiB 0.29 MIN/MAX VAR: 0.65/1.89 STDDEV: 0.16Return to
workstationas thestudentuser.[ceph: root@clienta mnt]#
exit[admin@clienta ~]$exit[student@workstation ~]$
This concludes the guided exercise.
Red Hat Ceph Storage for OpenStack (CL260)
Haley_Ruccio
3 sie 2023
Build, expand and maintain cloud-scale, clustered storage for your applications with Red Hat Ceph StorageCloud Storage with Red Hat Ceph Storage (CL260) is designed for storage administrators and cloud operators who deploy Red Hat Ceph Storage in a production data center environment or as a component of a Red Hat OpenStack Platform or OpenShift Container Platform infrastructure. Learn how to deploy, manage, and scale a Ceph storage cluster to provide hybrid storage resources, including Amazon S3 and OpenStack Swift-compatible object storage, Ceph-native and iSCSI-based block storage, and shared file storage. This course is based on Red Hat Ceph Storage 5.0.Course summaryDeploy and manage a Red Hat Ceph Storage cluster on commodity servers.Perform common management operations using the web-based management interface.Create, expand, and control access to storage pools provided by the Ceph cluster.Access Red Hat Ceph Storage from clients using object, block, and file-based methods.Analyze and tune Red Hat Ceph Storage performance.Integrate Red Hat OpenStack Platform image, object, block, and file storage with a Red Hat Ceph Storage cluster.Integrate OpenShift Container Platform with a Red Hat Ceph Storage cluster.Target AudienceThis course is intended for storage administrators and cloud operators who want to learn how to deploy and manage Red Hat Ceph Storage on servers in an enterprise data center or within a Red Hat OpenStack Platform or OpenShift Container Platform environment.Developers writing applications that use cloud-based storage will learn the distinctions of various storage types and client access methods.Recommended trainingTake our free assessment to gauge whether this offering is the best fit for your skills.Red Hat Certified System Administrator (RHCSA) certification, or equivalent experience.For candidates that have not earned an RHCSA or equivalent, confirmation of the correct skill set knowledge can be obtained by taking the online skills assessment.Some experience with storage administration is recommended but not required.Technology considerationsThis course does not have any special technical requirements.This course is not intended for BYOD.Internet access is recommended.
0
0
24
Welcome to the Red Hat Ceph Storage for OpenStack (CL260) group in the Red Hat Learning Community!
cschunke
31 lip 2023
We are excited to launch a space dedicated to the Red Hat Training course CL260! To gain the most value from this group - click the "Join Group" button in the upper right hand corner of the group home page.We encourage group members to collaborate in this group to discuss topics, ask questions, share best practices and tips, provide course feedback, and share their accomplishments as it relates to CL260.Read more about Red Hat Ceph Storage for OpenStack here.
2
1
381