May 29 20:34:35.975833 ip-10-0-138-100 systemd[1]: Starting Kubernetes Kubelet... May 29 20:34:36.634702 ip-10-0-138-100 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 20:34:36.634702 ip-10-0-138-100 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 20:34:36.634702 ip-10-0-138-100 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 20:34:36.634702 ip-10-0-138-100 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 20:34:36.634702 ip-10-0-138-100 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 20:34:36.638742 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.638604 2551 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 20:34:36.650686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650656 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 20:34:36.650686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650678 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 20:34:36.650686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650682 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 20:34:36.650686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650685 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 20:34:36.650686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650689 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 20:34:36.650686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650692 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 20:34:36.650686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650696 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650699 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650702 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650705 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650708 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650711 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650714 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650716 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650719 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650722 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650725 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650728 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650730 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650733 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650735 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650738 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650752 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650755 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650757 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650760 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 20:34:36.650938 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650763 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650765 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650768 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650771 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650773 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650776 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650779 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650781 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650783 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650786 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650788 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650791 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650793 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650796 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650800 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650803 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650807 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650811 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 20:34:36.651415 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650816 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650821 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650824 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650827 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650830 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650832 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650836 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650839 2551 feature_gate.go:328] unrecognized feature gate: Example May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650841 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650844 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650847 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650849 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650852 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650855 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650857 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650859 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650862 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650865 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650867 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650870 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 20:34:36.651899 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650872 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650875 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650877 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650880 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650882 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650885 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650888 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650890 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650894 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650897 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650899 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650902 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650905 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650907 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650916 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650919 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650921 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650924 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650926 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650929 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 20:34:36.652378 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650931 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.650933 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651347 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651352 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651355 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651358 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651360 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651363 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651365 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651368 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651371 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651374 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651377 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651380 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651382 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651385 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651388 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651390 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651393 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651395 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 20:34:36.652870 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651399 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651402 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651405 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651407 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651410 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651412 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651421 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651424 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651426 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651429 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651432 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651434 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651437 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651439 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651441 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651445 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651448 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651450 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651453 2551 feature_gate.go:328] unrecognized feature gate: Example May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651455 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 20:34:36.653348 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651458 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651460 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651464 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651467 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651470 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651474 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651478 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651480 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651483 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651486 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651489 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651501 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651506 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651509 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651512 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651515 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651533 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651536 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651539 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 29 20:34:36.653866 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651548 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651551 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651555 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651559 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651562 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651566 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651570 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651573 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651576 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651578 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651581 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651583 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651586 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651589 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651591 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651593 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651596 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651598 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651601 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 20:34:36.654335 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651604 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651607 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651610 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651612 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651615 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651617 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651620 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651623 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651625 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.651628 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653901 2551 flags.go:64] FLAG: --address="0.0.0.0" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653917 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653930 2551 flags.go:64] FLAG: --anonymous-auth="true" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653935 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653945 2551 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653950 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653954 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653959 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653962 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653965 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653969 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 20:34:36.654839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653972 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653975 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653978 2551 flags.go:64] FLAG: --cgroup-root="" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653981 2551 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653984 2551 flags.go:64] FLAG: --client-ca-file="" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653987 2551 flags.go:64] FLAG: --cloud-config="" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653989 2551 flags.go:64] FLAG: --cloud-provider="external" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653992 2551 flags.go:64] FLAG: --cluster-dns="[]" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.653998 2551 flags.go:64] FLAG: --cluster-domain="" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654001 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654004 2551 flags.go:64] FLAG: --config-dir="" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654007 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654011 2551 flags.go:64] FLAG: --container-log-max-files="5" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654015 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654018 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654021 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654024 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654027 2551 flags.go:64] FLAG: --contention-profiling="false" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654030 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654033 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654037 2551 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654040 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654044 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654047 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654050 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 20:34:36.655347 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654053 2551 flags.go:64] FLAG: --enable-load-reader="false" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654063 2551 flags.go:64] FLAG: --enable-server="true" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654066 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654073 2551 flags.go:64] FLAG: --event-burst="100" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654076 2551 flags.go:64] FLAG: --event-qps="50" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654080 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654083 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654086 2551 flags.go:64] FLAG: --eviction-hard="" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654090 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654092 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654095 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654098 2551 flags.go:64] FLAG: --eviction-soft="" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654101 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654104 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654107 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654110 2551 flags.go:64] FLAG: --experimental-mounter-path="" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654113 2551 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654115 2551 flags.go:64] FLAG: --fail-swap-on="true" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654118 2551 flags.go:64] FLAG: --feature-gates="" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654122 2551 flags.go:64] FLAG: --file-check-frequency="20s" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654125 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654128 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654131 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654134 2551 flags.go:64] FLAG: --healthz-port="10248" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654138 2551 flags.go:64] FLAG: --help="false" May 29 20:34:36.655980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654141 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-138-100.ec2.internal" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654144 2551 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654147 2551 flags.go:64] FLAG: --http-check-frequency="20s" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654150 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654153 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654156 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654159 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654162 2551 flags.go:64] FLAG: --image-service-endpoint="" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654165 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654175 2551 flags.go:64] FLAG: --kube-api-burst="100" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654179 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654182 2551 flags.go:64] FLAG: --kube-api-qps="50" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654185 2551 flags.go:64] FLAG: --kube-reserved="" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654187 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654190 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654193 2551 flags.go:64] FLAG: --kubelet-cgroups="" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654196 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654199 2551 flags.go:64] FLAG: --lock-file="" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654201 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654204 2551 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654207 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654212 2551 flags.go:64] FLAG: --log-json-split-stream="false" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654215 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654218 2551 flags.go:64] FLAG: --log-text-split-stream="false" May 29 20:34:36.656643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654221 2551 flags.go:64] FLAG: --logging-format="text" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654224 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654227 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654230 2551 flags.go:64] FLAG: --manifest-url="" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654233 2551 flags.go:64] FLAG: --manifest-url-header="" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654237 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654241 2551 flags.go:64] FLAG: --max-open-files="1000000" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654245 2551 flags.go:64] FLAG: --max-pods="110" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654248 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654252 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654255 2551 flags.go:64] FLAG: --memory-manager-policy="None" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654258 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654260 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654263 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654266 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654274 2551 flags.go:64] FLAG: --node-status-max-images="50" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654277 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654279 2551 flags.go:64] FLAG: --oom-score-adj="-999" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654288 2551 flags.go:64] FLAG: --pod-cidr="" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654292 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654297 2551 flags.go:64] FLAG: --pod-manifest-path="" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654299 2551 flags.go:64] FLAG: --pod-max-pids="-1" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654302 2551 flags.go:64] FLAG: --pods-per-core="0" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654306 2551 flags.go:64] FLAG: --port="10250" May 29 20:34:36.657221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654308 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654311 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c08bef68dbad247d" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654314 2551 flags.go:64] FLAG: --qos-reserved="" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654317 2551 flags.go:64] FLAG: --read-only-port="10255" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654320 2551 flags.go:64] FLAG: --register-node="true" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654323 2551 flags.go:64] FLAG: --register-schedulable="true" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654326 2551 flags.go:64] FLAG: --register-with-taints="" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654330 2551 flags.go:64] FLAG: --registry-burst="10" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654332 2551 flags.go:64] FLAG: --registry-qps="5" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654335 2551 flags.go:64] FLAG: --reserved-cpus="" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654338 2551 flags.go:64] FLAG: --reserved-memory="" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654342 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654345 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654348 2551 flags.go:64] FLAG: --rotate-certificates="false" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654351 2551 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654354 2551 flags.go:64] FLAG: --runonce="false" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654357 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654360 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654363 2551 flags.go:64] FLAG: --seccomp-default="false" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654366 2551 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654369 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654372 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654375 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654378 2551 flags.go:64] FLAG: --storage-driver-password="root" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654381 2551 flags.go:64] FLAG: --storage-driver-secure="false" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654384 2551 flags.go:64] FLAG: --storage-driver-table="stats" May 29 20:34:36.657879 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654386 2551 flags.go:64] FLAG: --storage-driver-user="root" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654390 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654393 2551 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654396 2551 flags.go:64] FLAG: --system-cgroups="" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654399 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654404 2551 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654407 2551 flags.go:64] FLAG: --tls-cert-file="" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654410 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654416 2551 flags.go:64] FLAG: --tls-min-version="" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654419 2551 flags.go:64] FLAG: --tls-private-key-file="" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654422 2551 flags.go:64] FLAG: --topology-manager-policy="none" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654425 2551 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654427 2551 flags.go:64] FLAG: --topology-manager-scope="container" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654430 2551 flags.go:64] FLAG: --v="2" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654434 2551 flags.go:64] FLAG: --version="false" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654438 2551 flags.go:64] FLAG: --vmodule="" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654442 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.654445 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654577 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654583 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654586 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654589 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654594 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 20:34:36.658503 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654597 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654599 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654602 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654604 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654607 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654610 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654612 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654615 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654617 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654620 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654622 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654627 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654630 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654634 2551 feature_gate.go:328] unrecognized feature gate: Example May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654636 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654639 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654642 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654644 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654647 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654649 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 20:34:36.659074 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654652 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654654 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654657 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654659 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654662 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654664 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654667 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654669 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654672 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654674 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654677 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654681 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654684 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654686 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654689 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654692 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654694 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654696 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654699 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654701 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 20:34:36.659643 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654704 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654706 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654709 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654711 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654714 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654717 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654719 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654722 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654724 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654726 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654729 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654731 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654734 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654736 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654739 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654741 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654743 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654746 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654750 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 20:34:36.660143 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654753 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654756 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654758 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654761 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654764 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654767 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654770 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654772 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654775 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654778 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654780 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654782 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654785 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654788 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654790 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654793 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654795 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654798 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654801 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654803 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 20:34:36.660625 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654806 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 20:34:36.661103 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.654808 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 20:34:36.661103 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.655933 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 20:34:36.665318 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.665298 2551 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" May 29 20:34:36.665318 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.665320 2551 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665368 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665373 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665377 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665380 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665383 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665386 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665389 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665391 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665394 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665396 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665399 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665402 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665405 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 20:34:36.665402 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665408 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665411 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665414 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665416 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665419 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665422 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665424 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665427 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665429 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665432 2551 feature_gate.go:328] unrecognized feature gate: Example May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665435 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665438 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665443 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665446 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665448 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665451 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665453 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665456 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665459 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665462 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 20:34:36.665863 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665465 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665467 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665470 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665479 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665482 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665484 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665486 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665489 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665491 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665494 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665496 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665499 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665501 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665504 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665507 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665510 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665513 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665515 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665531 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665535 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 20:34:36.666351 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665537 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665540 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665544 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665546 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665549 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665551 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665554 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665556 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665559 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665562 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665564 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665568 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665570 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665573 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665575 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665578 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665581 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665583 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665586 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 20:34:36.666844 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665589 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665593 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665596 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665598 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665602 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665604 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665608 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665610 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665613 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665617 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665620 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665623 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665625 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665628 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.665633 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 20:34:36.667338 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665729 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665733 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665736 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665740 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665744 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665748 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665751 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665754 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665756 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665759 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665762 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665765 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665768 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665770 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665772 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665775 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665778 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665781 2551 feature_gate.go:328] unrecognized feature gate: Example May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665784 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665786 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 20:34:36.667740 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665789 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665792 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665795 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665797 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665800 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665802 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665805 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665807 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665810 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665812 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665815 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665817 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665820 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665822 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665825 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665827 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665830 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665832 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665835 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 20:34:36.668234 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665837 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665840 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665843 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665845 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665848 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665850 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665853 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665856 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665858 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665862 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665864 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665867 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665869 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665873 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665875 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665878 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665880 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665883 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665885 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665888 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 20:34:36.668711 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665890 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665893 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665895 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665897 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665900 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665902 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665905 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665907 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665910 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665912 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665915 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665918 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665920 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665923 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665925 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665928 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665930 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665934 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665936 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 20:34:36.669204 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665939 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665941 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665944 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665946 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665949 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665953 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665956 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:36.665959 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.665964 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 20:34:36.669686 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.667316 2551 server.go:962] "Client rotation is on, will bootstrap in background" May 29 20:34:36.670657 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.670643 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 20:34:36.672039 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.672027 2551 server.go:1019] "Starting client certificate rotation" May 29 20:34:36.672137 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.672124 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 20:34:36.672166 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.672153 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 20:34:36.700974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.700950 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 20:34:36.707904 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.707874 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 20:34:36.733559 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.733535 2551 log.go:25] "Validated CRI v1 runtime API" May 29 20:34:36.744365 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.744346 2551 log.go:25] "Validated CRI v1 image API" May 29 20:34:36.745534 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.745507 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 20:34:36.751243 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.751223 2551 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 20:34:36.757282 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.757260 2551 fs.go:135] Filesystem UUIDs: map[2102708b-15fb-4dc6-9b85-9e3ea0c81bdc:/dev/nvme0n1p4 5d4d0a5f-f0e0-44bd-b816-e29354437a6a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 29 20:34:36.757337 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.757282 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 20:34:36.761593 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.761468 2551 manager.go:217] Machine: {Timestamp:2026-05-29 20:34:36.760987252 +0000 UTC m=+0.633624444 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107343 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f62d762e163838700542e54a37cde SystemUUID:ec2f62d7-62e1-6383-8700-542e54a37cde BootID:09c6c931-c530-46f9-abf5-8af030526672 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:c0:f9:ac:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:c0:f9:ac:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:b5:dc:78:c4:02 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 20:34:36.762776 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.762765 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 20:34:36.762859 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.762847 2551 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 20:34:36.763049 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.763036 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-chffd" May 29 20:34:36.764256 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.764236 2551 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 20:34:36.764400 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.764256 2551 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 20:34:36.764448 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.764409 2551 topology_manager.go:138] "Creating topology manager with none policy" May 29 20:34:36.764448 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.764417 2551 container_manager_linux.go:306] "Creating device plugin manager" May 29 20:34:36.764448 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.764424 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 20:34:36.764448 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.764437 2551 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 20:34:36.767766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.767755 2551 state_mem.go:36] "Initialized new in-memory state store" May 29 20:34:36.767882 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.767873 2551 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 20:34:36.771552 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.771531 2551 kubelet.go:491] "Attempting to sync node with API server" May 29 20:34:36.771661 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.771574 2551 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 20:34:36.771661 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.771601 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 20:34:36.771661 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.771617 2551 kubelet.go:397] "Adding apiserver pod source" May 29 20:34:36.771661 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.771640 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 20:34:36.771972 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.771954 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-chffd" May 29 20:34:36.774293 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.774277 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 20:34:36.774384 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.774313 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 20:34:36.778950 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.778906 2551 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" May 29 20:34:36.782868 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.782844 2551 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 20:34:36.788919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.788903 2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 20:34:36.789290 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789274 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 20:34:36.789359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789298 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 20:34:36.789359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789309 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 20:34:36.789359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789319 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 20:34:36.789359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789333 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 20:34:36.789359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789344 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 20:34:36.789359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789353 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 20:34:36.789554 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789369 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 20:34:36.789554 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789383 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 20:34:36.789554 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789393 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 20:34:36.789554 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789425 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 20:34:36.789554 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789447 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 20:34:36.789799 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.789785 2551 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 20:34:36.791462 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.791439 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 20:34:36.791550 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.791473 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 20:34:36.794596 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.794583 2551 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 20:34:36.794643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.794624 2551 server.go:1295] "Started kubelet" May 29 20:34:36.794712 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.794683 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 20:34:36.794792 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.794720 2551 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 20:34:36.794837 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.794820 2551 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 20:34:36.795360 ip-10-0-138-100 systemd[1]: Started Kubernetes Kubelet. May 29 20:34:36.799236 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.799221 2551 server.go:317] "Adding debug handlers to kubelet server" May 29 20:34:36.799324 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.799254 2551 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-100.ec2.internal" not found May 29 20:34:36.799477 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.799461 2551 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 20:34:36.813553 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:36.813514 2551 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 20:34:36.816819 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.816801 2551 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-100.ec2.internal" not found May 29 20:34:36.816998 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.816983 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 20:34:36.818179 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.818166 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 20:34:36.818326 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.818311 2551 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 20:34:36.818326 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.818326 2551 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 20:34:36.818452 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.818440 2551 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 20:34:36.818513 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.818492 2551 reconstruct.go:97] "Volume reconstruction finished" May 29 20:34:36.818513 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.818502 2551 reconciler.go:26] "Reconciler: start to sync state" May 29 20:34:36.818877 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.818860 2551 factory.go:55] Registering systemd factory May 29 20:34:36.818877 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.818877 2551 factory.go:223] Registration of the systemd container factory successfully May 29 20:34:36.819089 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.819077 2551 factory.go:153] Registering CRI-O factory May 29 20:34:36.819122 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.819090 2551 factory.go:223] Registration of the crio container factory successfully May 29 20:34:36.819150 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.819141 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 20:34:36.819189 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.819156 2551 factory.go:103] Registering Raw factory May 29 20:34:36.819189 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.819167 2551 manager.go:1196] Started watching for new ooms in manager May 29 20:34:36.819646 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:36.819610 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-100.ec2.internal\" not found" May 29 20:34:36.819736 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.819725 2551 manager.go:319] Starting recovery of all containers May 29 20:34:36.821907 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.821885 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 20:34:36.823813 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:36.823796 2551 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-100.ec2.internal\" not found" node="ip-10-0-138-100.ec2.internal" May 29 20:34:36.828317 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.828179 2551 manager.go:324] Recovery completed May 29 20:34:36.834029 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.834012 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 20:34:36.835757 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.835746 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-100.ec2.internal" event="NodeHasSufficientMemory" May 29 20:34:36.835816 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.835774 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-100.ec2.internal" event="NodeHasNoDiskPressure" May 29 20:34:36.835816 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.835788 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-100.ec2.internal" event="NodeHasSufficientPID" May 29 20:34:36.836280 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.836265 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 20:34:36.836357 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.836291 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 20:34:36.836357 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.836308 2551 state_mem.go:36] "Initialized new in-memory state store" May 29 20:34:36.841382 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.841369 2551 policy_none.go:49] "None policy: Start" May 29 20:34:36.841445 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.841385 2551 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 20:34:36.841445 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.841395 2551 state_mem.go:35] "Initializing new in-memory state store" May 29 20:34:36.876425 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.876402 2551 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-100.ec2.internal" not found May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.886837 2551 manager.go:341] "Starting Device Plugin manager" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:36.886866 2551 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.886878 2551 server.go:85] "Starting device plugin registration server" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.887130 2551 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.887142 2551 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.887239 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.887326 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.887336 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:36.887916 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 20:34:36.919386 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:36.887956 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-100.ec2.internal\" not found" May 29 20:34:36.958460 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.958430 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 20:34:36.959586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.959563 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 20:34:36.959586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.959583 2551 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 20:34:36.959709 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.959608 2551 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 20:34:36.959709 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.959616 2551 kubelet.go:2451] "Starting kubelet main sync loop" May 29 20:34:36.959709 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:36.959653 2551 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 20:34:36.963737 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.963719 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 20:34:36.988147 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.988115 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 20:34:36.989008 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.988992 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-100.ec2.internal" event="NodeHasSufficientMemory" May 29 20:34:36.989080 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.989022 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-100.ec2.internal" event="NodeHasNoDiskPressure" May 29 20:34:36.989080 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.989035 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-100.ec2.internal" event="NodeHasSufficientPID" May 29 20:34:36.989080 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.989064 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-100.ec2.internal" May 29 20:34:36.998079 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:36.998063 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-100.ec2.internal" May 29 20:34:37.060487 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.060401 2551 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal"] May 29 20:34:37.062812 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.062795 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" May 29 20:34:37.062911 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.062798 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.093169 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.093149 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" May 29 20:34:37.097502 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.097488 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.104850 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.104836 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 20:34:37.107690 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.107677 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 20:34:37.119949 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.119929 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f37e71e36820ca3369fb4fdbd82936b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal\" (UID: \"f37e71e36820ca3369fb4fdbd82936b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.120016 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.119964 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f37e71e36820ca3369fb4fdbd82936b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal\" (UID: \"f37e71e36820ca3369fb4fdbd82936b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.120016 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.120009 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01d3640ada4dbd31bc20de996727f289-config\") pod \"kube-apiserver-proxy-ip-10-0-138-100.ec2.internal\" (UID: \"01d3640ada4dbd31bc20de996727f289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" May 29 20:34:37.220186 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.220139 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f37e71e36820ca3369fb4fdbd82936b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal\" (UID: \"f37e71e36820ca3369fb4fdbd82936b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.220186 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.220187 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f37e71e36820ca3369fb4fdbd82936b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal\" (UID: \"f37e71e36820ca3369fb4fdbd82936b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.220396 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.220205 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01d3640ada4dbd31bc20de996727f289-config\") pod \"kube-apiserver-proxy-ip-10-0-138-100.ec2.internal\" (UID: \"01d3640ada4dbd31bc20de996727f289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" May 29 20:34:37.220396 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.220256 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f37e71e36820ca3369fb4fdbd82936b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal\" (UID: \"f37e71e36820ca3369fb4fdbd82936b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.220396 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.220257 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f37e71e36820ca3369fb4fdbd82936b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal\" (UID: \"f37e71e36820ca3369fb4fdbd82936b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.220396 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.220264 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01d3640ada4dbd31bc20de996727f289-config\") pod \"kube-apiserver-proxy-ip-10-0-138-100.ec2.internal\" (UID: \"01d3640ada4dbd31bc20de996727f289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" May 29 20:34:37.409710 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.409679 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" May 29 20:34:37.410741 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.410720 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" May 29 20:34:37.671559 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.671460 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 20:34:37.672066 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.671650 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 20:34:37.672066 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.671662 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 20:34:37.672066 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.671705 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 20:34:37.772681 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.772645 2551 apiserver.go:52] "Watching apiserver" May 29 20:34:37.774764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.774732 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 20:29:36 +0000 UTC" deadline="2027-12-07 17:35:35.757434953 +0000 UTC" May 29 20:34:37.774840 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.774764 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13365h0m57.982673787s" May 29 20:34:37.779349 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.779327 2551 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 20:34:37.780499 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.780480 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-l85tw","openshift-multus/multus-9c275","openshift-multus/multus-additional-cni-plugins-7tczx","openshift-network-diagnostics/network-check-target-pd62t","openshift-ovn-kubernetes/ovnkube-node-xdc94","kube-system/konnectivity-agent-5jfcl","kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal","openshift-image-registry/node-ca-nnhvx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal","openshift-multus/network-metrics-daemon-2lh64","openshift-network-operator/iptables-alerter-2t5dr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg","openshift-cluster-node-tuning-operator/tuned-4hnf5"] May 29 20:34:37.783268 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.783251 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.785992 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.785965 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 20:34:37.786170 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.785965 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 20:34:37.786170 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.785971 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f6sff\"" May 29 20:34:37.786359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.786344 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9c275" May 29 20:34:37.786455 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.786440 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.788152 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788135 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:37.788251 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:37.788189 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:37.788469 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788442 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 20:34:37.788592 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788571 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 20:34:37.788690 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788589 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 20:34:37.788690 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788605 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 20:34:37.788856 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788799 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 20:34:37.788856 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788833 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 20:34:37.788957 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788833 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-42cdl\"" May 29 20:34:37.788957 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.788804 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tr4mh\"" May 29 20:34:37.789497 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.789482 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.790606 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.790589 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5jfcl" May 29 20:34:37.791393 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.791371 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 20:34:37.791549 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.791537 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 20:34:37.791933 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.791918 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.791985 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.791972 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 20:34:37.792041 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.792022 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 20:34:37.792041 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.792026 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 20:34:37.792186 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.792169 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 20:34:37.792275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.792265 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2jjl2\"" May 29 20:34:37.792851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.792838 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-smcgv\"" May 29 20:34:37.792907 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.792858 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 20:34:37.793083 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.793067 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:37.793143 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.793074 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 20:34:37.793143 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:37.793127 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:37.794193 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.794179 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5kgrm\"" May 29 20:34:37.794367 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.794354 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 20:34:37.794508 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.794494 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 20:34:37.794595 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.794585 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.794651 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.794634 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 20:34:37.795831 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.795816 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.797407 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.797392 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 20:34:37.797586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.797573 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 20:34:37.797643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.797578 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 20:34:37.797643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.797577 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.798045 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.798031 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 20:34:37.798110 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.798098 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 20:34:37.798154 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.798108 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-slw6t\"" May 29 20:34:37.798588 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.798563 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 20:34:37.798643 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.798563 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q7xxg\"" May 29 20:34:37.799719 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.799700 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 20:34:37.799878 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.799795 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 20:34:37.799878 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.799821 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bprkv\"" May 29 20:34:37.817650 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.817629 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 20:34:37.820454 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.820428 2551 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 20:34:37.823462 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823442 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-ovn\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.823566 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823469 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysctl-d\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.823566 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823486 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-lib-modules\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.823566 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823511 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be09a3ab-0870-4d32-9031-b969a978b0fb-tmp\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.823566 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823550 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/474a0bc1-0455-4d61-8c50-7288545cdd8d-konnectivity-ca\") pod \"konnectivity-agent-5jfcl\" (UID: \"474a0bc1-0455-4d61-8c50-7288545cdd8d\") " pod="kube-system/konnectivity-agent-5jfcl" May 29 20:34:37.823754 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823576 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-socket-dir-parent\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.823754 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823593 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-conf-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.823754 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823609 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-system-cni-dir\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.823754 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823651 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovnkube-script-lib\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.823754 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823691 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xwf\" (UniqueName: \"kubernetes.io/projected/c9c8631f-eea5-4184-aa19-e53c413b83a0-kube-api-access-s9xwf\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.823754 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823724 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d472j\" (UniqueName: \"kubernetes.io/projected/776c8f3d-8ded-4fb6-982a-36fed858beb3-kube-api-access-d472j\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823766 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-cni-bin\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823789 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823810 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stvv\" (UniqueName: \"kubernetes.io/projected/d4abbd14-0a52-432e-b13b-a727b13d0af7-kube-api-access-8stvv\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823835 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-var-lib-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823855 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovn-node-metrics-cert\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823871 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-sys-fs\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823885 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-system-cni-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823917 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-systemd\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823936 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-log-socket\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823950 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-cni-bin\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823971 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovnkube-config\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.823987 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mqc7\" (UniqueName: \"kubernetes.io/projected/0c41df73-e24e-4b29-8408-e96237e180de-kube-api-access-2mqc7\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824001 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-k8s-cni-cncf-io\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.824009 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824015 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-etc-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824036 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w5dk\" (UniqueName: \"kubernetes.io/projected/be09a3ab-0870-4d32-9031-b969a978b0fb-kube-api-access-6w5dk\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824058 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9c8631f-eea5-4184-aa19-e53c413b83a0-host\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824086 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbfrf\" (UniqueName: \"kubernetes.io/projected/442072e3-d69d-41f9-aa51-be411b2779d8-kube-api-access-xbfrf\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824110 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-multus-certs\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824126 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824145 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysconfig\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824159 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824177 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-hostroot\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824191 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-slash\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824207 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-cni-netd\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824223 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824239 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-systemd\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824257 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2556e896-125e-4055-8b95-a7b4fad103dd-multus-daemon-config\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824271 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824285 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-node-log\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.824689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824306 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rr9t\" (UniqueName: \"kubernetes.io/projected/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-kube-api-access-7rr9t\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824327 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/474a0bc1-0455-4d61-8c50-7288545cdd8d-agent-certs\") pod \"konnectivity-agent-5jfcl\" (UID: \"474a0bc1-0455-4d61-8c50-7288545cdd8d\") " pod="kube-system/konnectivity-agent-5jfcl" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824346 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-host\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824360 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-os-release\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824374 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-kubelet\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824389 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-kubelet\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824418 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-modprobe-d\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824431 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-sys\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824446 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-socket-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824474 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4dwc\" (UniqueName: \"kubernetes.io/projected/11455435-1da2-422c-9650-ad2f07363c63-kube-api-access-z4dwc\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824493 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442072e3-d69d-41f9-aa51-be411b2779d8-tmp-dir\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824507 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-netns\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824549 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-env-overrides\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824573 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysctl-conf\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824595 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824630 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-cnibin\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824649 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-cni-multus\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.825428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824663 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-run-netns\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824677 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-run\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824692 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824717 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-etc-kubernetes\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824739 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-kubernetes\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824754 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbvm\" (UniqueName: \"kubernetes.io/projected/2556e896-125e-4055-8b95-a7b4fad103dd-kube-api-access-9cbvm\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824767 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-run-ovn-kubernetes\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824788 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-var-lib-kubelet\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824806 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/776c8f3d-8ded-4fb6-982a-36fed858beb3-host-slash\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824820 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-registration-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824834 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-cni-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824860 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2556e896-125e-4055-8b95-a7b4fad103dd-cni-binary-copy\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824880 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-cnibin\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824894 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-os-release\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824907 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-tuned\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824924 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:37.826198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824960 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/776c8f3d-8ded-4fb6-982a-36fed858beb3-iptables-alerter-script\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.826947 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824980 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-device-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.826947 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.824997 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/442072e3-d69d-41f9-aa51-be411b2779d8-hosts-file\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.826947 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.825011 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-systemd-units\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.826947 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.825025 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9c8631f-eea5-4184-aa19-e53c413b83a0-serviceca\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.826947 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.825039 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.826947 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.825052 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.836724 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.836705 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 20:34:37.858275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.858251 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmqpz" May 29 20:34:37.865925 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.865907 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmqpz" May 29 20:34:37.912709 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:37.912673 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d3640ada4dbd31bc20de996727f289.slice/crio-e606b990506beee758667075824b42471602cf5202efd5c812d89138281586f2 WatchSource:0}: Error finding container e606b990506beee758667075824b42471602cf5202efd5c812d89138281586f2: Status 404 returned error can't find the container with id e606b990506beee758667075824b42471602cf5202efd5c812d89138281586f2 May 29 20:34:37.912954 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:37.912932 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37e71e36820ca3369fb4fdbd82936b8.slice/crio-415f2602f8744c6048d6b2eee040bc6a4473057907fb9d9a3a677e9fbe94aa98 WatchSource:0}: Error finding container 415f2602f8744c6048d6b2eee040bc6a4473057907fb9d9a3a677e9fbe94aa98: Status 404 returned error can't find the container with id 415f2602f8744c6048d6b2eee040bc6a4473057907fb9d9a3a677e9fbe94aa98 May 29 20:34:37.916606 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.916591 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 20:34:37.925746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925703 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-os-release\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.925746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925729 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-tuned\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.925746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925745 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925761 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/776c8f3d-8ded-4fb6-982a-36fed858beb3-iptables-alerter-script\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925777 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-device-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925792 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/442072e3-d69d-41f9-aa51-be411b2779d8-hosts-file\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925814 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-systemd-units\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925835 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-os-release\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925855 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-device-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925837 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9c8631f-eea5-4184-aa19-e53c413b83a0-serviceca\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925893 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-systemd-units\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.925919 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925902 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925927 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925950 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-ovn\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.925973 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysctl-d\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926019 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-lib-modules\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926032 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926042 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be09a3ab-0870-4d32-9031-b969a978b0fb-tmp\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926095 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/474a0bc1-0455-4d61-8c50-7288545cdd8d-konnectivity-ca\") pod \"konnectivity-agent-5jfcl\" (UID: \"474a0bc1-0455-4d61-8c50-7288545cdd8d\") " pod="kube-system/konnectivity-agent-5jfcl" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926102 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926125 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-socket-dir-parent\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926154 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-conf-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926178 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-system-cni-dir\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926205 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovnkube-script-lib\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926231 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xwf\" (UniqueName: \"kubernetes.io/projected/c9c8631f-eea5-4184-aa19-e53c413b83a0-kube-api-access-s9xwf\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926256 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d472j\" (UniqueName: \"kubernetes.io/projected/776c8f3d-8ded-4fb6-982a-36fed858beb3-kube-api-access-d472j\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926280 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-cni-bin\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926305 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926322 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9c8631f-eea5-4184-aa19-e53c413b83a0-serviceca\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.926352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926332 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8stvv\" (UniqueName: \"kubernetes.io/projected/d4abbd14-0a52-432e-b13b-a727b13d0af7-kube-api-access-8stvv\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926394 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-var-lib-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926416 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/776c8f3d-8ded-4fb6-982a-36fed858beb3-iptables-alerter-script\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926426 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovn-node-metrics-cert\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926455 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-sys-fs\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926478 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-ovn\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926486 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-system-cni-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926538 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-systemd\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926571 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-log-socket\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926568 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926538 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/442072e3-d69d-41f9-aa51-be411b2779d8-hosts-file\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926637 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-system-cni-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926659 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-run-systemd\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926675 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-log-socket\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926661 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-lib-modules\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926728 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-cni-bin\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926754 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-var-lib-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926757 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovnkube-config\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.927187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926740 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-socket-dir-parent\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926812 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mqc7\" (UniqueName: \"kubernetes.io/projected/0c41df73-e24e-4b29-8408-e96237e180de-kube-api-access-2mqc7\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926863 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-k8s-cni-cncf-io\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926889 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-etc-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926905 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-cni-bin\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.926967 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovnkube-script-lib\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927002 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5dk\" (UniqueName: \"kubernetes.io/projected/be09a3ab-0870-4d32-9031-b969a978b0fb-kube-api-access-6w5dk\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927029 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9c8631f-eea5-4184-aa19-e53c413b83a0-host\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927034 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-conf-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927053 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbfrf\" (UniqueName: \"kubernetes.io/projected/442072e3-d69d-41f9-aa51-be411b2779d8-kube-api-access-xbfrf\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927100 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-multus-certs\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927141 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-multus-certs\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927201 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-system-cni-dir\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927208 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovnkube-config\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927279 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-cni-bin\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927321 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-etc-openvswitch\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927361 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-k8s-cni-cncf-io\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927383 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.928746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927572 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9c8631f-eea5-4184-aa19-e53c413b83a0-host\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927595 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927637 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysconfig\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927662 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927667 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysctl-d\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927684 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-hostroot\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927707 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-slash\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927728 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-sys-fs\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927753 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysconfig\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927755 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-cni-netd\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927783 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-hostroot\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927805 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-cni-netd\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927812 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927843 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-systemd\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927868 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2556e896-125e-4055-8b95-a7b4fad103dd-multus-daemon-config\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927883 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927921 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.929485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927923 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/474a0bc1-0455-4d61-8c50-7288545cdd8d-konnectivity-ca\") pod \"konnectivity-agent-5jfcl\" (UID: \"474a0bc1-0455-4d61-8c50-7288545cdd8d\") " pod="kube-system/konnectivity-agent-5jfcl" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927926 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.927939 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-slash\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928003 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-systemd\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928034 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-node-log\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928042 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928063 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rr9t\" (UniqueName: \"kubernetes.io/projected/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-kube-api-access-7rr9t\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928088 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/474a0bc1-0455-4d61-8c50-7288545cdd8d-agent-certs\") pod \"konnectivity-agent-5jfcl\" (UID: \"474a0bc1-0455-4d61-8c50-7288545cdd8d\") " pod="kube-system/konnectivity-agent-5jfcl" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928113 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-host\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928125 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4abbd14-0a52-432e-b13b-a727b13d0af7-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928088 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-node-log\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928135 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-os-release\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928175 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-kubelet\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928235 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-os-release\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928202 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-kubelet\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.928979 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2556e896-125e-4055-8b95-a7b4fad103dd-multus-daemon-config\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929000 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-modprobe-d\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929046 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-sys\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.930277 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929081 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-socket-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929096 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-host\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929141 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-kubelet\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929153 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-sys\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929185 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-kubelet\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929235 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-modprobe-d\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929279 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4dwc\" (UniqueName: \"kubernetes.io/projected/11455435-1da2-422c-9650-ad2f07363c63-kube-api-access-z4dwc\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929292 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-socket-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929403 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442072e3-d69d-41f9-aa51-be411b2779d8-tmp-dir\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929439 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-netns\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929465 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-env-overrides\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929496 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysctl-conf\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929578 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929565 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be09a3ab-0870-4d32-9031-b969a978b0fb-tmp\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929612 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-cnibin\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929649 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-cni-multus\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929680 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-run-netns\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929697 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442072e3-d69d-41f9-aa51-be411b2779d8-tmp-dir\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.931085 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929705 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-run\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929734 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929766 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-etc-kubernetes\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929770 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-cnibin\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929783 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-sysctl-conf\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929802 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-kubernetes\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929840 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbvm\" (UniqueName: \"kubernetes.io/projected/2556e896-125e-4055-8b95-a7b4fad103dd-kube-api-access-9cbvm\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929846 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929868 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-run-ovn-kubernetes\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929883 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-run-netns\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929935 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-var-lib-kubelet\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.929947 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-etc-kubernetes\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930020 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-host-var-lib-cni-multus\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930054 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-run\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:37.930085 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930112 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-kubernetes\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:37.930149 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs podName:0c41df73-e24e-4b29-8408-e96237e180de nodeName:}" failed. No retries permitted until 2026-05-29 20:34:38.430121424 +0000 UTC m=+2.302758597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs") pod "network-metrics-daemon-2lh64" (UID: "0c41df73-e24e-4b29-8408-e96237e180de") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:37.931851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930164 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be09a3ab-0870-4d32-9031-b969a978b0fb-var-lib-kubelet\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930212 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/776c8f3d-8ded-4fb6-982a-36fed858beb3-host-slash\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930187 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-run-netns\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930246 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-registration-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930271 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-cni-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930272 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-host-run-ovn-kubernetes\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930349 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2556e896-125e-4055-8b95-a7b4fad103dd-cni-binary-copy\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930339 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/776c8f3d-8ded-4fb6-982a-36fed858beb3-host-slash\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930376 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-ovn-node-metrics-cert\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930423 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11455435-1da2-422c-9650-ad2f07363c63-registration-dir\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930431 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2556e896-125e-4055-8b95-a7b4fad103dd-multus-cni-dir\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930781 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-env-overrides\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930845 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-cnibin\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930924 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4abbd14-0a52-432e-b13b-a727b13d0af7-cnibin\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.930979 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2556e896-125e-4055-8b95-a7b4fad103dd-cni-binary-copy\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:37.932254 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:37.932274 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 20:34:37.932684 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:37.932288 2551 projected.go:194] Error preparing data for projected volume kube-api-access-jgbd7 for pod openshift-network-diagnostics/network-check-target-pd62t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:37.933394 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:37.932358 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7 podName:91afabc6-d251-4003-9185-00a9f362a82b nodeName:}" failed. No retries permitted until 2026-05-29 20:34:38.432339314 +0000 UTC m=+2.304976490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jgbd7" (UniqueName: "kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7") pod "network-check-target-pd62t" (UID: "91afabc6-d251-4003-9185-00a9f362a82b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:37.933861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.933839 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be09a3ab-0870-4d32-9031-b969a978b0fb-etc-tuned\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.934890 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.934872 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stvv\" (UniqueName: \"kubernetes.io/projected/d4abbd14-0a52-432e-b13b-a727b13d0af7-kube-api-access-8stvv\") pod \"multus-additional-cni-plugins-7tczx\" (UID: \"d4abbd14-0a52-432e-b13b-a727b13d0af7\") " pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:37.935006 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.934990 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/474a0bc1-0455-4d61-8c50-7288545cdd8d-agent-certs\") pod \"konnectivity-agent-5jfcl\" (UID: \"474a0bc1-0455-4d61-8c50-7288545cdd8d\") " pod="kube-system/konnectivity-agent-5jfcl" May 29 20:34:37.935082 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.935067 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xwf\" (UniqueName: \"kubernetes.io/projected/c9c8631f-eea5-4184-aa19-e53c413b83a0-kube-api-access-s9xwf\") pod \"node-ca-nnhvx\" (UID: \"c9c8631f-eea5-4184-aa19-e53c413b83a0\") " pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:37.947076 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.947052 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d472j\" (UniqueName: \"kubernetes.io/projected/776c8f3d-8ded-4fb6-982a-36fed858beb3-kube-api-access-d472j\") pod \"iptables-alerter-2t5dr\" (UID: \"776c8f3d-8ded-4fb6-982a-36fed858beb3\") " pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:37.947232 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.947208 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w5dk\" (UniqueName: \"kubernetes.io/projected/be09a3ab-0870-4d32-9031-b969a978b0fb-kube-api-access-6w5dk\") pod \"tuned-4hnf5\" (UID: \"be09a3ab-0870-4d32-9031-b969a978b0fb\") " pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:37.947604 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.947564 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mqc7\" (UniqueName: \"kubernetes.io/projected/0c41df73-e24e-4b29-8408-e96237e180de-kube-api-access-2mqc7\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:37.947861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.947842 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rr9t\" (UniqueName: \"kubernetes.io/projected/e22f5f5a-58aa-4bb0-9384-9e15d81c74de-kube-api-access-7rr9t\") pod \"ovnkube-node-xdc94\" (UID: \"e22f5f5a-58aa-4bb0-9384-9e15d81c74de\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:37.947897 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.947865 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbvm\" (UniqueName: \"kubernetes.io/projected/2556e896-125e-4055-8b95-a7b4fad103dd-kube-api-access-9cbvm\") pod \"multus-9c275\" (UID: \"2556e896-125e-4055-8b95-a7b4fad103dd\") " pod="openshift-multus/multus-9c275" May 29 20:34:37.948324 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.948305 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbfrf\" (UniqueName: \"kubernetes.io/projected/442072e3-d69d-41f9-aa51-be411b2779d8-kube-api-access-xbfrf\") pod \"node-resolver-l85tw\" (UID: \"442072e3-d69d-41f9-aa51-be411b2779d8\") " pod="openshift-dns/node-resolver-l85tw" May 29 20:34:37.948324 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.948318 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4dwc\" (UniqueName: \"kubernetes.io/projected/11455435-1da2-422c-9650-ad2f07363c63-kube-api-access-z4dwc\") pod \"aws-ebs-csi-driver-node-8kggg\" (UID: \"11455435-1da2-422c-9650-ad2f07363c63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:37.962466 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.962420 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" event={"ID":"f37e71e36820ca3369fb4fdbd82936b8","Type":"ContainerStarted","Data":"415f2602f8744c6048d6b2eee040bc6a4473057907fb9d9a3a677e9fbe94aa98"} May 29 20:34:37.963344 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:37.963323 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" event={"ID":"01d3640ada4dbd31bc20de996727f289","Type":"ContainerStarted","Data":"e606b990506beee758667075824b42471602cf5202efd5c812d89138281586f2"} May 29 20:34:38.120093 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.120064 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l85tw" May 29 20:34:38.127201 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.127175 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442072e3_d69d_41f9_aa51_be411b2779d8.slice/crio-695e2146ab2cfa8c66a42d8165e925e452b896505b55ddaf33e7e976e5f777e3 WatchSource:0}: Error finding container 695e2146ab2cfa8c66a42d8165e925e452b896505b55ddaf33e7e976e5f777e3: Status 404 returned error can't find the container with id 695e2146ab2cfa8c66a42d8165e925e452b896505b55ddaf33e7e976e5f777e3 May 29 20:34:38.134801 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.134785 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9c275" May 29 20:34:38.140481 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.140460 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2556e896_125e_4055_8b95_a7b4fad103dd.slice/crio-f40ca4ad14cf3000d7c2789024dc36ec59c9460a68ffe34d4f58652c88fb4312 WatchSource:0}: Error finding container f40ca4ad14cf3000d7c2789024dc36ec59c9460a68ffe34d4f58652c88fb4312: Status 404 returned error can't find the container with id f40ca4ad14cf3000d7c2789024dc36ec59c9460a68ffe34d4f58652c88fb4312 May 29 20:34:38.152388 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.152371 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tczx" May 29 20:34:38.158218 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.158194 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4abbd14_0a52_432e_b13b_a727b13d0af7.slice/crio-862007fbfd2098ca7d57162a629422953afd9d9e7baa7210eec3e47ebef0b8be WatchSource:0}: Error finding container 862007fbfd2098ca7d57162a629422953afd9d9e7baa7210eec3e47ebef0b8be: Status 404 returned error can't find the container with id 862007fbfd2098ca7d57162a629422953afd9d9e7baa7210eec3e47ebef0b8be May 29 20:34:38.166708 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.166691 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:34:38.171833 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.171818 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5jfcl" May 29 20:34:38.173781 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.173640 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22f5f5a_58aa_4bb0_9384_9e15d81c74de.slice/crio-ed8c494b2a7012caf3a9c889bc741f62ce1ad2dd4a623fec8c0046b373de9230 WatchSource:0}: Error finding container ed8c494b2a7012caf3a9c889bc741f62ce1ad2dd4a623fec8c0046b373de9230: Status 404 returned error can't find the container with id ed8c494b2a7012caf3a9c889bc741f62ce1ad2dd4a623fec8c0046b373de9230 May 29 20:34:38.179551 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.179512 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474a0bc1_0455_4d61_8c50_7288545cdd8d.slice/crio-ce92915f8bca56da07283ef7a8784847908e0c6829e247635d6b851af293ef66 WatchSource:0}: Error finding container ce92915f8bca56da07283ef7a8784847908e0c6829e247635d6b851af293ef66: Status 404 returned error can't find the container with id ce92915f8bca56da07283ef7a8784847908e0c6829e247635d6b851af293ef66 May 29 20:34:38.191764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.191740 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nnhvx" May 29 20:34:38.197603 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.197580 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c8631f_eea5_4184_aa19_e53c413b83a0.slice/crio-281a5e4498f5bdc0351fc60d406b14b9b0d136c1df8db22cf10116410ae2a1c0 WatchSource:0}: Error finding container 281a5e4498f5bdc0351fc60d406b14b9b0d136c1df8db22cf10116410ae2a1c0: Status 404 returned error can't find the container with id 281a5e4498f5bdc0351fc60d406b14b9b0d136c1df8db22cf10116410ae2a1c0 May 29 20:34:38.207322 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.207308 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2t5dr" May 29 20:34:38.212834 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.212808 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776c8f3d_8ded_4fb6_982a_36fed858beb3.slice/crio-f2b3f70a581c58db13a8b8f392a4aaf87154f0d07f7787120238309d06cd3724 WatchSource:0}: Error finding container f2b3f70a581c58db13a8b8f392a4aaf87154f0d07f7787120238309d06cd3724: Status 404 returned error can't find the container with id f2b3f70a581c58db13a8b8f392a4aaf87154f0d07f7787120238309d06cd3724 May 29 20:34:38.216716 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.216696 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" May 29 20:34:38.221212 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.221197 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" May 29 20:34:38.222106 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.222085 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11455435_1da2_422c_9650_ad2f07363c63.slice/crio-3485fb9b7f5248dee64b6b1236c62330d194e15fa5dd14a6caa981ee56628d06 WatchSource:0}: Error finding container 3485fb9b7f5248dee64b6b1236c62330d194e15fa5dd14a6caa981ee56628d06: Status 404 returned error can't find the container with id 3485fb9b7f5248dee64b6b1236c62330d194e15fa5dd14a6caa981ee56628d06 May 29 20:34:38.226728 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:34:38.226706 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe09a3ab_0870_4d32_9031_b969a978b0fb.slice/crio-ac1d64e61d081db04d9c20d847aad3ed138ef52b6dbdfb8baf8b8c432ee948c2 WatchSource:0}: Error finding container ac1d64e61d081db04d9c20d847aad3ed138ef52b6dbdfb8baf8b8c432ee948c2: Status 404 returned error can't find the container with id ac1d64e61d081db04d9c20d847aad3ed138ef52b6dbdfb8baf8b8c432ee948c2 May 29 20:34:38.433726 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.433634 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:38.433726 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.433689 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:38.433944 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:38.433902 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 20:34:38.433944 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:38.433924 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 20:34:38.433944 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:38.433937 2551 projected.go:194] Error preparing data for projected volume kube-api-access-jgbd7 for pod openshift-network-diagnostics/network-check-target-pd62t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:38.433944 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:38.433939 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:38.434157 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:38.434002 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs podName:0c41df73-e24e-4b29-8408-e96237e180de nodeName:}" failed. No retries permitted until 2026-05-29 20:34:39.433982247 +0000 UTC m=+3.306619415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs") pod "network-metrics-daemon-2lh64" (UID: "0c41df73-e24e-4b29-8408-e96237e180de") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:38.434157 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:38.434020 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7 podName:91afabc6-d251-4003-9185-00a9f362a82b nodeName:}" failed. No retries permitted until 2026-05-29 20:34:39.434011841 +0000 UTC m=+3.306649001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgbd7" (UniqueName: "kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7") pod "network-check-target-pd62t" (UID: "91afabc6-d251-4003-9185-00a9f362a82b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:38.586005 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.583505 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 20:34:38.728568 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.728468 2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 20:34:38.866870 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.866800 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 20:29:37 +0000 UTC" deadline="2027-12-05 16:17:47.759274963 +0000 UTC" May 29 20:34:38.866870 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.866839 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13315h43m8.892439076s" May 29 20:34:38.962938 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.962908 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:38.963098 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:38.963030 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:38.984469 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.984388 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerStarted","Data":"862007fbfd2098ca7d57162a629422953afd9d9e7baa7210eec3e47ebef0b8be"} May 29 20:34:38.990405 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.990370 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9c275" event={"ID":"2556e896-125e-4055-8b95-a7b4fad103dd","Type":"ContainerStarted","Data":"f40ca4ad14cf3000d7c2789024dc36ec59c9460a68ffe34d4f58652c88fb4312"} May 29 20:34:38.999546 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:38.999501 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l85tw" event={"ID":"442072e3-d69d-41f9-aa51-be411b2779d8","Type":"ContainerStarted","Data":"695e2146ab2cfa8c66a42d8165e925e452b896505b55ddaf33e7e976e5f777e3"} May 29 20:34:39.009359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.009329 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" event={"ID":"11455435-1da2-422c-9650-ad2f07363c63","Type":"ContainerStarted","Data":"3485fb9b7f5248dee64b6b1236c62330d194e15fa5dd14a6caa981ee56628d06"} May 29 20:34:39.018552 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.018473 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nnhvx" event={"ID":"c9c8631f-eea5-4184-aa19-e53c413b83a0","Type":"ContainerStarted","Data":"281a5e4498f5bdc0351fc60d406b14b9b0d136c1df8db22cf10116410ae2a1c0"} May 29 20:34:39.027861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.027734 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" event={"ID":"be09a3ab-0870-4d32-9031-b969a978b0fb","Type":"ContainerStarted","Data":"ac1d64e61d081db04d9c20d847aad3ed138ef52b6dbdfb8baf8b8c432ee948c2"} May 29 20:34:39.033362 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.033331 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2t5dr" event={"ID":"776c8f3d-8ded-4fb6-982a-36fed858beb3","Type":"ContainerStarted","Data":"f2b3f70a581c58db13a8b8f392a4aaf87154f0d07f7787120238309d06cd3724"} May 29 20:34:39.057059 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.057012 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5jfcl" event={"ID":"474a0bc1-0455-4d61-8c50-7288545cdd8d","Type":"ContainerStarted","Data":"ce92915f8bca56da07283ef7a8784847908e0c6829e247635d6b851af293ef66"} May 29 20:34:39.065255 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.065191 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"ed8c494b2a7012caf3a9c889bc741f62ce1ad2dd4a623fec8c0046b373de9230"} May 29 20:34:39.122221 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.122190 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 20:34:39.442497 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.442463 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:39.442700 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.442531 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:39.442765 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:39.442744 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 20:34:39.442765 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:39.442763 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 20:34:39.442865 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:39.442777 2551 projected.go:194] Error preparing data for projected volume kube-api-access-jgbd7 for pod openshift-network-diagnostics/network-check-target-pd62t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:39.442865 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:39.442836 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7 podName:91afabc6-d251-4003-9185-00a9f362a82b nodeName:}" failed. No retries permitted until 2026-05-29 20:34:41.442817614 +0000 UTC m=+5.315454780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgbd7" (UniqueName: "kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7") pod "network-check-target-pd62t" (UID: "91afabc6-d251-4003-9185-00a9f362a82b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:39.443280 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:39.443231 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:39.443363 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:39.443318 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs podName:0c41df73-e24e-4b29-8408-e96237e180de nodeName:}" failed. No retries permitted until 2026-05-29 20:34:41.443302699 +0000 UTC m=+5.315939861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs") pod "network-metrics-daemon-2lh64" (UID: "0c41df73-e24e-4b29-8408-e96237e180de") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:39.867268 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.867178 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 20:29:37 +0000 UTC" deadline="2028-02-26 04:02:27.33515089 +0000 UTC" May 29 20:34:39.867268 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.867218 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15295h27m47.467936358s" May 29 20:34:39.960192 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:39.960163 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:39.960381 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:39.960318 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:40.962566 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:40.962502 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:40.963005 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:40.962640 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:41.458652 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:41.458589 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:41.458842 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:41.458738 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:41.458842 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:41.458743 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:41.458842 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:41.458816 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs podName:0c41df73-e24e-4b29-8408-e96237e180de nodeName:}" failed. No retries permitted until 2026-05-29 20:34:45.458795271 +0000 UTC m=+9.331432433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs") pod "network-metrics-daemon-2lh64" (UID: "0c41df73-e24e-4b29-8408-e96237e180de") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:41.459010 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:41.458891 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 20:34:41.459010 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:41.458908 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 20:34:41.459010 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:41.458920 2551 projected.go:194] Error preparing data for projected volume kube-api-access-jgbd7 for pod openshift-network-diagnostics/network-check-target-pd62t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:41.459010 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:41.458977 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7 podName:91afabc6-d251-4003-9185-00a9f362a82b nodeName:}" failed. No retries permitted until 2026-05-29 20:34:45.458962559 +0000 UTC m=+9.331599721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgbd7" (UniqueName: "kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7") pod "network-check-target-pd62t" (UID: "91afabc6-d251-4003-9185-00a9f362a82b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:41.960238 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:41.960200 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:41.960422 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:41.960336 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:42.960222 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:42.960190 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:42.960695 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:42.960413 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:43.960263 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:43.960157 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:43.960749 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:43.960309 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:44.961311 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:44.960894 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:44.961311 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:44.961027 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:45.492157 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:45.492107 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:45.492351 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:45.492172 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:45.492351 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:45.492336 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 20:34:45.492466 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:45.492357 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 20:34:45.492466 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:45.492369 2551 projected.go:194] Error preparing data for projected volume kube-api-access-jgbd7 for pod openshift-network-diagnostics/network-check-target-pd62t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:45.492466 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:45.492426 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7 podName:91afabc6-d251-4003-9185-00a9f362a82b nodeName:}" failed. No retries permitted until 2026-05-29 20:34:53.492408238 +0000 UTC m=+17.365045399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgbd7" (UniqueName: "kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7") pod "network-check-target-pd62t" (UID: "91afabc6-d251-4003-9185-00a9f362a82b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:45.492758 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:45.492729 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:45.492875 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:45.492789 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs podName:0c41df73-e24e-4b29-8408-e96237e180de nodeName:}" failed. No retries permitted until 2026-05-29 20:34:53.49277255 +0000 UTC m=+17.365409723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs") pod "network-metrics-daemon-2lh64" (UID: "0c41df73-e24e-4b29-8408-e96237e180de") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:45.959861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:45.959826 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:45.960033 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:45.959966 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:46.961384 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:46.960920 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:46.961384 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:46.961030 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:47.960295 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:47.960267 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:47.960453 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:47.960377 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:48.962878 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:48.960549 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:48.962878 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:48.960707 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:49.959951 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:49.959920 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:49.960128 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:49.960057 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:50.960313 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:50.960275 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:50.960803 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:50.960413 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:51.960079 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:51.960034 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:51.960309 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:51.960168 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:52.960093 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:52.960058 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:52.960488 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:52.960190 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:53.553121 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:53.553083 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:53.553351 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:53.553246 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:53.553351 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:53.553246 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:53.553351 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:53.553321 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs podName:0c41df73-e24e-4b29-8408-e96237e180de nodeName:}" failed. No retries permitted until 2026-05-29 20:35:09.553298001 +0000 UTC m=+33.425935174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs") pod "network-metrics-daemon-2lh64" (UID: "0c41df73-e24e-4b29-8408-e96237e180de") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:34:53.553541 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:53.553352 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 20:34:53.553541 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:53.553377 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 20:34:53.553541 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:53.553390 2551 projected.go:194] Error preparing data for projected volume kube-api-access-jgbd7 for pod openshift-network-diagnostics/network-check-target-pd62t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:53.553541 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:53.553448 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7 podName:91afabc6-d251-4003-9185-00a9f362a82b nodeName:}" failed. No retries permitted until 2026-05-29 20:35:09.553432502 +0000 UTC m=+33.426069666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgbd7" (UniqueName: "kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7") pod "network-check-target-pd62t" (UID: "91afabc6-d251-4003-9185-00a9f362a82b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:34:53.960622 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:53.960585 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:53.961032 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:53.960702 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:54.960459 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:54.960420 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:54.960641 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:54.960569 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:55.960765 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:55.960728 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:55.961213 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:55.960872 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:56.960261 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:56.960238 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:56.960363 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:56.960319 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:57.096392 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.096365 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"268416528ca00e52dd2725c190c4ff51cfbc001d81862b22a9a72c0914109ac8"} May 29 20:34:57.096811 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.096404 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"6f9da5bc67a12ee3b25618449a571f4fa5e4e26c842c98242351fd1aaf6ef13c"} May 29 20:34:57.097686 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.097660 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9c275" event={"ID":"2556e896-125e-4055-8b95-a7b4fad103dd","Type":"ContainerStarted","Data":"0f63383a4ab75d9a7b07343a62ec4314fbc961b253f01223794bb589a1c2ff0c"} May 29 20:34:57.098928 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.098901 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" event={"ID":"01d3640ada4dbd31bc20de996727f289","Type":"ContainerStarted","Data":"ad25e7999547b374b57d527497e042b5bd43b7b3663896f5f6cf1d48c3e0d6e6"} May 29 20:34:57.100068 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.100049 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" event={"ID":"be09a3ab-0870-4d32-9031-b969a978b0fb","Type":"ContainerStarted","Data":"c3ef7ed3fc8103bfd4a57fbb05c82faa7c992e215ecde3b929a4014897c4342d"} May 29 20:34:57.143745 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.143705 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-9c275" podStartSLOduration=1.671932183 podStartE2EDuration="20.14369126s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.141969953 +0000 UTC m=+2.014607113" lastFinishedPulling="2026-05-29 20:34:56.613729027 +0000 UTC m=+20.486366190" observedRunningTime="2026-05-29 20:34:57.128921236 +0000 UTC m=+21.001558436" watchObservedRunningTime="2026-05-29 20:34:57.14369126 +0000 UTC m=+21.016328442" May 29 20:34:57.144036 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.144017 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-100.ec2.internal" podStartSLOduration=20.144011031 podStartE2EDuration="20.144011031s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:34:57.143408062 +0000 UTC m=+21.016045244" watchObservedRunningTime="2026-05-29 20:34:57.144011031 +0000 UTC m=+21.016648213" May 29 20:34:57.166300 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.166257 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4hnf5" podStartSLOduration=1.8147872870000001 podStartE2EDuration="20.166243329s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.228099495 +0000 UTC m=+2.100736658" lastFinishedPulling="2026-05-29 20:34:56.579555534 +0000 UTC m=+20.452192700" observedRunningTime="2026-05-29 20:34:57.165959051 +0000 UTC m=+21.038596230" watchObservedRunningTime="2026-05-29 20:34:57.166243329 +0000 UTC m=+21.038880511" May 29 20:34:57.960377 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:57.960211 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:57.960549 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:57.960458 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:34:58.106450 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.106413 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2t5dr" event={"ID":"776c8f3d-8ded-4fb6-982a-36fed858beb3","Type":"ContainerStarted","Data":"2b44d50488a470f2a5acf895d6f6b10a718ad76f2f01e87b1d1321705e27ea24"} May 29 20:34:58.109106 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.109089 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-acl-logging/0.log" May 29 20:34:58.109390 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.109370 2551 generic.go:358] "Generic (PLEG): container finished" podID="e22f5f5a-58aa-4bb0-9384-9e15d81c74de" containerID="268416528ca00e52dd2725c190c4ff51cfbc001d81862b22a9a72c0914109ac8" exitCode=1 May 29 20:34:58.109473 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.109450 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerDied","Data":"268416528ca00e52dd2725c190c4ff51cfbc001d81862b22a9a72c0914109ac8"} May 29 20:34:58.109516 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.109480 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"6a06b44226f32653e961b1c479b4d0149b35eb6e578dd5ff201b106adffe8d27"} May 29 20:34:58.109516 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.109494 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"449c0cfa7e93c273e1a24d8a0c679f63a9f2b978921e3a89f21bf1f9f54aae0e"} May 29 20:34:58.109516 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.109507 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"f19647800d02cb0576a9677082748ba989c327ac9c967ff93d7df6b7f29283f7"} May 29 20:34:58.109640 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.109537 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"d27af472d679942f27c0aa465d87261a1bfdb53c6348a5f0a228e3a6873ca7cc"} May 29 20:34:58.960603 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:58.960380 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:34:58.960831 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:58.960702 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:34:59.111957 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.111920 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l85tw" event={"ID":"442072e3-d69d-41f9-aa51-be411b2779d8","Type":"ContainerStarted","Data":"ff2ec5b76f0a7d18982b993824b93c787bfd367901d46454dcbc9a3b526c4b1e"} May 29 20:34:59.113170 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.113150 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" event={"ID":"11455435-1da2-422c-9650-ad2f07363c63","Type":"ContainerStarted","Data":"4a3bd44f9b5a4428baa8848c2951b50f2e5155a66f0cb03b51ca5cdb624e2b1d"} May 29 20:34:59.114239 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.114216 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nnhvx" event={"ID":"c9c8631f-eea5-4184-aa19-e53c413b83a0","Type":"ContainerStarted","Data":"e6aeb60fdc666d29d63e6fc0d47aa1fdf6a139bd9dda2b466819b43200dc9d3b"} May 29 20:34:59.115415 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.115394 2551 generic.go:358] "Generic (PLEG): container finished" podID="f37e71e36820ca3369fb4fdbd82936b8" containerID="79bc4582464b8489075443a294fb9df4d0a5520fec65004701a81577af4079aa" exitCode=0 May 29 20:34:59.115497 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.115420 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" event={"ID":"f37e71e36820ca3369fb4fdbd82936b8","Type":"ContainerDied","Data":"79bc4582464b8489075443a294fb9df4d0a5520fec65004701a81577af4079aa"} May 29 20:34:59.118639 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.118606 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5jfcl" event={"ID":"474a0bc1-0455-4d61-8c50-7288545cdd8d","Type":"ContainerStarted","Data":"97817910c51a42944f83dc0aa727c271ea1c4479dee3da3b3d7be3a743cdd695"} May 29 20:34:59.120123 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.120101 2551 generic.go:358] "Generic (PLEG): container finished" podID="d4abbd14-0a52-432e-b13b-a727b13d0af7" containerID="c05ba9a7a5c78b803a610c98fa567ead5cdc191622a2c9508fa1ddf32bc7c8d1" exitCode=0 May 29 20:34:59.120198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.120179 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerDied","Data":"c05ba9a7a5c78b803a610c98fa567ead5cdc191622a2c9508fa1ddf32bc7c8d1"} May 29 20:34:59.138224 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.138185 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2t5dr" podStartSLOduration=3.796651861 podStartE2EDuration="22.138174216s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.214282528 +0000 UTC m=+2.086919692" lastFinishedPulling="2026-05-29 20:34:56.555804873 +0000 UTC m=+20.428442047" observedRunningTime="2026-05-29 20:34:58.143614292 +0000 UTC m=+22.016251476" watchObservedRunningTime="2026-05-29 20:34:59.138174216 +0000 UTC m=+23.010811397" May 29 20:34:59.170466 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.170419 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-l85tw" podStartSLOduration=3.719877945 podStartE2EDuration="22.170407789s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.128619866 +0000 UTC m=+2.001257026" lastFinishedPulling="2026-05-29 20:34:56.579149708 +0000 UTC m=+20.451786870" observedRunningTime="2026-05-29 20:34:59.138132103 +0000 UTC m=+23.010769284" watchObservedRunningTime="2026-05-29 20:34:59.170407789 +0000 UTC m=+23.043044971" May 29 20:34:59.243389 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.241124 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5jfcl" podStartSLOduration=3.912659117 podStartE2EDuration="22.241103474s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.180599008 +0000 UTC m=+2.053236168" lastFinishedPulling="2026-05-29 20:34:56.509043363 +0000 UTC m=+20.381680525" observedRunningTime="2026-05-29 20:34:59.215139252 +0000 UTC m=+23.087776434" watchObservedRunningTime="2026-05-29 20:34:59.241103474 +0000 UTC m=+23.113740653" May 29 20:34:59.260207 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.260167 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nnhvx" podStartSLOduration=3.950089202 podStartE2EDuration="22.260153099s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.198996118 +0000 UTC m=+2.071633278" lastFinishedPulling="2026-05-29 20:34:56.509059997 +0000 UTC m=+20.381697175" observedRunningTime="2026-05-29 20:34:59.259775041 +0000 UTC m=+23.132412223" watchObservedRunningTime="2026-05-29 20:34:59.260153099 +0000 UTC m=+23.132790280" May 29 20:34:59.386284 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.386259 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 20:34:59.900989 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.900863 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T20:34:59.386276801Z","UUID":"578bb1ca-4a48-4c32-9bf6-5298a306f65c","Handler":null,"Name":"","Endpoint":""} May 29 20:34:59.904333 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.904308 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 20:34:59.904476 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.904344 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 20:34:59.961999 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:34:59.961923 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:34:59.962148 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:34:59.962080 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:35:00.124662 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:00.124613 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" event={"ID":"f37e71e36820ca3369fb4fdbd82936b8","Type":"ContainerStarted","Data":"506a9d2b78eaf1922b0db4620d8a076c37e5fedb72e46ae817e0720d56cb4600"} May 29 20:35:00.127946 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:00.127917 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-acl-logging/0.log" May 29 20:35:00.128569 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:00.128509 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"5c1702ce7639ee82373812908932a616449a945265b606ca09699f4e4b0e78ba"} May 29 20:35:00.131322 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:00.131282 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" event={"ID":"11455435-1da2-422c-9650-ad2f07363c63","Type":"ContainerStarted","Data":"6370750e540997255689deabccec8944e762d21b541035b12bd2a6240b85d8e2"} May 29 20:35:00.144501 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:00.144452 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-100.ec2.internal" podStartSLOduration=23.144435046 podStartE2EDuration="23.144435046s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:35:00.144381337 +0000 UTC m=+24.017018531" watchObservedRunningTime="2026-05-29 20:35:00.144435046 +0000 UTC m=+24.017072228" May 29 20:35:00.960349 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:00.960162 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:00.960556 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:00.960440 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:35:01.135376 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:01.135334 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" event={"ID":"11455435-1da2-422c-9650-ad2f07363c63","Type":"ContainerStarted","Data":"c246457a5cd68030e7152811b30afc753406ad5466f231bb48ba41ae0da933ca"} May 29 20:35:01.155029 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:01.154982 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kggg" podStartSLOduration=2.075194865 podStartE2EDuration="24.154967713s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.223928701 +0000 UTC m=+2.096565860" lastFinishedPulling="2026-05-29 20:35:00.303701535 +0000 UTC m=+24.176338708" observedRunningTime="2026-05-29 20:35:01.154815747 +0000 UTC m=+25.027452932" watchObservedRunningTime="2026-05-29 20:35:01.154967713 +0000 UTC m=+25.027604916" May 29 20:35:01.960535 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:01.960486 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:35:01.960718 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:01.960632 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:35:02.962705 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:02.962683 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:02.963243 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:02.962794 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:35:03.141737 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.141581 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-acl-logging/0.log" May 29 20:35:03.142144 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.142105 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"eebfedc09f109c3d5c3e88ab2930fe8f0eb90f17b7e3d36bbbafe7de1dd5db2d"} May 29 20:35:03.142422 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.142403 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:35:03.142510 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.142431 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:35:03.142674 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.142657 2551 scope.go:117] "RemoveContainer" containerID="268416528ca00e52dd2725c190c4ff51cfbc001d81862b22a9a72c0914109ac8" May 29 20:35:03.143904 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.143886 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerStarted","Data":"e4619b2256db81851f836620da23f8637ab4e5716ab054c31d9995e56c94c662"} May 29 20:35:03.159791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.159771 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:35:03.742629 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.742592 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5jfcl" May 29 20:35:03.743276 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.743262 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5jfcl" May 29 20:35:03.960157 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:03.960123 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:35:03.960297 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:03.960227 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:35:04.151076 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.151042 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-acl-logging/0.log" May 29 20:35:04.151683 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.151450 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" event={"ID":"e22f5f5a-58aa-4bb0-9384-9e15d81c74de","Type":"ContainerStarted","Data":"6f5bf9357e40a8ed8e5282efbeaf88bd4bc03f9c11da1cbbb9a01f296013d318"} May 29 20:35:04.151843 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.151808 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:35:04.153351 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.153317 2551 generic.go:358] "Generic (PLEG): container finished" podID="d4abbd14-0a52-432e-b13b-a727b13d0af7" containerID="e4619b2256db81851f836620da23f8637ab4e5716ab054c31d9995e56c94c662" exitCode=0 May 29 20:35:04.153434 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.153382 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerDied","Data":"e4619b2256db81851f836620da23f8637ab4e5716ab054c31d9995e56c94c662"} May 29 20:35:04.153787 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.153714 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5jfcl" May 29 20:35:04.154790 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.154214 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5jfcl" May 29 20:35:04.170076 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.170050 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:35:04.187865 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.187806 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" podStartSLOduration=8.501193303 podStartE2EDuration="27.187791391s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.17528487 +0000 UTC m=+2.047922030" lastFinishedPulling="2026-05-29 20:34:56.861882956 +0000 UTC m=+20.734520118" observedRunningTime="2026-05-29 20:35:04.186314033 +0000 UTC m=+28.058951242" watchObservedRunningTime="2026-05-29 20:35:04.187791391 +0000 UTC m=+28.060428573" May 29 20:35:04.932239 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.932210 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lh64"] May 29 20:35:04.932397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.932323 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:35:04.932459 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:04.932440 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:35:04.935988 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.935964 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pd62t"] May 29 20:35:04.936093 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:04.936067 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:04.936178 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:04.936159 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:35:05.156833 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:05.156802 2551 generic.go:358] "Generic (PLEG): container finished" podID="d4abbd14-0a52-432e-b13b-a727b13d0af7" containerID="9953609010ea2306d8bcebb1577743b1611e1e734028d7ab12b50f8058c84226" exitCode=0 May 29 20:35:05.157260 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:05.156895 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerDied","Data":"9953609010ea2306d8bcebb1577743b1611e1e734028d7ab12b50f8058c84226"} May 29 20:35:06.160804 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:06.160765 2551 generic.go:358] "Generic (PLEG): container finished" podID="d4abbd14-0a52-432e-b13b-a727b13d0af7" containerID="f8b29e94264c421f635eef3e084e8a6bd83c9bca8f913ad55e090f061166c933" exitCode=0 May 29 20:35:06.161166 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:06.160853 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerDied","Data":"f8b29e94264c421f635eef3e084e8a6bd83c9bca8f913ad55e090f061166c933"} May 29 20:35:06.962778 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:06.962324 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:06.962959 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:06.962790 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:35:06.963256 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:06.963236 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:35:06.963398 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:06.963377 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:35:08.959825 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:08.959791 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:08.959825 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:08.959805 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:35:08.960265 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:08.959913 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pd62t" podUID="91afabc6-d251-4003-9185-00a9f362a82b" May 29 20:35:08.960265 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:08.960068 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lh64" podUID="0c41df73-e24e-4b29-8408-e96237e180de" May 29 20:35:09.570673 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.570630 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:35:09.570852 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.570683 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:09.570852 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:09.570768 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:35:09.570852 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:09.570793 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 20:35:09.570852 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:09.570808 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 20:35:09.570852 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:09.570820 2551 projected.go:194] Error preparing data for projected volume kube-api-access-jgbd7 for pod openshift-network-diagnostics/network-check-target-pd62t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:35:09.570852 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:09.570835 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs podName:0c41df73-e24e-4b29-8408-e96237e180de nodeName:}" failed. No retries permitted until 2026-05-29 20:35:41.570813913 +0000 UTC m=+65.443451092 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs") pod "network-metrics-daemon-2lh64" (UID: "0c41df73-e24e-4b29-8408-e96237e180de") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 20:35:09.570852 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:09.570854 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7 podName:91afabc6-d251-4003-9185-00a9f362a82b nodeName:}" failed. No retries permitted until 2026-05-29 20:35:41.570842338 +0000 UTC m=+65.443479513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgbd7" (UniqueName: "kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7") pod "network-check-target-pd62t" (UID: "91afabc6-d251-4003-9185-00a9f362a82b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 20:35:09.874035 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.874009 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-100.ec2.internal" event="NodeReady" May 29 20:35:09.874205 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.874149 2551 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 20:35:09.945167 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.945134 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vn2sw"] May 29 20:35:09.948448 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.948427 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-psvfr"] May 29 20:35:09.948669 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.948622 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vn2sw" May 29 20:35:09.950322 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.950302 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:09.954056 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.954035 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 20:35:09.954756 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.954735 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8rkdw\"" May 29 20:35:09.954849 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.954740 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 20:35:09.954963 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.954947 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 20:35:09.955015 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.954961 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 20:35:09.955573 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.955500 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 20:35:09.958514 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.958495 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-svhwx\"" May 29 20:35:09.967366 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.967345 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vn2sw"] May 29 20:35:09.977066 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:09.977037 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-psvfr"] May 29 20:35:10.073870 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.073828 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ghgf\" (UniqueName: \"kubernetes.io/projected/369261b1-d15d-4ebb-b917-d226cbe15df2-kube-api-access-4ghgf\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.074026 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.073890 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/369261b1-d15d-4ebb-b917-d226cbe15df2-config-volume\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.074026 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.073912 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.074026 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.073983 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghg99\" (UniqueName: \"kubernetes.io/projected/53193993-66d7-4d8e-ad4c-2cfed635ac59-kube-api-access-ghg99\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:10.074026 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.074016 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:10.074182 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.074038 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/369261b1-d15d-4ebb-b917-d226cbe15df2-tmp-dir\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.175119 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.175032 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ghgf\" (UniqueName: \"kubernetes.io/projected/369261b1-d15d-4ebb-b917-d226cbe15df2-kube-api-access-4ghgf\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.175119 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.175091 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/369261b1-d15d-4ebb-b917-d226cbe15df2-config-volume\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.175119 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.175116 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.175460 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.175146 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghg99\" (UniqueName: \"kubernetes.io/projected/53193993-66d7-4d8e-ad4c-2cfed635ac59-kube-api-access-ghg99\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:10.175460 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:10.175267 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 20:35:10.175460 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.175261 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:10.175460 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:10.175331 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls podName:369261b1-d15d-4ebb-b917-d226cbe15df2 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:10.675307302 +0000 UTC m=+34.547944474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls") pod "dns-default-vn2sw" (UID: "369261b1-d15d-4ebb-b917-d226cbe15df2") : secret "dns-default-metrics-tls" not found May 29 20:35:10.175460 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:10.175357 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 20:35:10.175460 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:10.175410 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert podName:53193993-66d7-4d8e-ad4c-2cfed635ac59 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:10.675392877 +0000 UTC m=+34.548030041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert") pod "ingress-canary-psvfr" (UID: "53193993-66d7-4d8e-ad4c-2cfed635ac59") : secret "canary-serving-cert" not found May 29 20:35:10.175460 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.175359 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/369261b1-d15d-4ebb-b917-d226cbe15df2-tmp-dir\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.175784 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.175631 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/369261b1-d15d-4ebb-b917-d226cbe15df2-tmp-dir\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.175784 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.175671 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/369261b1-d15d-4ebb-b917-d226cbe15df2-config-volume\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.187281 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.187257 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ghgf\" (UniqueName: \"kubernetes.io/projected/369261b1-d15d-4ebb-b917-d226cbe15df2-kube-api-access-4ghgf\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.187452 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.187421 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghg99\" (UniqueName: \"kubernetes.io/projected/53193993-66d7-4d8e-ad4c-2cfed635ac59-kube-api-access-ghg99\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:10.679946 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.679908 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:10.680132 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.680011 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:10.680132 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:10.680038 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 20:35:10.680132 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:10.680112 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert podName:53193993-66d7-4d8e-ad4c-2cfed635ac59 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:11.680096674 +0000 UTC m=+35.552733838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert") pod "ingress-canary-psvfr" (UID: "53193993-66d7-4d8e-ad4c-2cfed635ac59") : secret "canary-serving-cert" not found May 29 20:35:10.680132 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:10.680112 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 20:35:10.680347 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:10.680174 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls podName:369261b1-d15d-4ebb-b917-d226cbe15df2 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:11.680158688 +0000 UTC m=+35.552795856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls") pod "dns-default-vn2sw" (UID: "369261b1-d15d-4ebb-b917-d226cbe15df2") : secret "dns-default-metrics-tls" not found May 29 20:35:10.960142 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.960055 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:10.960142 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.960113 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:35:10.963977 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.963792 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jfpqx\"" May 29 20:35:10.963977 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.963819 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 20:35:10.964676 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.964654 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 20:35:10.964782 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.964725 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-46dkk\"" May 29 20:35:10.964782 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:10.964761 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 20:35:11.688417 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:11.688376 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:11.688417 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:11.688426 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:11.689004 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:11.688543 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 20:35:11.689004 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:11.688544 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 20:35:11.689004 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:11.688605 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert podName:53193993-66d7-4d8e-ad4c-2cfed635ac59 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:13.688591012 +0000 UTC m=+37.561228172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert") pod "ingress-canary-psvfr" (UID: "53193993-66d7-4d8e-ad4c-2cfed635ac59") : secret "canary-serving-cert" not found May 29 20:35:11.689004 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:11.688619 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls podName:369261b1-d15d-4ebb-b917-d226cbe15df2 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:13.688613036 +0000 UTC m=+37.561250196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls") pod "dns-default-vn2sw" (UID: "369261b1-d15d-4ebb-b917-d226cbe15df2") : secret "dns-default-metrics-tls" not found May 29 20:35:12.174898 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:12.174872 2551 generic.go:358] "Generic (PLEG): container finished" podID="d4abbd14-0a52-432e-b13b-a727b13d0af7" containerID="3c8872684e41d3728b17910247f39d2632b39ad96b36aebeba25dc979c9d6942" exitCode=0 May 29 20:35:12.175053 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:12.174919 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerDied","Data":"3c8872684e41d3728b17910247f39d2632b39ad96b36aebeba25dc979c9d6942"} May 29 20:35:13.179693 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:13.179657 2551 generic.go:358] "Generic (PLEG): container finished" podID="d4abbd14-0a52-432e-b13b-a727b13d0af7" containerID="d038ad77cfaffa1546e4e99983443a341865bea1789fc25e1cff1929579e5f26" exitCode=0 May 29 20:35:13.180160 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:13.179709 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerDied","Data":"d038ad77cfaffa1546e4e99983443a341865bea1789fc25e1cff1929579e5f26"} May 29 20:35:13.704351 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:13.704166 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:13.704563 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:13.704366 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:13.704563 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:13.704314 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 20:35:13.704563 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:13.704444 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 20:35:13.704563 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:13.704491 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls podName:369261b1-d15d-4ebb-b917-d226cbe15df2 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:17.704467757 +0000 UTC m=+41.577104937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls") pod "dns-default-vn2sw" (UID: "369261b1-d15d-4ebb-b917-d226cbe15df2") : secret "dns-default-metrics-tls" not found May 29 20:35:13.704563 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:13.704511 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert podName:53193993-66d7-4d8e-ad4c-2cfed635ac59 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:17.704502279 +0000 UTC m=+41.577139439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert") pod "ingress-canary-psvfr" (UID: "53193993-66d7-4d8e-ad4c-2cfed635ac59") : secret "canary-serving-cert" not found May 29 20:35:14.184635 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:14.184604 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tczx" event={"ID":"d4abbd14-0a52-432e-b13b-a727b13d0af7","Type":"ContainerStarted","Data":"4de18eefed71a17da9c9b4284bfaa41227c512a6954f4c9c59258c9673ff8e50"} May 29 20:35:14.210330 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:14.210282 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7tczx" podStartSLOduration=3.544465784 podStartE2EDuration="37.210269545s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:34:38.159755604 +0000 UTC m=+2.032392765" lastFinishedPulling="2026-05-29 20:35:11.825559363 +0000 UTC m=+35.698196526" observedRunningTime="2026-05-29 20:35:14.209775733 +0000 UTC m=+38.082412915" watchObservedRunningTime="2026-05-29 20:35:14.210269545 +0000 UTC m=+38.082906727" May 29 20:35:17.730434 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:17.730393 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:17.730434 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:17.730441 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:17.730884 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:17.730547 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 20:35:17.730884 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:17.730551 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 20:35:17.730884 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:17.730598 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert podName:53193993-66d7-4d8e-ad4c-2cfed635ac59 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:25.730584622 +0000 UTC m=+49.603221781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert") pod "ingress-canary-psvfr" (UID: "53193993-66d7-4d8e-ad4c-2cfed635ac59") : secret "canary-serving-cert" not found May 29 20:35:17.730884 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:17.730611 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls podName:369261b1-d15d-4ebb-b917-d226cbe15df2 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:25.730605262 +0000 UTC m=+49.603242422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls") pod "dns-default-vn2sw" (UID: "369261b1-d15d-4ebb-b917-d226cbe15df2") : secret "dns-default-metrics-tls" not found May 29 20:35:25.788047 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:25.787999 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:25.788648 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:25.788060 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:25.788648 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:25.788149 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 20:35:25.788648 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:25.788163 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 20:35:25.788648 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:25.788229 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls podName:369261b1-d15d-4ebb-b917-d226cbe15df2 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:41.788212632 +0000 UTC m=+65.660849811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls") pod "dns-default-vn2sw" (UID: "369261b1-d15d-4ebb-b917-d226cbe15df2") : secret "dns-default-metrics-tls" not found May 29 20:35:25.788648 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:25.788246 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert podName:53193993-66d7-4d8e-ad4c-2cfed635ac59 nodeName:}" failed. No retries permitted until 2026-05-29 20:35:41.788239768 +0000 UTC m=+65.660876928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert") pod "ingress-canary-psvfr" (UID: "53193993-66d7-4d8e-ad4c-2cfed635ac59") : secret "canary-serving-cert" not found May 29 20:35:36.172051 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:36.172024 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdc94" May 29 20:35:41.601512 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.601453 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:41.601998 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.601566 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:35:41.606023 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.605999 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 20:35:41.606124 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.606001 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 20:35:41.611691 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:41.611673 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 20:35:41.611838 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:41.611734 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs podName:0c41df73-e24e-4b29-8408-e96237e180de nodeName:}" failed. No retries permitted until 2026-05-29 20:36:45.611717866 +0000 UTC m=+129.484355040 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs") pod "network-metrics-daemon-2lh64" (UID: "0c41df73-e24e-4b29-8408-e96237e180de") : secret "metrics-daemon-secret" not found May 29 20:35:41.618507 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.618492 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 20:35:41.625918 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.625903 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgbd7\" (UniqueName: \"kubernetes.io/projected/91afabc6-d251-4003-9185-00a9f362a82b-kube-api-access-jgbd7\") pod \"network-check-target-pd62t\" (UID: \"91afabc6-d251-4003-9185-00a9f362a82b\") " pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:41.802873 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.802833 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:35:41.803024 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.802888 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:35:41.803024 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:41.802984 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 20:35:41.803109 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:41.803038 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert podName:53193993-66d7-4d8e-ad4c-2cfed635ac59 nodeName:}" failed. No retries permitted until 2026-05-29 20:36:13.803020989 +0000 UTC m=+97.675658149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert") pod "ingress-canary-psvfr" (UID: "53193993-66d7-4d8e-ad4c-2cfed635ac59") : secret "canary-serving-cert" not found May 29 20:35:41.803109 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:41.802984 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 20:35:41.803109 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:35:41.803099 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls podName:369261b1-d15d-4ebb-b917-d226cbe15df2 nodeName:}" failed. No retries permitted until 2026-05-29 20:36:13.803086103 +0000 UTC m=+97.675723276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls") pod "dns-default-vn2sw" (UID: "369261b1-d15d-4ebb-b917-d226cbe15df2") : secret "dns-default-metrics-tls" not found May 29 20:35:41.874813 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.874788 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jfpqx\"" May 29 20:35:41.881953 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:41.881932 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:42.016364 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:42.016330 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pd62t"] May 29 20:35:42.020092 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:35:42.020069 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91afabc6_d251_4003_9185_00a9f362a82b.slice/crio-e3cd9ca092bb67ec1c4eaf8f66bff0665905b6c1999f087afb65ada6bbcae0b0 WatchSource:0}: Error finding container e3cd9ca092bb67ec1c4eaf8f66bff0665905b6c1999f087afb65ada6bbcae0b0: Status 404 returned error can't find the container with id e3cd9ca092bb67ec1c4eaf8f66bff0665905b6c1999f087afb65ada6bbcae0b0 May 29 20:35:42.236342 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:42.236256 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pd62t" event={"ID":"91afabc6-d251-4003-9185-00a9f362a82b","Type":"ContainerStarted","Data":"e3cd9ca092bb67ec1c4eaf8f66bff0665905b6c1999f087afb65ada6bbcae0b0"} May 29 20:35:45.243371 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:45.243331 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pd62t" event={"ID":"91afabc6-d251-4003-9185-00a9f362a82b","Type":"ContainerStarted","Data":"63578884d7607444a16032b9867f5c6aa0f2ae77471c47264f95eaed4b9da3e7"} May 29 20:35:45.243833 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:45.243442 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:35:45.265042 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:35:45.264989 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pd62t" podStartSLOduration=65.609821244 podStartE2EDuration="1m8.264974701s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:35:42.021727168 +0000 UTC m=+65.894364328" lastFinishedPulling="2026-05-29 20:35:44.676880617 +0000 UTC m=+68.549517785" observedRunningTime="2026-05-29 20:35:45.264817592 +0000 UTC m=+69.137454773" watchObservedRunningTime="2026-05-29 20:35:45.264974701 +0000 UTC m=+69.137611883" May 29 20:36:05.296998 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.296887 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd"] May 29 20:36:05.299300 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.299285 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.303750 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.303730 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8h2wm\"" May 29 20:36:05.304040 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.304024 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 29 20:36:05.304768 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.304748 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 29 20:36:05.304872 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.304770 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 29 20:36:05.304872 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.304829 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 29 20:36:05.313824 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.313803 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd"] May 29 20:36:05.370492 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.370446 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvdcv\" (UniqueName: \"kubernetes.io/projected/a8ea1ac4-5d53-436f-b509-dc2346412523-kube-api-access-nvdcv\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.370492 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.370507 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8ea1ac4-5d53-436f-b509-dc2346412523-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.370728 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.370547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8ea1ac4-5d53-436f-b509-dc2346412523-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.399677 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.399636 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-cff7h"] May 29 20:36:05.401258 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.401243 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.403906 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.403876 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 29 20:36:05.403906 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.403898 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 29 20:36:05.404073 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.403927 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 29 20:36:05.404073 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.403931 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 29 20:36:05.405488 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.405472 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6xgrm\"" May 29 20:36:05.409842 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.409819 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-z7z9m"] May 29 20:36:05.411765 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.411749 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bf687d465-5s4t6"] May 29 20:36:05.411904 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.411888 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.413579 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.413562 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.417421 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.417395 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 29 20:36:05.417514 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.417465 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 29 20:36:05.418166 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.418147 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 29 20:36:05.418364 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.418345 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 20:36:05.418960 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.418824 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bqdzb\"" May 29 20:36:05.419774 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.419751 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 29 20:36:05.422075 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.421686 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x4trv\"" May 29 20:36:05.422075 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.421713 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 20:36:05.422075 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.421941 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 20:36:05.422723 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.422704 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-cff7h"] May 29 20:36:05.427062 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.427031 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 29 20:36:05.430433 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.430414 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 20:36:05.435326 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.435307 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-z7z9m"] May 29 20:36:05.437731 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.437712 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf687d465-5s4t6"] May 29 20:36:05.470860 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.470818 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf22a18c-b355-4db2-a1e7-acc584679f82-serving-cert\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.470860 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.470870 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-bound-sa-token\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.471040 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.470891 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-image-registry-private-configuration\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.471040 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.470945 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a5c4037-1bac-48cc-a663-c172c9b959e1-config\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.471040 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.470961 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-trusted-ca\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.471040 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.470979 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.471040 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.470996 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-installation-pull-secrets\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.471040 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471038 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjk6x\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-kube-api-access-qjk6x\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.471273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471070 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvdcv\" (UniqueName: \"kubernetes.io/projected/a8ea1ac4-5d53-436f-b509-dc2346412523-kube-api-access-nvdcv\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.471273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471111 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzs2z\" (UniqueName: \"kubernetes.io/projected/cf22a18c-b355-4db2-a1e7-acc584679f82-kube-api-access-jzs2z\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.471273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471136 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a5c4037-1bac-48cc-a663-c172c9b959e1-trusted-ca\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.471273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471159 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-certificates\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.471273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471187 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8ea1ac4-5d53-436f-b509-dc2346412523-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.471273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471218 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8ea1ac4-5d53-436f-b509-dc2346412523-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.471273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471249 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf22a18c-b355-4db2-a1e7-acc584679f82-config\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.471273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471274 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a5c4037-1bac-48cc-a663-c172c9b959e1-serving-cert\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.471676 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471309 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-ca-trust-extracted\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.471676 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471351 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwpcr\" (UniqueName: \"kubernetes.io/projected/5a5c4037-1bac-48cc-a663-c172c9b959e1-kube-api-access-jwpcr\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.471825 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.471806 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8ea1ac4-5d53-436f-b509-dc2346412523-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.473375 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.473351 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8ea1ac4-5d53-436f-b509-dc2346412523-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.483937 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.483901 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvdcv\" (UniqueName: \"kubernetes.io/projected/a8ea1ac4-5d53-436f-b509-dc2346412523-kube-api-access-nvdcv\") pod \"kube-storage-version-migrator-operator-96ddc787c-q7qdd\" (UID: \"a8ea1ac4-5d53-436f-b509-dc2346412523\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.572620 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572508 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-image-registry-private-configuration\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.572620 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572582 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a5c4037-1bac-48cc-a663-c172c9b959e1-config\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.572620 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572599 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-trusted-ca\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.572620 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572617 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572634 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-installation-pull-secrets\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:05.572729 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:05.572746 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf687d465-5s4t6: secret "image-registry-tls" not found May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:05.572804 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls podName:9495727e-73f1-4f79-8eb6-3fe2a3c7a11f nodeName:}" failed. No retries permitted until 2026-05-29 20:36:06.072784552 +0000 UTC m=+89.945421712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls") pod "image-registry-5bf687d465-5s4t6" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f") : secret "image-registry-tls" not found May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572718 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjk6x\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-kube-api-access-qjk6x\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572870 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzs2z\" (UniqueName: \"kubernetes.io/projected/cf22a18c-b355-4db2-a1e7-acc584679f82-kube-api-access-jzs2z\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572898 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a5c4037-1bac-48cc-a663-c172c9b959e1-trusted-ca\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572924 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-certificates\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.572974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572968 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf22a18c-b355-4db2-a1e7-acc584679f82-config\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.573386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.572993 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a5c4037-1bac-48cc-a663-c172c9b959e1-serving-cert\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.573386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.573034 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-ca-trust-extracted\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.573386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.573067 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwpcr\" (UniqueName: \"kubernetes.io/projected/5a5c4037-1bac-48cc-a663-c172c9b959e1-kube-api-access-jwpcr\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.573386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.573107 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf22a18c-b355-4db2-a1e7-acc584679f82-serving-cert\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.573386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.573153 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-bound-sa-token\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.573564 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.573431 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a5c4037-1bac-48cc-a663-c172c9b959e1-config\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.573619 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.573580 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf22a18c-b355-4db2-a1e7-acc584679f82-config\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.573990 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.573961 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-ca-trust-extracted\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.574093 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.574008 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a5c4037-1bac-48cc-a663-c172c9b959e1-trusted-ca\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.574310 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.574282 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-trusted-ca\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.574310 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.574296 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-certificates\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.575284 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.575263 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-image-registry-private-configuration\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.575358 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.575306 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-installation-pull-secrets\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.575878 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.575862 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a5c4037-1bac-48cc-a663-c172c9b959e1-serving-cert\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.575926 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.575882 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf22a18c-b355-4db2-a1e7-acc584679f82-serving-cert\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.585774 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.585749 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-bound-sa-token\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.585873 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.585786 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzs2z\" (UniqueName: \"kubernetes.io/projected/cf22a18c-b355-4db2-a1e7-acc584679f82-kube-api-access-jzs2z\") pod \"service-ca-operator-69877444c-cff7h\" (UID: \"cf22a18c-b355-4db2-a1e7-acc584679f82\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.586328 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.586308 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwpcr\" (UniqueName: \"kubernetes.io/projected/5a5c4037-1bac-48cc-a663-c172c9b959e1-kube-api-access-jwpcr\") pod \"console-operator-86d7c6cc77-z7z9m\" (UID: \"5a5c4037-1bac-48cc-a663-c172c9b959e1\") " pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.586540 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.586505 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjk6x\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-kube-api-access-qjk6x\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:05.608311 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.608287 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" May 29 20:36:05.710982 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.710951 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" May 29 20:36:05.723748 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.723714 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:05.730369 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.730337 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd"] May 29 20:36:05.734655 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:05.734617 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ea1ac4_5d53_436f_b509_dc2346412523.slice/crio-4342106d57db9bc8e70cfcd8938862e69d1b0c214d5b19ff9c41bb459f8d640b WatchSource:0}: Error finding container 4342106d57db9bc8e70cfcd8938862e69d1b0c214d5b19ff9c41bb459f8d640b: Status 404 returned error can't find the container with id 4342106d57db9bc8e70cfcd8938862e69d1b0c214d5b19ff9c41bb459f8d640b May 29 20:36:05.849130 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.849049 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-cff7h"] May 29 20:36:05.852748 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:05.852722 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf22a18c_b355_4db2_a1e7_acc584679f82.slice/crio-ae1b6e9e15b50aed3462bfe88e975efa94064b081b3359826fa89e464b635577 WatchSource:0}: Error finding container ae1b6e9e15b50aed3462bfe88e975efa94064b081b3359826fa89e464b635577: Status 404 returned error can't find the container with id ae1b6e9e15b50aed3462bfe88e975efa94064b081b3359826fa89e464b635577 May 29 20:36:05.865841 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:05.865811 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-z7z9m"] May 29 20:36:05.868132 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:05.868108 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5c4037_1bac_48cc_a663_c172c9b959e1.slice/crio-43c9bffa9b68b7a3a2785443f8ff688e343765ad802b8a932ff2da0aa1aeb5cc WatchSource:0}: Error finding container 43c9bffa9b68b7a3a2785443f8ff688e343765ad802b8a932ff2da0aa1aeb5cc: Status 404 returned error can't find the container with id 43c9bffa9b68b7a3a2785443f8ff688e343765ad802b8a932ff2da0aa1aeb5cc May 29 20:36:06.077418 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:06.077376 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:06.077605 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:06.077558 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 20:36:06.077605 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:06.077577 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf687d465-5s4t6: secret "image-registry-tls" not found May 29 20:36:06.077677 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:06.077641 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls podName:9495727e-73f1-4f79-8eb6-3fe2a3c7a11f nodeName:}" failed. No retries permitted until 2026-05-29 20:36:07.077620984 +0000 UTC m=+90.950258159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls") pod "image-registry-5bf687d465-5s4t6" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f") : secret "image-registry-tls" not found May 29 20:36:06.284814 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:06.284761 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" event={"ID":"5a5c4037-1bac-48cc-a663-c172c9b959e1","Type":"ContainerStarted","Data":"43c9bffa9b68b7a3a2785443f8ff688e343765ad802b8a932ff2da0aa1aeb5cc"} May 29 20:36:06.285980 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:06.285936 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" event={"ID":"a8ea1ac4-5d53-436f-b509-dc2346412523","Type":"ContainerStarted","Data":"4342106d57db9bc8e70cfcd8938862e69d1b0c214d5b19ff9c41bb459f8d640b"} May 29 20:36:06.287312 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:06.287283 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" event={"ID":"cf22a18c-b355-4db2-a1e7-acc584679f82","Type":"ContainerStarted","Data":"ae1b6e9e15b50aed3462bfe88e975efa94064b081b3359826fa89e464b635577"} May 29 20:36:07.086505 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:07.086465 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:07.086923 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:07.086641 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 20:36:07.086923 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:07.086665 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf687d465-5s4t6: secret "image-registry-tls" not found May 29 20:36:07.086923 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:07.086749 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls podName:9495727e-73f1-4f79-8eb6-3fe2a3c7a11f nodeName:}" failed. No retries permitted until 2026-05-29 20:36:09.086728524 +0000 UTC m=+92.959365692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls") pod "image-registry-5bf687d465-5s4t6" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f") : secret "image-registry-tls" not found May 29 20:36:09.104690 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.104607 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:09.105028 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:09.104789 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 20:36:09.105028 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:09.104813 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf687d465-5s4t6: secret "image-registry-tls" not found May 29 20:36:09.105028 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:09.104873 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls podName:9495727e-73f1-4f79-8eb6-3fe2a3c7a11f nodeName:}" failed. No retries permitted until 2026-05-29 20:36:13.1048548 +0000 UTC m=+96.977491980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls") pod "image-registry-5bf687d465-5s4t6" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f") : secret "image-registry-tls" not found May 29 20:36:09.294078 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.294048 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/0.log" May 29 20:36:09.294254 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.294091 2551 generic.go:358] "Generic (PLEG): container finished" podID="5a5c4037-1bac-48cc-a663-c172c9b959e1" containerID="f503bbd64603b01635248d3ce98cad6db6a43c160ce0b44e0770fdebd6171f67" exitCode=255 May 29 20:36:09.294254 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.294125 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" event={"ID":"5a5c4037-1bac-48cc-a663-c172c9b959e1","Type":"ContainerDied","Data":"f503bbd64603b01635248d3ce98cad6db6a43c160ce0b44e0770fdebd6171f67"} May 29 20:36:09.294410 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.294378 2551 scope.go:117] "RemoveContainer" containerID="f503bbd64603b01635248d3ce98cad6db6a43c160ce0b44e0770fdebd6171f67" May 29 20:36:09.295574 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.295551 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" event={"ID":"a8ea1ac4-5d53-436f-b509-dc2346412523","Type":"ContainerStarted","Data":"d656ab13093dc8d5967971c135d0ece62a18afb71237345fe98bc494548cf6cf"} May 29 20:36:09.297102 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.297068 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" event={"ID":"cf22a18c-b355-4db2-a1e7-acc584679f82","Type":"ContainerStarted","Data":"28f8760d1c4b0faa1fb437361b47494549246d244b7ac42668d5ef225a88ef8e"} May 29 20:36:09.333973 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.333917 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" podStartSLOduration=1.3917935240000001 podStartE2EDuration="4.333898398s" podCreationTimestamp="2026-05-29 20:36:05 +0000 UTC" firstStartedPulling="2026-05-29 20:36:05.737443219 +0000 UTC m=+89.610080385" lastFinishedPulling="2026-05-29 20:36:08.679548084 +0000 UTC m=+92.552185259" observedRunningTime="2026-05-29 20:36:09.333774154 +0000 UTC m=+93.206411335" watchObservedRunningTime="2026-05-29 20:36:09.333898398 +0000 UTC m=+93.206535581" May 29 20:36:09.352161 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:09.352102 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" podStartSLOduration=1.522012602 podStartE2EDuration="4.352082845s" podCreationTimestamp="2026-05-29 20:36:05 +0000 UTC" firstStartedPulling="2026-05-29 20:36:05.854484509 +0000 UTC m=+89.727121670" lastFinishedPulling="2026-05-29 20:36:08.68455475 +0000 UTC m=+92.557191913" observedRunningTime="2026-05-29 20:36:09.350896178 +0000 UTC m=+93.223533360" watchObservedRunningTime="2026-05-29 20:36:09.352082845 +0000 UTC m=+93.224720028" May 29 20:36:10.254688 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.254660 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l85tw_442072e3-d69d-41f9-aa51-be411b2779d8/dns-node-resolver/0.log" May 29 20:36:10.300906 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.300876 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/1.log" May 29 20:36:10.301283 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.301266 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/0.log" May 29 20:36:10.301351 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.301308 2551 generic.go:358] "Generic (PLEG): container finished" podID="5a5c4037-1bac-48cc-a663-c172c9b959e1" containerID="cf4c51e9dd8541e9248474ead102af1411e6b9a3440cede973f68a444520ed20" exitCode=255 May 29 20:36:10.301417 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.301394 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" event={"ID":"5a5c4037-1bac-48cc-a663-c172c9b959e1","Type":"ContainerDied","Data":"cf4c51e9dd8541e9248474ead102af1411e6b9a3440cede973f68a444520ed20"} May 29 20:36:10.301470 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.301443 2551 scope.go:117] "RemoveContainer" containerID="f503bbd64603b01635248d3ce98cad6db6a43c160ce0b44e0770fdebd6171f67" May 29 20:36:10.301742 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.301725 2551 scope.go:117] "RemoveContainer" containerID="cf4c51e9dd8541e9248474ead102af1411e6b9a3440cede973f68a444520ed20" May 29 20:36:10.301945 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:10.301918 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-z7z9m_openshift-console-operator(5a5c4037-1bac-48cc-a663-c172c9b959e1)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" podUID="5a5c4037-1bac-48cc-a663-c172c9b959e1" May 29 20:36:10.874129 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.874093 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m"] May 29 20:36:10.876753 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.876738 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" May 29 20:36:10.879771 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.879745 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 29 20:36:10.879882 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.879757 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 29 20:36:10.880641 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.880620 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-g7kwt\"" May 29 20:36:10.892293 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.892267 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m"] May 29 20:36:10.919430 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:10.919404 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wdf5\" (UniqueName: \"kubernetes.io/projected/316bb3bc-606a-4901-aed2-0a5babbe670b-kube-api-access-7wdf5\") pod \"migrator-96c6f749-xqr2m\" (UID: \"316bb3bc-606a-4901-aed2-0a5babbe670b\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" May 29 20:36:11.020822 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:11.020792 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wdf5\" (UniqueName: \"kubernetes.io/projected/316bb3bc-606a-4901-aed2-0a5babbe670b-kube-api-access-7wdf5\") pod \"migrator-96c6f749-xqr2m\" (UID: \"316bb3bc-606a-4901-aed2-0a5babbe670b\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" May 29 20:36:11.029880 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:11.029855 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wdf5\" (UniqueName: \"kubernetes.io/projected/316bb3bc-606a-4901-aed2-0a5babbe670b-kube-api-access-7wdf5\") pod \"migrator-96c6f749-xqr2m\" (UID: \"316bb3bc-606a-4901-aed2-0a5babbe670b\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" May 29 20:36:11.185320 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:11.185235 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" May 29 20:36:11.304962 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:11.304940 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/1.log" May 29 20:36:11.305300 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:11.305278 2551 scope.go:117] "RemoveContainer" containerID="cf4c51e9dd8541e9248474ead102af1411e6b9a3440cede973f68a444520ed20" May 29 20:36:11.305499 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:11.305481 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-z7z9m_openshift-console-operator(5a5c4037-1bac-48cc-a663-c172c9b959e1)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" podUID="5a5c4037-1bac-48cc-a663-c172c9b959e1" May 29 20:36:11.311019 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:11.310997 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m"] May 29 20:36:11.313884 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:11.313860 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316bb3bc_606a_4901_aed2_0a5babbe670b.slice/crio-087173cb58ff1e66eb8e99e7268132c35d43c0ac5d0ac0132c5d943ce4ff90f7 WatchSource:0}: Error finding container 087173cb58ff1e66eb8e99e7268132c35d43c0ac5d0ac0132c5d943ce4ff90f7: Status 404 returned error can't find the container with id 087173cb58ff1e66eb8e99e7268132c35d43c0ac5d0ac0132c5d943ce4ff90f7 May 29 20:36:11.454808 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:11.454732 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nnhvx_c9c8631f-eea5-4184-aa19-e53c413b83a0/node-ca/0.log" May 29 20:36:12.308399 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:12.308365 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" event={"ID":"316bb3bc-606a-4901-aed2-0a5babbe670b","Type":"ContainerStarted","Data":"087173cb58ff1e66eb8e99e7268132c35d43c0ac5d0ac0132c5d943ce4ff90f7"} May 29 20:36:13.134296 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.134256 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:13.134484 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:13.134414 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 20:36:13.134484 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:13.134435 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf687d465-5s4t6: secret "image-registry-tls" not found May 29 20:36:13.134583 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:13.134490 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls podName:9495727e-73f1-4f79-8eb6-3fe2a3c7a11f nodeName:}" failed. No retries permitted until 2026-05-29 20:36:21.134475332 +0000 UTC m=+105.007112492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls") pod "image-registry-5bf687d465-5s4t6" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f") : secret "image-registry-tls" not found May 29 20:36:13.311865 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.311828 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" event={"ID":"316bb3bc-606a-4901-aed2-0a5babbe670b","Type":"ContainerStarted","Data":"407c2cb88f9a27e35bad3d2f699c062704557b62ae1169b5218f0d22e026d016"} May 29 20:36:13.311865 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.311867 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" event={"ID":"316bb3bc-606a-4901-aed2-0a5babbe670b","Type":"ContainerStarted","Data":"3fbdffea86f2a0df9fd714a1c169a90364b32ffb14aa0766d221e1a6c709423a"} May 29 20:36:13.341401 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.341345 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xqr2m" podStartSLOduration=2.02135398 podStartE2EDuration="3.341329006s" podCreationTimestamp="2026-05-29 20:36:10 +0000 UTC" firstStartedPulling="2026-05-29 20:36:11.315505229 +0000 UTC m=+95.188142389" lastFinishedPulling="2026-05-29 20:36:12.635480255 +0000 UTC m=+96.508117415" observedRunningTime="2026-05-29 20:36:13.339866062 +0000 UTC m=+97.212503244" watchObservedRunningTime="2026-05-29 20:36:13.341329006 +0000 UTC m=+97.213966187" May 29 20:36:13.535648 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.535565 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-jpb8g"] May 29 20:36:13.537741 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.537726 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.540907 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.540884 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 29 20:36:13.540907 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.540901 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8psp8\"" May 29 20:36:13.541357 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.541343 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 29 20:36:13.541539 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.541511 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 29 20:36:13.541607 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.541580 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 29 20:36:13.555940 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.555911 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-jpb8g"] May 29 20:36:13.638706 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.638669 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ff9113e-ba42-4404-9841-4625d9d87169-signing-key\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.638893 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.638737 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ff9113e-ba42-4404-9841-4625d9d87169-signing-cabundle\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.638893 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.638806 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh8xd\" (UniqueName: \"kubernetes.io/projected/1ff9113e-ba42-4404-9841-4625d9d87169-kube-api-access-hh8xd\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.739416 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.739376 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh8xd\" (UniqueName: \"kubernetes.io/projected/1ff9113e-ba42-4404-9841-4625d9d87169-kube-api-access-hh8xd\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.739631 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.739561 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ff9113e-ba42-4404-9841-4625d9d87169-signing-key\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.739699 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.739645 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ff9113e-ba42-4404-9841-4625d9d87169-signing-cabundle\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.740242 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.740225 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ff9113e-ba42-4404-9841-4625d9d87169-signing-cabundle\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.741874 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.741851 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ff9113e-ba42-4404-9841-4625d9d87169-signing-key\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.748505 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.748487 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh8xd\" (UniqueName: \"kubernetes.io/projected/1ff9113e-ba42-4404-9841-4625d9d87169-kube-api-access-hh8xd\") pod \"service-ca-685df94d57-jpb8g\" (UID: \"1ff9113e-ba42-4404-9841-4625d9d87169\") " pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.841023 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.840918 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:36:13.841023 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.841011 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:36:13.841209 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:13.841065 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 20:36:13.841209 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:13.841104 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 20:36:13.841209 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:13.841128 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert podName:53193993-66d7-4d8e-ad4c-2cfed635ac59 nodeName:}" failed. No retries permitted until 2026-05-29 20:37:17.841113181 +0000 UTC m=+161.713750346 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert") pod "ingress-canary-psvfr" (UID: "53193993-66d7-4d8e-ad4c-2cfed635ac59") : secret "canary-serving-cert" not found May 29 20:36:13.841209 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:13.841156 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls podName:369261b1-d15d-4ebb-b917-d226cbe15df2 nodeName:}" failed. No retries permitted until 2026-05-29 20:37:17.841144612 +0000 UTC m=+161.713781773 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls") pod "dns-default-vn2sw" (UID: "369261b1-d15d-4ebb-b917-d226cbe15df2") : secret "dns-default-metrics-tls" not found May 29 20:36:13.846928 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.846905 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-jpb8g" May 29 20:36:13.974230 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:13.974199 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-jpb8g"] May 29 20:36:13.977127 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:13.977096 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff9113e_ba42_4404_9841_4625d9d87169.slice/crio-a35e3ff52218b03448fac01b2d2d2476c2201477a6e38c461bc94031b32df49b WatchSource:0}: Error finding container a35e3ff52218b03448fac01b2d2d2476c2201477a6e38c461bc94031b32df49b: Status 404 returned error can't find the container with id a35e3ff52218b03448fac01b2d2d2476c2201477a6e38c461bc94031b32df49b May 29 20:36:14.317835 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:14.317799 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-jpb8g" event={"ID":"1ff9113e-ba42-4404-9841-4625d9d87169","Type":"ContainerStarted","Data":"2e281e1274c8605a1f9d26d6a21149101e606c85875af3a3eef074f6dcf519e9"} May 29 20:36:14.317835 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:14.317839 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-jpb8g" event={"ID":"1ff9113e-ba42-4404-9841-4625d9d87169","Type":"ContainerStarted","Data":"a35e3ff52218b03448fac01b2d2d2476c2201477a6e38c461bc94031b32df49b"} May 29 20:36:15.724317 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:15.724273 2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:15.724317 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:15.724320 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:15.724853 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:15.724777 2551 scope.go:117] "RemoveContainer" containerID="cf4c51e9dd8541e9248474ead102af1411e6b9a3440cede973f68a444520ed20" May 29 20:36:15.725003 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:15.724982 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-z7z9m_openshift-console-operator(5a5c4037-1bac-48cc-a663-c172c9b959e1)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" podUID="5a5c4037-1bac-48cc-a663-c172c9b959e1" May 29 20:36:16.247869 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:16.247833 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pd62t" May 29 20:36:16.267132 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:16.267080 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-jpb8g" podStartSLOduration=3.267064994 podStartE2EDuration="3.267064994s" podCreationTimestamp="2026-05-29 20:36:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:36:14.344114075 +0000 UTC m=+98.216751258" watchObservedRunningTime="2026-05-29 20:36:16.267064994 +0000 UTC m=+100.139702175" May 29 20:36:21.207213 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:21.207172 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:21.209662 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:21.209638 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"image-registry-5bf687d465-5s4t6\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:21.328685 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:21.328646 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:21.456275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:21.456248 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf687d465-5s4t6"] May 29 20:36:21.458481 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:21.458423 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9495727e_73f1_4f79_8eb6_3fe2a3c7a11f.slice/crio-cffd4ef33195555491466b9560ed5dfe08e4738d5526123701abe707efdafcf9 WatchSource:0}: Error finding container cffd4ef33195555491466b9560ed5dfe08e4738d5526123701abe707efdafcf9: Status 404 returned error can't find the container with id cffd4ef33195555491466b9560ed5dfe08e4738d5526123701abe707efdafcf9 May 29 20:36:22.337495 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:22.337453 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" event={"ID":"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f","Type":"ContainerStarted","Data":"f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f"} May 29 20:36:22.337495 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:22.337490 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" event={"ID":"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f","Type":"ContainerStarted","Data":"cffd4ef33195555491466b9560ed5dfe08e4738d5526123701abe707efdafcf9"} May 29 20:36:22.338014 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:22.337565 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:22.358478 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:22.358430 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" podStartSLOduration=17.358416979 podStartE2EDuration="17.358416979s" podCreationTimestamp="2026-05-29 20:36:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:36:22.357407831 +0000 UTC m=+106.230045014" watchObservedRunningTime="2026-05-29 20:36:22.358416979 +0000 UTC m=+106.231054160" May 29 20:36:27.960106 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:27.960074 2551 scope.go:117] "RemoveContainer" containerID="cf4c51e9dd8541e9248474ead102af1411e6b9a3440cede973f68a444520ed20" May 29 20:36:28.353437 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:28.353355 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/2.log" May 29 20:36:28.353735 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:28.353721 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/1.log" May 29 20:36:28.353785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:28.353752 2551 generic.go:358] "Generic (PLEG): container finished" podID="5a5c4037-1bac-48cc-a663-c172c9b959e1" containerID="adcde63657a89eb2933f34b0fdbf2a45fb4cc4eb70405a712716f3e26469c6cf" exitCode=255 May 29 20:36:28.353785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:28.353779 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" event={"ID":"5a5c4037-1bac-48cc-a663-c172c9b959e1","Type":"ContainerDied","Data":"adcde63657a89eb2933f34b0fdbf2a45fb4cc4eb70405a712716f3e26469c6cf"} May 29 20:36:28.353885 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:28.353808 2551 scope.go:117] "RemoveContainer" containerID="cf4c51e9dd8541e9248474ead102af1411e6b9a3440cede973f68a444520ed20" May 29 20:36:28.354151 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:28.354134 2551 scope.go:117] "RemoveContainer" containerID="adcde63657a89eb2933f34b0fdbf2a45fb4cc4eb70405a712716f3e26469c6cf" May 29 20:36:28.354392 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:28.354343 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-z7z9m_openshift-console-operator(5a5c4037-1bac-48cc-a663-c172c9b959e1)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" podUID="5a5c4037-1bac-48cc-a663-c172c9b959e1" May 29 20:36:29.357374 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:29.357347 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/2.log" May 29 20:36:32.576392 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.576360 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wbggh"] May 29 20:36:32.579092 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.579069 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.581450 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.581430 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 20:36:32.581580 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.581532 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 20:36:32.581580 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.581540 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 20:36:32.582173 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.582155 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 20:36:32.582259 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.582227 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lskmd\"" May 29 20:36:32.591058 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.591036 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wbggh"] May 29 20:36:32.595185 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.595162 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf687d465-5s4t6"] May 29 20:36:32.698974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.698944 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9906f14-6f9b-4812-8fd8-0eab762db2ca-data-volume\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.699136 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.698999 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sctc\" (UniqueName: \"kubernetes.io/projected/c9906f14-6f9b-4812-8fd8-0eab762db2ca-kube-api-access-4sctc\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.699136 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.699109 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9906f14-6f9b-4812-8fd8-0eab762db2ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.699220 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.699177 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9906f14-6f9b-4812-8fd8-0eab762db2ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.699254 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.699224 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c9906f14-6f9b-4812-8fd8-0eab762db2ca-crio-socket\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.800068 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.800030 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sctc\" (UniqueName: \"kubernetes.io/projected/c9906f14-6f9b-4812-8fd8-0eab762db2ca-kube-api-access-4sctc\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.800068 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.800075 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9906f14-6f9b-4812-8fd8-0eab762db2ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.800295 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.800107 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9906f14-6f9b-4812-8fd8-0eab762db2ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.800295 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.800135 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c9906f14-6f9b-4812-8fd8-0eab762db2ca-crio-socket\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.800295 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.800162 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9906f14-6f9b-4812-8fd8-0eab762db2ca-data-volume\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.800295 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.800264 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c9906f14-6f9b-4812-8fd8-0eab762db2ca-crio-socket\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.800488 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.800473 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9906f14-6f9b-4812-8fd8-0eab762db2ca-data-volume\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.800699 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.800676 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9906f14-6f9b-4812-8fd8-0eab762db2ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.802441 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.802420 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9906f14-6f9b-4812-8fd8-0eab762db2ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.808668 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.808649 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sctc\" (UniqueName: \"kubernetes.io/projected/c9906f14-6f9b-4812-8fd8-0eab762db2ca-kube-api-access-4sctc\") pod \"insights-runtime-extractor-wbggh\" (UID: \"c9906f14-6f9b-4812-8fd8-0eab762db2ca\") " pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:32.889236 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:32.889204 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wbggh" May 29 20:36:33.028790 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:33.028758 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wbggh"] May 29 20:36:33.031619 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:33.031570 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9906f14_6f9b_4812_8fd8_0eab762db2ca.slice/crio-1acb081185057352149ee387dcb86dd168be2ca4e815c86918cf2ac75f3990c5 WatchSource:0}: Error finding container 1acb081185057352149ee387dcb86dd168be2ca4e815c86918cf2ac75f3990c5: Status 404 returned error can't find the container with id 1acb081185057352149ee387dcb86dd168be2ca4e815c86918cf2ac75f3990c5 May 29 20:36:33.368514 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:33.368485 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wbggh" event={"ID":"c9906f14-6f9b-4812-8fd8-0eab762db2ca","Type":"ContainerStarted","Data":"68ab4bf4d759380a6ea96e7e6122d306035d6e4214af2d01ed8dfae14875545f"} May 29 20:36:33.368681 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:33.368537 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wbggh" event={"ID":"c9906f14-6f9b-4812-8fd8-0eab762db2ca","Type":"ContainerStarted","Data":"1acb081185057352149ee387dcb86dd168be2ca4e815c86918cf2ac75f3990c5"} May 29 20:36:34.373652 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:34.373608 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wbggh" event={"ID":"c9906f14-6f9b-4812-8fd8-0eab762db2ca","Type":"ContainerStarted","Data":"853d90444ba314f2b0de690b360c99cba7e82cb9a24d65e88be006c839ab5ae8"} May 29 20:36:35.377502 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:35.377468 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wbggh" event={"ID":"c9906f14-6f9b-4812-8fd8-0eab762db2ca","Type":"ContainerStarted","Data":"4ec004922dc69008b8c940ecc190988f18322ec4be7e2f1766d159c125c2c27e"} May 29 20:36:35.395243 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:35.395197 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wbggh" podStartSLOduration=1.496280986 podStartE2EDuration="3.39518383s" podCreationTimestamp="2026-05-29 20:36:32 +0000 UTC" firstStartedPulling="2026-05-29 20:36:33.081164973 +0000 UTC m=+116.953802146" lastFinishedPulling="2026-05-29 20:36:34.980067831 +0000 UTC m=+118.852704990" observedRunningTime="2026-05-29 20:36:35.39445312 +0000 UTC m=+119.267090303" watchObservedRunningTime="2026-05-29 20:36:35.39518383 +0000 UTC m=+119.267821012" May 29 20:36:35.724585 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:35.724485 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:35.724585 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:35.724534 2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:35.724881 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:35.724867 2551 scope.go:117] "RemoveContainer" containerID="adcde63657a89eb2933f34b0fdbf2a45fb4cc4eb70405a712716f3e26469c6cf" May 29 20:36:35.725076 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:35.725058 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-z7z9m_openshift-console-operator(5a5c4037-1bac-48cc-a663-c172c9b959e1)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" podUID="5a5c4037-1bac-48cc-a663-c172c9b959e1" May 29 20:36:39.326324 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.326289 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt"] May 29 20:36:39.329178 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.329163 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" May 29 20:36:39.332485 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.332463 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 29 20:36:39.332614 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.332471 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5s9xk\"" May 29 20:36:39.340165 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.340144 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt"] May 29 20:36:39.451851 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.451813 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e9884f8-f66a-4cd8-b37a-eda444ec43c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-4hrxt\" (UID: \"2e9884f8-f66a-4cd8-b37a-eda444ec43c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" May 29 20:36:39.552886 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.552843 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e9884f8-f66a-4cd8-b37a-eda444ec43c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-4hrxt\" (UID: \"2e9884f8-f66a-4cd8-b37a-eda444ec43c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" May 29 20:36:39.555186 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.555167 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e9884f8-f66a-4cd8-b37a-eda444ec43c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-4hrxt\" (UID: \"2e9884f8-f66a-4cd8-b37a-eda444ec43c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" May 29 20:36:39.637660 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.637619 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" May 29 20:36:39.758808 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:39.758778 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt"] May 29 20:36:39.761907 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:39.761868 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9884f8_f66a_4cd8_b37a_eda444ec43c6.slice/crio-eb0484bc6a6044ed01e0fa632cb74b4955d41d814e4f638b24f8a3732767d04f WatchSource:0}: Error finding container eb0484bc6a6044ed01e0fa632cb74b4955d41d814e4f638b24f8a3732767d04f: Status 404 returned error can't find the container with id eb0484bc6a6044ed01e0fa632cb74b4955d41d814e4f638b24f8a3732767d04f May 29 20:36:40.390512 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:40.390473 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" event={"ID":"2e9884f8-f66a-4cd8-b37a-eda444ec43c6","Type":"ContainerStarted","Data":"eb0484bc6a6044ed01e0fa632cb74b4955d41d814e4f638b24f8a3732767d04f"} May 29 20:36:41.394302 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:41.394264 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" event={"ID":"2e9884f8-f66a-4cd8-b37a-eda444ec43c6","Type":"ContainerStarted","Data":"5da0943439179e6d026c61ef4a2dad758dd543aeee2625acc4dd0aa808c11322"} May 29 20:36:41.394765 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:41.394463 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" May 29 20:36:41.399104 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:41.399083 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" May 29 20:36:41.412516 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:41.412468 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-4hrxt" podStartSLOduration=0.989185866 podStartE2EDuration="2.412457745s" podCreationTimestamp="2026-05-29 20:36:39 +0000 UTC" firstStartedPulling="2026-05-29 20:36:39.763817951 +0000 UTC m=+123.636455121" lastFinishedPulling="2026-05-29 20:36:41.187089836 +0000 UTC m=+125.059727000" observedRunningTime="2026-05-29 20:36:41.410960596 +0000 UTC m=+125.283597800" watchObservedRunningTime="2026-05-29 20:36:41.412457745 +0000 UTC m=+125.285094927" May 29 20:36:42.600989 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:42.600955 2551 patch_prober.go:28] interesting pod/image-registry-5bf687d465-5s4t6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 20:36:42.601355 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:42.601015 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" podUID="9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 20:36:45.702429 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:45.702386 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:36:45.704651 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:45.704633 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c41df73-e24e-4b29-8408-e96237e180de-metrics-certs\") pod \"network-metrics-daemon-2lh64\" (UID: \"0c41df73-e24e-4b29-8408-e96237e180de\") " pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:36:45.780001 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:45.779972 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-46dkk\"" May 29 20:36:45.787949 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:45.787930 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lh64" May 29 20:36:45.908449 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:45.908417 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lh64"] May 29 20:36:45.912287 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:45.912261 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c41df73_e24e_4b29_8408_e96237e180de.slice/crio-325b93a0cd5e79527888f457585f45d8920ea1bd5b8ebef33442472c4c89c401 WatchSource:0}: Error finding container 325b93a0cd5e79527888f457585f45d8920ea1bd5b8ebef33442472c4c89c401: Status 404 returned error can't find the container with id 325b93a0cd5e79527888f457585f45d8920ea1bd5b8ebef33442472c4c89c401 May 29 20:36:46.408188 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.408146 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lh64" event={"ID":"0c41df73-e24e-4b29-8408-e96237e180de","Type":"ContainerStarted","Data":"325b93a0cd5e79527888f457585f45d8920ea1bd5b8ebef33442472c4c89c401"} May 29 20:36:46.765921 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.765617 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-zk258"] May 29 20:36:46.768813 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.768790 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz"] May 29 20:36:46.769000 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.768980 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:46.773001 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.772720 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:46.775653 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.775621 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 29 20:36:46.775941 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.775836 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8msv9\"" May 29 20:36:46.776020 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.775949 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dp82p\"" May 29 20:36:46.776083 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.776019 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 29 20:36:46.776362 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.776202 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 29 20:36:46.776362 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.776226 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 29 20:36:46.776362 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.776263 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 20:36:46.776587 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.776446 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 20:36:46.776647 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.776599 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 20:36:46.779094 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.779075 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 29 20:36:46.795657 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.795203 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz"] May 29 20:36:46.796255 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.796211 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-zk258"] May 29 20:36:46.798629 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.797434 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-whn5n"] May 29 20:36:46.800789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.800759 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.804030 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.804002 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 20:36:46.804721 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.804406 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5mcnb\"" May 29 20:36:46.804721 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.804566 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 20:36:46.804721 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.804601 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 20:36:46.913166 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913135 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-wtmp\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.913339 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913176 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccwkp\" (UniqueName: \"kubernetes.io/projected/b16293a7-e6f7-49b7-8669-1552ee6be5a6-kube-api-access-ccwkp\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.913339 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913212 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:46.913339 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913260 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.913339 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913305 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-tls\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.913339 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913336 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:46.913656 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913373 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:46.913656 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913408 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjlc\" (UniqueName: \"kubernetes.io/projected/535ad954-ae5e-431c-b028-67c8e20487af-kube-api-access-wvjlc\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:46.913656 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913433 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:46.913656 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913476 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:46.913861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913706 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:46.913861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913752 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-textfile\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.913861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913782 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sczxf\" (UniqueName: \"kubernetes.io/projected/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-api-access-sczxf\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:46.913861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913807 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b16293a7-e6f7-49b7-8669-1552ee6be5a6-metrics-client-ca\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.913861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913837 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-sys\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.914103 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913870 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-root\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:46.914103 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913899 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535ad954-ae5e-431c-b028-67c8e20487af-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:46.914103 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913933 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:46.914103 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:46.913960 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015061 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015000 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.015061 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015050 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjlc\" (UniqueName: \"kubernetes.io/projected/535ad954-ae5e-431c-b028-67c8e20487af-kube-api-access-wvjlc\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015081 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015107 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015140 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015164 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-textfile\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015185 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sczxf\" (UniqueName: \"kubernetes.io/projected/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-api-access-sczxf\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015202 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b16293a7-e6f7-49b7-8669-1552ee6be5a6-metrics-client-ca\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015223 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-sys\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015245 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-root\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015262 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535ad954-ae5e-431c-b028-67c8e20487af-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.015287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015284 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.015789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015301 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015327 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-wtmp\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015342 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccwkp\" (UniqueName: \"kubernetes.io/projected/b16293a7-e6f7-49b7-8669-1552ee6be5a6-kube-api-access-ccwkp\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015362 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.015789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015392 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015413 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-tls\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015436 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-sys\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.015789 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015452 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.016208 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.015851 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-textfile\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.016208 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:47.015945 2551 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 29 20:36:47.016208 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:47.016008 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-tls podName:8e5e54ff-6512-4b23-ac0f-3370a8be7c90 nodeName:}" failed. No retries permitted until 2026-05-29 20:36:47.515982407 +0000 UTC m=+131.388619584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-ptxgz" (UID: "8e5e54ff-6512-4b23-ac0f-3370a8be7c90") : secret "kube-state-metrics-tls" not found May 29 20:36:47.016361 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.016218 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.016361 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.016320 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b16293a7-e6f7-49b7-8669-1552ee6be5a6-metrics-client-ca\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.016361 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.016354 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-wtmp\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.016540 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.016406 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b16293a7-e6f7-49b7-8669-1552ee6be5a6-root\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.017391 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.016649 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.017391 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.016755 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.017391 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:47.016840 2551 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 29 20:36:47.017391 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:47.016882 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-tls podName:535ad954-ae5e-431c-b028-67c8e20487af nodeName:}" failed. No retries permitted until 2026-05-29 20:36:47.516868075 +0000 UTC m=+131.389505240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-zk258" (UID: "535ad954-ae5e-431c-b028-67c8e20487af") : secret "openshift-state-metrics-tls" not found May 29 20:36:47.017391 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.017023 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535ad954-ae5e-431c-b028-67c8e20487af-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.017391 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.017287 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.018465 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.018439 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.019692 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.019646 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.020107 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.020063 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.021666 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.021619 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b16293a7-e6f7-49b7-8669-1552ee6be5a6-node-exporter-tls\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.027241 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.027202 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjlc\" (UniqueName: \"kubernetes.io/projected/535ad954-ae5e-431c-b028-67c8e20487af-kube-api-access-wvjlc\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.027809 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.027787 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sczxf\" (UniqueName: \"kubernetes.io/projected/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-api-access-sczxf\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.034187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.034166 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccwkp\" (UniqueName: \"kubernetes.io/projected/b16293a7-e6f7-49b7-8669-1552ee6be5a6-kube-api-access-ccwkp\") pod \"node-exporter-whn5n\" (UID: \"b16293a7-e6f7-49b7-8669-1552ee6be5a6\") " pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.119050 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.119007 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-whn5n" May 29 20:36:47.127720 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:47.127687 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16293a7_e6f7_49b7_8669_1552ee6be5a6.slice/crio-7231792d6ba8c0200adec5289581c43be11b7b8617cad461d522e5e631602920 WatchSource:0}: Error finding container 7231792d6ba8c0200adec5289581c43be11b7b8617cad461d522e5e631602920: Status 404 returned error can't find the container with id 7231792d6ba8c0200adec5289581c43be11b7b8617cad461d522e5e631602920 May 29 20:36:47.413664 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.413629 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lh64" event={"ID":"0c41df73-e24e-4b29-8408-e96237e180de","Type":"ContainerStarted","Data":"f7ba98685084556c960f4d62a8f3466aad995e052129bdf685afbe2a04520e07"} May 29 20:36:47.413664 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.413667 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lh64" event={"ID":"0c41df73-e24e-4b29-8408-e96237e180de","Type":"ContainerStarted","Data":"799caaf097de14ee9becb96b5fb50cfc4a6d21be0bc4e5b45b0ae4f2827dd51c"} May 29 20:36:47.414683 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.414657 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-whn5n" event={"ID":"b16293a7-e6f7-49b7-8669-1552ee6be5a6","Type":"ContainerStarted","Data":"7231792d6ba8c0200adec5289581c43be11b7b8617cad461d522e5e631602920"} May 29 20:36:47.432213 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.432156 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2lh64" podStartSLOduration=129.55861535 podStartE2EDuration="2m10.432137685s" podCreationTimestamp="2026-05-29 20:34:37 +0000 UTC" firstStartedPulling="2026-05-29 20:36:45.914415646 +0000 UTC m=+129.787052820" lastFinishedPulling="2026-05-29 20:36:46.787937991 +0000 UTC m=+130.660575155" observedRunningTime="2026-05-29 20:36:47.430798727 +0000 UTC m=+131.303435909" watchObservedRunningTime="2026-05-29 20:36:47.432137685 +0000 UTC m=+131.304774869" May 29 20:36:47.520890 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.520851 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.521068 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.520920 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.523295 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.523264 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/535ad954-ae5e-431c-b028-67c8e20487af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-zk258\" (UID: \"535ad954-ae5e-431c-b028-67c8e20487af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.523386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.523311 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e54ff-6512-4b23-ac0f-3370a8be7c90-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-ptxgz\" (UID: \"8e5e54ff-6512-4b23-ac0f-3370a8be7c90\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.682315 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.682230 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" May 29 20:36:47.688044 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.688019 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" May 29 20:36:47.860884 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.860850 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-zk258"] May 29 20:36:47.865545 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.865367 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:36:47.865869 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:47.865842 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535ad954_ae5e_431c_b028_67c8e20487af.slice/crio-bfa9c7cdd6bd4df9b93a0b13f4f3e220aabcd361d7e883ccb57191732a4cd09f WatchSource:0}: Error finding container bfa9c7cdd6bd4df9b93a0b13f4f3e220aabcd361d7e883ccb57191732a4cd09f: Status 404 returned error can't find the container with id bfa9c7cdd6bd4df9b93a0b13f4f3e220aabcd361d7e883ccb57191732a4cd09f May 29 20:36:47.872711 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.872688 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:47.875188 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.875162 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 29 20:36:47.875813 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.875475 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 29 20:36:47.875813 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.875546 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 29 20:36:47.875813 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.875569 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 29 20:36:47.875813 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.875634 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 29 20:36:47.875813 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.875679 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cjrl4\"" May 29 20:36:47.875813 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.875718 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 29 20:36:47.876231 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.876061 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 29 20:36:47.876484 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.876463 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 29 20:36:47.876657 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.876641 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 29 20:36:47.880663 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.880617 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz"] May 29 20:36:47.883154 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:47.883134 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:36:47.887591 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:47.887561 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5e54ff_6512_4b23_ac0f_3370a8be7c90.slice/crio-08f2fdc361e1d0d35c7409780384c431a479799710efda3b21e9ce406383cd25 WatchSource:0}: Error finding container 08f2fdc361e1d0d35c7409780384c431a479799710efda3b21e9ce406383cd25: Status 404 returned error can't find the container with id 08f2fdc361e1d0d35c7409780384c431a479799710efda3b21e9ce406383cd25 May 29 20:36:48.026296 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026247 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026474 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026318 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026474 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026339 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026474 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026356 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026474 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026374 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-web-config\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026474 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026392 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026474 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026429 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026474 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026460 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-out\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026867 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026481 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026867 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026496 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026867 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026511 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026867 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026542 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m85kp\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-kube-api-access-m85kp\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.026867 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.026563 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127103 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-out\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127318 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127148 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127318 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127260 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127318 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127294 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127319 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m85kp\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-kube-api-access-m85kp\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127349 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127392 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127665 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127447 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127665 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127477 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127665 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127504 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127665 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127551 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-web-config\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127665 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127582 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127665 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127662 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127957 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.127667 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.127957 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:48.127796 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle podName:8d7e5d49-dcc6-4006-a835-c70a603a5feb nodeName:}" failed. No retries permitted until 2026-05-29 20:36:48.627773977 +0000 UTC m=+132.500411140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb") : configmap references non-existent config key: ca-bundle.crt May 29 20:36:48.128126 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:48.128109 2551 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 29 20:36:48.128197 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:48.128163 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls podName:8d7e5d49-dcc6-4006-a835-c70a603a5feb nodeName:}" failed. No retries permitted until 2026-05-29 20:36:48.628147744 +0000 UTC m=+132.500784906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb") : secret "alertmanager-main-tls" not found May 29 20:36:48.128300 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.128274 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.130770 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.130714 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.131066 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.131021 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.131275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.131220 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.131407 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.131381 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-out\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.132170 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.132128 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.132475 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.132443 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.132588 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.132509 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.133141 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.133120 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-web-config\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.137786 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.137764 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m85kp\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-kube-api-access-m85kp\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.419017 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.418980 2551 generic.go:358] "Generic (PLEG): container finished" podID="b16293a7-e6f7-49b7-8669-1552ee6be5a6" containerID="820b54d7007507c957c740325d4ef7880fa97dfe60e542a82cc33c51c0434353" exitCode=0 May 29 20:36:48.419187 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.419068 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-whn5n" event={"ID":"b16293a7-e6f7-49b7-8669-1552ee6be5a6","Type":"ContainerDied","Data":"820b54d7007507c957c740325d4ef7880fa97dfe60e542a82cc33c51c0434353"} May 29 20:36:48.420721 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.420698 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" event={"ID":"535ad954-ae5e-431c-b028-67c8e20487af","Type":"ContainerStarted","Data":"8050302e0986b0c08201a00680de0c202a5fe992ec26ed700d65d18da495d9f7"} May 29 20:36:48.420829 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.420728 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" event={"ID":"535ad954-ae5e-431c-b028-67c8e20487af","Type":"ContainerStarted","Data":"b08d78a43d95ffb52007536599e206e974cab47cdc37d54fc0052caca03860a6"} May 29 20:36:48.420829 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.420744 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" event={"ID":"535ad954-ae5e-431c-b028-67c8e20487af","Type":"ContainerStarted","Data":"bfa9c7cdd6bd4df9b93a0b13f4f3e220aabcd361d7e883ccb57191732a4cd09f"} May 29 20:36:48.421641 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.421619 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" event={"ID":"8e5e54ff-6512-4b23-ac0f-3370a8be7c90","Type":"ContainerStarted","Data":"08f2fdc361e1d0d35c7409780384c431a479799710efda3b21e9ce406383cd25"} May 29 20:36:48.633088 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.633048 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.633286 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.633147 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.633910 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.633887 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.635371 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.635352 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.816693 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.816607 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 20:36:48.977895 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:48.977871 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:36:49.204095 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:49.204065 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7e5d49_dcc6_4006_a835_c70a603a5feb.slice/crio-dd8d3d68cb47002779751f35598f4775151bfd02037ceaedd4836fc5447ac9cb WatchSource:0}: Error finding container dd8d3d68cb47002779751f35598f4775151bfd02037ceaedd4836fc5447ac9cb: Status 404 returned error can't find the container with id dd8d3d68cb47002779751f35598f4775151bfd02037ceaedd4836fc5447ac9cb May 29 20:36:49.424978 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.424939 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerStarted","Data":"dd8d3d68cb47002779751f35598f4775151bfd02037ceaedd4836fc5447ac9cb"} May 29 20:36:49.426582 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.426557 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-whn5n" event={"ID":"b16293a7-e6f7-49b7-8669-1552ee6be5a6","Type":"ContainerStarted","Data":"a6a22c2d09040a49f74d146d324892798a8932e16a72ab78bafa4678220a1831"} May 29 20:36:49.426582 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.426584 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-whn5n" event={"ID":"b16293a7-e6f7-49b7-8669-1552ee6be5a6","Type":"ContainerStarted","Data":"1ee5b13f6fcb6846597ee6d6f24f4abda3c75c2b90447293013baf21b8d37185"} May 29 20:36:49.447292 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.447243 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-whn5n" podStartSLOduration=2.375355257 podStartE2EDuration="3.447229752s" podCreationTimestamp="2026-05-29 20:36:46 +0000 UTC" firstStartedPulling="2026-05-29 20:36:47.129462868 +0000 UTC m=+131.002100028" lastFinishedPulling="2026-05-29 20:36:48.201337356 +0000 UTC m=+132.073974523" observedRunningTime="2026-05-29 20:36:49.446403967 +0000 UTC m=+133.319041151" watchObservedRunningTime="2026-05-29 20:36:49.447229752 +0000 UTC m=+133.319866933" May 29 20:36:49.773973 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.773872 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs"] May 29 20:36:49.778134 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.778113 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.781825 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.781634 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 29 20:36:49.783550 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.783201 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 29 20:36:49.783550 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.783457 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qff9q\"" May 29 20:36:49.784148 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.783809 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 29 20:36:49.784148 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.783870 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8j5ofe0d93s0d\"" May 29 20:36:49.784148 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.784042 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 29 20:36:49.784148 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.784054 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 29 20:36:49.806817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.806788 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs"] May 29 20:36:49.945335 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.945292 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-grpc-tls\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.945515 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.945383 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8twks\" (UniqueName: \"kubernetes.io/projected/1a1b94ef-bbfd-4930-9e36-a08093cbb883-kube-api-access-8twks\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.945515 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.945414 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1b94ef-bbfd-4930-9e36-a08093cbb883-metrics-client-ca\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.945515 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.945443 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.945515 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.945476 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-tls\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.945715 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.945557 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.945715 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.945587 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.945715 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.945619 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:49.961512 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:49.961473 2551 scope.go:117] "RemoveContainer" containerID="adcde63657a89eb2933f34b0fdbf2a45fb4cc4eb70405a712716f3e26469c6cf" May 29 20:36:50.046798 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.046710 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8twks\" (UniqueName: \"kubernetes.io/projected/1a1b94ef-bbfd-4930-9e36-a08093cbb883-kube-api-access-8twks\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.046798 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.046765 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1b94ef-bbfd-4930-9e36-a08093cbb883-metrics-client-ca\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.047155 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.046797 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.047155 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.046827 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-tls\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.047155 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.046880 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.047155 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.046906 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.047155 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.046937 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.047155 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.046999 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-grpc-tls\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.048437 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.048385 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1b94ef-bbfd-4930-9e36-a08093cbb883-metrics-client-ca\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.050150 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.050122 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-grpc-tls\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.050874 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.050848 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.050974 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.050920 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.052311 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.052288 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-tls\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.053140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.053082 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.053752 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.053705 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a1b94ef-bbfd-4930-9e36-a08093cbb883-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.054727 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.054707 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8twks\" (UniqueName: \"kubernetes.io/projected/1a1b94ef-bbfd-4930-9e36-a08093cbb883-kube-api-access-8twks\") pod \"thanos-querier-845fbcfdcb-zxlhs\" (UID: \"1a1b94ef-bbfd-4930-9e36-a08093cbb883\") " pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.091658 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.091620 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:50.432822 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.432720 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/2.log" May 29 20:36:50.432910 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.432822 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" event={"ID":"5a5c4037-1bac-48cc-a663-c172c9b959e1","Type":"ContainerStarted","Data":"353071cfb1944fbc6e1fbcdc3d5b94107455aada7d2e50b6462893349137e010"} May 29 20:36:50.433287 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.433247 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:50.436206 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.436146 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" event={"ID":"8e5e54ff-6512-4b23-ac0f-3370a8be7c90","Type":"ContainerStarted","Data":"88ea5aedfd5890bd500b91a64939f49bd0bdb8dcfb325f6e77b26e53ba9f8e63"} May 29 20:36:50.436309 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.436185 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" event={"ID":"8e5e54ff-6512-4b23-ac0f-3370a8be7c90","Type":"ContainerStarted","Data":"1ad0f596a8e8b926f487525782f252bbcf747b8a2eef61d9af6b31d77d2df43a"} May 29 20:36:50.436309 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.436227 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" event={"ID":"8e5e54ff-6512-4b23-ac0f-3370a8be7c90","Type":"ContainerStarted","Data":"30b2d0e5c4431b49d1c6bf67969f45c3a86bf478384f86dbac7c768f717fc058"} May 29 20:36:50.439758 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.439736 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" event={"ID":"535ad954-ae5e-431c-b028-67c8e20487af","Type":"ContainerStarted","Data":"4c43a463c8c0393861576c537685284db28459a150549cd0c9a4d1f3ce54bcf6"} May 29 20:36:50.454249 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.454203 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" podStartSLOduration=42.640250221 podStartE2EDuration="45.454189594s" podCreationTimestamp="2026-05-29 20:36:05 +0000 UTC" firstStartedPulling="2026-05-29 20:36:05.869733545 +0000 UTC m=+89.742370706" lastFinishedPulling="2026-05-29 20:36:08.683672907 +0000 UTC m=+92.556310079" observedRunningTime="2026-05-29 20:36:50.453669265 +0000 UTC m=+134.326306448" watchObservedRunningTime="2026-05-29 20:36:50.454189594 +0000 UTC m=+134.326826776" May 29 20:36:50.466903 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.466877 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs"] May 29 20:36:50.475662 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.475614 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-ptxgz" podStartSLOduration=2.909254299 podStartE2EDuration="4.475589018s" podCreationTimestamp="2026-05-29 20:36:46 +0000 UTC" firstStartedPulling="2026-05-29 20:36:47.891243434 +0000 UTC m=+131.763880601" lastFinishedPulling="2026-05-29 20:36:49.457578157 +0000 UTC m=+133.330215320" observedRunningTime="2026-05-29 20:36:50.475110586 +0000 UTC m=+134.347747779" watchObservedRunningTime="2026-05-29 20:36:50.475589018 +0000 UTC m=+134.348226202" May 29 20:36:50.502459 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.502403 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-zk258" podStartSLOduration=3.2545627 podStartE2EDuration="4.502388421s" podCreationTimestamp="2026-05-29 20:36:46 +0000 UTC" firstStartedPulling="2026-05-29 20:36:48.212459804 +0000 UTC m=+132.085096983" lastFinishedPulling="2026-05-29 20:36:49.460285534 +0000 UTC m=+133.332922704" observedRunningTime="2026-05-29 20:36:50.501941737 +0000 UTC m=+134.374578945" watchObservedRunningTime="2026-05-29 20:36:50.502388421 +0000 UTC m=+134.375025602" May 29 20:36:50.527374 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:50.527343 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1b94ef_bbfd_4930_9e36_a08093cbb883.slice/crio-ae696582a33406770b169301daeeaa71f464ab2e72ac55e5df1543b2274c53c3 WatchSource:0}: Error finding container ae696582a33406770b169301daeeaa71f464ab2e72ac55e5df1543b2274c53c3: Status 404 returned error can't find the container with id ae696582a33406770b169301daeeaa71f464ab2e72ac55e5df1543b2274c53c3 May 29 20:36:50.742742 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:50.742710 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-z7z9m" May 29 20:36:51.444306 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:51.444270 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerID="597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc" exitCode=0 May 29 20:36:51.444794 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:51.444347 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerDied","Data":"597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc"} May 29 20:36:51.445645 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:51.445514 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" event={"ID":"1a1b94ef-bbfd-4930-9e36-a08093cbb883","Type":"ContainerStarted","Data":"ae696582a33406770b169301daeeaa71f464ab2e72ac55e5df1543b2274c53c3"} May 29 20:36:52.601076 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:52.601014 2551 patch_prober.go:28] interesting pod/image-registry-5bf687d465-5s4t6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 20:36:52.601517 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:52.601099 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" podUID="9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 20:36:53.019682 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.019571 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:36:53.023606 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.023576 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.025912 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.025889 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 20:36:53.027360 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.027311 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 20:36:53.027854 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.027434 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 20:36:53.027854 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.027488 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 20:36:53.027854 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.027793 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 20:36:53.027854 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.027828 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 20:36:53.028231 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.027448 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 20:36:53.028298 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.028286 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nlfn6\"" May 29 20:36:53.028365 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.028350 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 20:36:53.028487 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.028181 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 20:36:53.028564 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.028486 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 20:36:53.030119 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.030101 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 20:36:53.034261 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.034237 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2qqj1u9pdmhp4\"" May 29 20:36:53.039114 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.038858 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 20:36:53.042982 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.042958 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 20:36:53.047549 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.047505 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:36:53.073435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073159 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073204 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073235 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073280 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073315 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073340 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073435 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073363 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073615 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073656 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073681 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc5hz\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-kube-api-access-fc5hz\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073710 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073736 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073767 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073792 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073817 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.073861 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073846 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.074298 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073884 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.074298 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.073913 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.174886 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.174849 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175017 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.174897 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175017 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.174939 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175017 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.174974 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175017 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.174998 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175210 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.175024 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175210 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.175068 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175210 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.175094 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175826 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.175465 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc5hz\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-kube-api-access-fc5hz\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175826 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.175543 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175826 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.175571 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.175826 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.175609 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.176640 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176616 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.176724 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176654 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.176724 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176693 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.176822 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176733 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.176822 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176757 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.176822 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176764 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.176978 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176818 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.176978 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176911 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.177234 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.177213 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.177565 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.177539 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.177644 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.176539 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.177979 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.177955 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.178899 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.178873 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.179536 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.179494 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.180253 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.179780 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.180253 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.179888 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.180253 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.180209 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.180746 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.180720 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.180859 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.180839 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.181219 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.181195 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.181853 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.181833 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.181955 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.181933 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.182140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.182118 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.186312 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.186264 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc5hz\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-kube-api-access-fc5hz\") pod \"prometheus-k8s-0\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.340500 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.340458 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:36:53.456386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.456349 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerStarted","Data":"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e"} May 29 20:36:53.456386 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.456392 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerStarted","Data":"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff"} May 29 20:36:53.456624 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.456406 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerStarted","Data":"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70"} May 29 20:36:53.456624 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.456424 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerStarted","Data":"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12"} May 29 20:36:53.456624 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.456437 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerStarted","Data":"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a"} May 29 20:36:53.458353 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.458316 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" event={"ID":"1a1b94ef-bbfd-4930-9e36-a08093cbb883","Type":"ContainerStarted","Data":"44f0b76d6d1af6efbcb5169e189245866b573ff004c9020632f8dcb811b59c90"} May 29 20:36:53.458471 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.458352 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" event={"ID":"1a1b94ef-bbfd-4930-9e36-a08093cbb883","Type":"ContainerStarted","Data":"e0c11a3861a94939bfb49f966341a8018c909de940c925e596cdd377f1d5dba4"} May 29 20:36:53.458471 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.458432 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" event={"ID":"1a1b94ef-bbfd-4930-9e36-a08093cbb883","Type":"ContainerStarted","Data":"08688e5a53820b96ce8e0d3a4ebccb61faa5fb7813e9b0680bd9bf4201285b08"} May 29 20:36:53.483371 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:53.483334 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:36:53.486583 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:36:53.486546 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1e48ec_3e75_4c74_babd_c1b2d2b10494.slice/crio-f74ee2e99c0788b5ae74148213f5a06d36b247472093ad0d479726ac903b1922 WatchSource:0}: Error finding container f74ee2e99c0788b5ae74148213f5a06d36b247472093ad0d479726ac903b1922: Status 404 returned error can't find the container with id f74ee2e99c0788b5ae74148213f5a06d36b247472093ad0d479726ac903b1922 May 29 20:36:54.463832 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.463799 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerStarted","Data":"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d"} May 29 20:36:54.466216 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.466073 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" event={"ID":"1a1b94ef-bbfd-4930-9e36-a08093cbb883","Type":"ContainerStarted","Data":"a62251029da0814b2daba0d0b8fc3d3b8f614ccdb47303a0ba1989e83e21e277"} May 29 20:36:54.466475 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.466452 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" event={"ID":"1a1b94ef-bbfd-4930-9e36-a08093cbb883","Type":"ContainerStarted","Data":"f7d78d0f708b241018a331ea27d13919d276e7ea85f20e097da104f20e19cf28"} May 29 20:36:54.466636 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.466620 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" event={"ID":"1a1b94ef-bbfd-4930-9e36-a08093cbb883","Type":"ContainerStarted","Data":"2752b2c61d2e897ee2e1d9523d5e3f1ca23bf1118ec9f3941964839a1c56d9a4"} May 29 20:36:54.466764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.466752 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:36:54.472118 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.472094 2551 generic.go:358] "Generic (PLEG): container finished" podID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" exitCode=0 May 29 20:36:54.472208 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.472136 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerDied","Data":"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b"} May 29 20:36:54.472208 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.472152 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerStarted","Data":"f74ee2e99c0788b5ae74148213f5a06d36b247472093ad0d479726ac903b1922"} May 29 20:36:54.491655 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.491595 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.973814317 podStartE2EDuration="7.491583586s" podCreationTimestamp="2026-05-29 20:36:47 +0000 UTC" firstStartedPulling="2026-05-29 20:36:49.206589817 +0000 UTC m=+133.079226992" lastFinishedPulling="2026-05-29 20:36:53.724359088 +0000 UTC m=+137.596996261" observedRunningTime="2026-05-29 20:36:54.491055033 +0000 UTC m=+138.363692450" watchObservedRunningTime="2026-05-29 20:36:54.491583586 +0000 UTC m=+138.364220767" May 29 20:36:54.514198 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:54.514148 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" podStartSLOduration=2.319665606 podStartE2EDuration="5.514131917s" podCreationTimestamp="2026-05-29 20:36:49 +0000 UTC" firstStartedPulling="2026-05-29 20:36:50.529385743 +0000 UTC m=+134.402022903" lastFinishedPulling="2026-05-29 20:36:53.72385205 +0000 UTC m=+137.596489214" observedRunningTime="2026-05-29 20:36:54.512795848 +0000 UTC m=+138.385433031" watchObservedRunningTime="2026-05-29 20:36:54.514131917 +0000 UTC m=+138.386769098" May 29 20:36:57.484753 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.484727 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerStarted","Data":"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e"} May 29 20:36:57.485034 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.484762 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerStarted","Data":"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29"} May 29 20:36:57.485034 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.484776 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerStarted","Data":"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3"} May 29 20:36:57.485034 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.484787 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerStarted","Data":"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97"} May 29 20:36:57.616895 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.616859 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" podUID="9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" containerName="registry" containerID="cri-o://f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f" gracePeriod=30 May 29 20:36:57.847845 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.847813 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:57.928295 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.928264 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-installation-pull-secrets\") pod \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " May 29 20:36:57.928458 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.928309 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") pod \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " May 29 20:36:57.928458 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.928335 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjk6x\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-kube-api-access-qjk6x\") pod \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " May 29 20:36:57.928458 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.928434 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-certificates\") pod \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " May 29 20:36:57.928653 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.928475 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-trusted-ca\") pod \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " May 29 20:36:57.928653 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.928559 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-image-registry-private-configuration\") pod \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " May 29 20:36:57.928653 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.928603 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-ca-trust-extracted\") pod \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " May 29 20:36:57.928653 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.928627 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-bound-sa-token\") pod \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\" (UID: \"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f\") " May 29 20:36:57.929112 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.929059 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:36:57.930863 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.930341 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:36:57.931286 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.931259 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 20:36:57.931368 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.931279 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-kube-api-access-qjk6x" (OuterVolumeSpecName: "kube-api-access-qjk6x") pod "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f"). InnerVolumeSpecName "kube-api-access-qjk6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 20:36:57.931368 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.931330 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 20:36:57.931462 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.931445 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:36:57.931612 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.931587 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:36:57.937855 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:57.937834 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" (UID: "9495727e-73f1-4f79-8eb6-3fe2a3c7a11f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 20:36:58.029785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.029702 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-certificates\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:36:58.029785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.029732 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-trusted-ca\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:36:58.029785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.029743 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-image-registry-private-configuration\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:36:58.029785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.029753 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-ca-trust-extracted\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:36:58.029785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.029762 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-bound-sa-token\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:36:58.029785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.029771 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-installation-pull-secrets\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:36:58.029785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.029779 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-registry-tls\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:36:58.029785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.029788 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjk6x\" (UniqueName: \"kubernetes.io/projected/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f-kube-api-access-qjk6x\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:36:58.488310 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.488278 2551 generic.go:358] "Generic (PLEG): container finished" podID="9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" containerID="f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f" exitCode=0 May 29 20:36:58.488741 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.488337 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" May 29 20:36:58.488741 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.488355 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" event={"ID":"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f","Type":"ContainerDied","Data":"f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f"} May 29 20:36:58.488741 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.488384 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf687d465-5s4t6" event={"ID":"9495727e-73f1-4f79-8eb6-3fe2a3c7a11f","Type":"ContainerDied","Data":"cffd4ef33195555491466b9560ed5dfe08e4738d5526123701abe707efdafcf9"} May 29 20:36:58.488741 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.488399 2551 scope.go:117] "RemoveContainer" containerID="f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f" May 29 20:36:58.491478 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.491455 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerStarted","Data":"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23"} May 29 20:36:58.491610 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.491541 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerStarted","Data":"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7"} May 29 20:36:58.497691 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.497675 2551 scope.go:117] "RemoveContainer" containerID="f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f" May 29 20:36:58.497920 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:36:58.497900 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f\": container with ID starting with f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f not found: ID does not exist" containerID="f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f" May 29 20:36:58.497959 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.497927 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f"} err="failed to get container status \"f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f\": rpc error: code = NotFound desc = could not find container \"f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f\": container with ID starting with f5336bcb7a6ce50d4246161d2104e8eac2276730d62572c4a79c1fe768df464f not found: ID does not exist" May 29 20:36:58.525644 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.523572 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.854248726 podStartE2EDuration="6.523555042s" podCreationTimestamp="2026-05-29 20:36:52 +0000 UTC" firstStartedPulling="2026-05-29 20:36:54.473179257 +0000 UTC m=+138.345816417" lastFinishedPulling="2026-05-29 20:36:57.142485568 +0000 UTC m=+141.015122733" observedRunningTime="2026-05-29 20:36:58.520201414 +0000 UTC m=+142.392838608" watchObservedRunningTime="2026-05-29 20:36:58.523555042 +0000 UTC m=+142.396192225" May 29 20:36:58.535341 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.535315 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf687d465-5s4t6"] May 29 20:36:58.538955 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.538931 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bf687d465-5s4t6"] May 29 20:36:58.964312 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:36:58.964275 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" path="/var/lib/kubelet/pods/9495727e-73f1-4f79-8eb6-3fe2a3c7a11f/volumes" May 29 20:37:00.482106 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:00.482072 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-845fbcfdcb-zxlhs" May 29 20:37:03.341012 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:03.340975 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:37:12.961315 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:37:12.961264 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vn2sw" podUID="369261b1-d15d-4ebb-b917-d226cbe15df2" May 29 20:37:12.966830 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:37:12.966789 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-psvfr" podUID="53193993-66d7-4d8e-ad4c-2cfed635ac59" May 29 20:37:13.543462 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:13.543414 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:37:13.543686 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:13.543415 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vn2sw" May 29 20:37:17.911892 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:17.911849 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:37:17.912508 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:17.911922 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:37:17.914186 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:17.914159 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/369261b1-d15d-4ebb-b917-d226cbe15df2-metrics-tls\") pod \"dns-default-vn2sw\" (UID: \"369261b1-d15d-4ebb-b917-d226cbe15df2\") " pod="openshift-dns/dns-default-vn2sw" May 29 20:37:17.914280 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:17.914237 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53193993-66d7-4d8e-ad4c-2cfed635ac59-cert\") pod \"ingress-canary-psvfr\" (UID: \"53193993-66d7-4d8e-ad4c-2cfed635ac59\") " pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:37:18.047786 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:18.047751 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8rkdw\"" May 29 20:37:18.047786 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:18.047753 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-svhwx\"" May 29 20:37:18.055089 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:18.055071 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-psvfr" May 29 20:37:18.055178 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:18.055100 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vn2sw" May 29 20:37:18.190350 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:18.190322 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-psvfr"] May 29 20:37:18.192657 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:37:18.192623 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53193993_66d7_4d8e_ad4c_2cfed635ac59.slice/crio-0eb9fd698c3ea833d3dea4f9c52e1b75e394a8d89404ebd423c2694f9c2cc865 WatchSource:0}: Error finding container 0eb9fd698c3ea833d3dea4f9c52e1b75e394a8d89404ebd423c2694f9c2cc865: Status 404 returned error can't find the container with id 0eb9fd698c3ea833d3dea4f9c52e1b75e394a8d89404ebd423c2694f9c2cc865 May 29 20:37:18.209760 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:18.209738 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vn2sw"] May 29 20:37:18.212721 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:37:18.212695 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369261b1_d15d_4ebb_b917_d226cbe15df2.slice/crio-6c779e66a9c6299896bcf60b7e257bca8fcabb728d84f4181910b7534ff9907e WatchSource:0}: Error finding container 6c779e66a9c6299896bcf60b7e257bca8fcabb728d84f4181910b7534ff9907e: Status 404 returned error can't find the container with id 6c779e66a9c6299896bcf60b7e257bca8fcabb728d84f4181910b7534ff9907e May 29 20:37:18.559181 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:18.559096 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-psvfr" event={"ID":"53193993-66d7-4d8e-ad4c-2cfed635ac59","Type":"ContainerStarted","Data":"0eb9fd698c3ea833d3dea4f9c52e1b75e394a8d89404ebd423c2694f9c2cc865"} May 29 20:37:18.560211 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:18.560179 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vn2sw" event={"ID":"369261b1-d15d-4ebb-b917-d226cbe15df2","Type":"ContainerStarted","Data":"6c779e66a9c6299896bcf60b7e257bca8fcabb728d84f4181910b7534ff9907e"} May 29 20:37:20.567229 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.567135 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-psvfr" event={"ID":"53193993-66d7-4d8e-ad4c-2cfed635ac59","Type":"ContainerStarted","Data":"8d1fe58cb8cada23f1cd7b016259a9df82e72f248c2d580af2cc3d1039ef1d82"} May 29 20:37:20.568474 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.568444 2551 generic.go:358] "Generic (PLEG): container finished" podID="cf22a18c-b355-4db2-a1e7-acc584679f82" containerID="28f8760d1c4b0faa1fb437361b47494549246d244b7ac42668d5ef225a88ef8e" exitCode=0 May 29 20:37:20.568585 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.568506 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" event={"ID":"cf22a18c-b355-4db2-a1e7-acc584679f82","Type":"ContainerDied","Data":"28f8760d1c4b0faa1fb437361b47494549246d244b7ac42668d5ef225a88ef8e"} May 29 20:37:20.568828 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.568812 2551 scope.go:117] "RemoveContainer" containerID="28f8760d1c4b0faa1fb437361b47494549246d244b7ac42668d5ef225a88ef8e" May 29 20:37:20.570226 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.570155 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vn2sw" event={"ID":"369261b1-d15d-4ebb-b917-d226cbe15df2","Type":"ContainerStarted","Data":"4ab995713d35cdb1b49760a79077657ba19b295246c799884ca084bc6e02979c"} May 29 20:37:20.570226 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.570174 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vn2sw" event={"ID":"369261b1-d15d-4ebb-b917-d226cbe15df2","Type":"ContainerStarted","Data":"268d166e35ad903d94daed3f935c60fdde05bbf6a1eee4a0bd73b480a76e49d7"} May 29 20:37:20.570359 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.570258 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vn2sw" May 29 20:37:20.587619 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.587570 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-psvfr" podStartSLOduration=129.61680391 podStartE2EDuration="2m11.587556418s" podCreationTimestamp="2026-05-29 20:35:09 +0000 UTC" firstStartedPulling="2026-05-29 20:37:18.19454328 +0000 UTC m=+162.067180440" lastFinishedPulling="2026-05-29 20:37:20.165295776 +0000 UTC m=+164.037932948" observedRunningTime="2026-05-29 20:37:20.58626554 +0000 UTC m=+164.458902759" watchObservedRunningTime="2026-05-29 20:37:20.587556418 +0000 UTC m=+164.460193600" May 29 20:37:20.626658 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:20.626605 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-vn2sw" podStartSLOduration=129.675690991 podStartE2EDuration="2m11.626590963s" podCreationTimestamp="2026-05-29 20:35:09 +0000 UTC" firstStartedPulling="2026-05-29 20:37:18.214462684 +0000 UTC m=+162.087099856" lastFinishedPulling="2026-05-29 20:37:20.165362665 +0000 UTC m=+164.037999828" observedRunningTime="2026-05-29 20:37:20.625233566 +0000 UTC m=+164.497870748" watchObservedRunningTime="2026-05-29 20:37:20.626590963 +0000 UTC m=+164.499228144" May 29 20:37:21.574841 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:21.574801 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cff7h" event={"ID":"cf22a18c-b355-4db2-a1e7-acc584679f82","Type":"ContainerStarted","Data":"ec284f09aa82accf104c0e7814429346e9a34d61f767e21244221b4bc0977980"} May 29 20:37:24.586839 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:24.586804 2551 generic.go:358] "Generic (PLEG): container finished" podID="a8ea1ac4-5d53-436f-b509-dc2346412523" containerID="d656ab13093dc8d5967971c135d0ece62a18afb71237345fe98bc494548cf6cf" exitCode=0 May 29 20:37:24.587268 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:24.586860 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" event={"ID":"a8ea1ac4-5d53-436f-b509-dc2346412523","Type":"ContainerDied","Data":"d656ab13093dc8d5967971c135d0ece62a18afb71237345fe98bc494548cf6cf"} May 29 20:37:24.587268 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:24.587148 2551 scope.go:117] "RemoveContainer" containerID="d656ab13093dc8d5967971c135d0ece62a18afb71237345fe98bc494548cf6cf" May 29 20:37:25.591431 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:25.591393 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-q7qdd" event={"ID":"a8ea1ac4-5d53-436f-b509-dc2346412523","Type":"ContainerStarted","Data":"cd5a8ec16b690c6044d64447cce2c78ce8b75ac09304b9761ffaa26ce9bf1eab"} May 29 20:37:30.576960 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:30.576924 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vn2sw" May 29 20:37:53.340910 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:53.340877 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:37:53.381261 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:53.381232 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:37:53.684671 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:37:53.684633 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:07.063231 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.063189 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:38:07.063876 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.063825 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="alertmanager" containerID="cri-o://bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a" gracePeriod=120 May 29 20:38:07.063962 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.063889 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy-web" containerID="cri-o://ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70" gracePeriod=120 May 29 20:38:07.063962 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.063920 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy" containerID="cri-o://5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff" gracePeriod=120 May 29 20:38:07.064056 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.063889 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy-metric" containerID="cri-o://1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e" gracePeriod=120 May 29 20:38:07.064056 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.063950 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="prom-label-proxy" containerID="cri-o://bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d" gracePeriod=120 May 29 20:38:07.064148 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.064081 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="config-reloader" containerID="cri-o://858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12" gracePeriod=120 May 29 20:38:07.712271 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.712237 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerID="bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d" exitCode=0 May 29 20:38:07.712271 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.712263 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerID="5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff" exitCode=0 May 29 20:38:07.712271 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.712272 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerID="858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12" exitCode=0 May 29 20:38:07.712511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.712279 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerID="bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a" exitCode=0 May 29 20:38:07.712511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.712314 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerDied","Data":"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d"} May 29 20:38:07.712511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.712349 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerDied","Data":"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff"} May 29 20:38:07.712511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.712359 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerDied","Data":"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12"} May 29 20:38:07.712511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:07.712368 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerDied","Data":"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a"} May 29 20:38:08.306038 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.306014 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.444481 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444385 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-volume\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444481 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444433 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-out\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444481 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444478 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-web-config\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444554 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-web\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444600 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-tls-assets\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444622 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-cluster-tls-config\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444656 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444681 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-metrics-client-ca\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444710 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-main-db\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.444785 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444763 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.445107 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444789 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.445107 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444813 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m85kp\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-kube-api-access-m85kp\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.445107 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.444859 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls\") pod \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\" (UID: \"8d7e5d49-dcc6-4006-a835-c70a603a5feb\") " May 29 20:38:08.446243 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.445468 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 20:38:08.446243 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.445986 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:38:08.446627 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.446589 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:38:08.447640 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.447603 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-volume" (OuterVolumeSpecName: "config-volume") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:08.447948 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.447903 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:08.448134 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.448077 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:08.448244 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.448191 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-out" (OuterVolumeSpecName: "config-out") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 20:38:08.448418 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.448387 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 20:38:08.448783 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.448759 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:08.448993 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.448968 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-kube-api-access-m85kp" (OuterVolumeSpecName: "kube-api-access-m85kp") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "kube-api-access-m85kp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 20:38:08.449108 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.449089 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:08.452967 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.452802 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:08.458018 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.457996 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-web-config" (OuterVolumeSpecName: "web-config") pod "8d7e5d49-dcc6-4006-a835-c70a603a5feb" (UID: "8d7e5d49-dcc6-4006-a835-c70a603a5feb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:08.546509 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546458 2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-web-config\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546509 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546504 2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546509 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546515 2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-tls-assets\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546547 2551 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-cluster-tls-config\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546557 2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546566 2551 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-metrics-client-ca\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546575 2551 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-main-db\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546585 2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546593 2551 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7e5d49-dcc6-4006-a835-c70a603a5feb-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546602 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m85kp\" (UniqueName: \"kubernetes.io/projected/8d7e5d49-dcc6-4006-a835-c70a603a5feb-kube-api-access-m85kp\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546611 2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-secret-alertmanager-main-tls\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546619 2551 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-volume\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.546766 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.546628 2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d7e5d49-dcc6-4006-a835-c70a603a5feb-config-out\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:08.717779 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.717687 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerID="1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e" exitCode=0 May 29 20:38:08.717779 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.717719 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerID="ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70" exitCode=0 May 29 20:38:08.717779 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.717759 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerDied","Data":"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e"} May 29 20:38:08.718010 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.717795 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerDied","Data":"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70"} May 29 20:38:08.718010 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.717806 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d7e5d49-dcc6-4006-a835-c70a603a5feb","Type":"ContainerDied","Data":"dd8d3d68cb47002779751f35598f4775151bfd02037ceaedd4836fc5447ac9cb"} May 29 20:38:08.718010 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.717812 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.718010 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.717823 2551 scope.go:117] "RemoveContainer" containerID="bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d" May 29 20:38:08.725575 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.725553 2551 scope.go:117] "RemoveContainer" containerID="1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e" May 29 20:38:08.732223 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.732203 2551 scope.go:117] "RemoveContainer" containerID="5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff" May 29 20:38:08.738648 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.738626 2551 scope.go:117] "RemoveContainer" containerID="ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70" May 29 20:38:08.740895 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.740869 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:38:08.747250 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.747119 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:38:08.747506 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.747453 2551 scope.go:117] "RemoveContainer" containerID="858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12" May 29 20:38:08.755100 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.755077 2551 scope.go:117] "RemoveContainer" containerID="bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a" May 29 20:38:08.762008 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.761990 2551 scope.go:117] "RemoveContainer" containerID="597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc" May 29 20:38:08.771471 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.771376 2551 scope.go:117] "RemoveContainer" containerID="bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d" May 29 20:38:08.771762 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:08.771720 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d\": container with ID starting with bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d not found: ID does not exist" containerID="bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d" May 29 20:38:08.771852 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.771775 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d"} err="failed to get container status \"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d\": rpc error: code = NotFound desc = could not find container \"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d\": container with ID starting with bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d not found: ID does not exist" May 29 20:38:08.771852 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.771821 2551 scope.go:117] "RemoveContainer" containerID="1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e" May 29 20:38:08.772095 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:08.772068 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e\": container with ID starting with 1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e not found: ID does not exist" containerID="1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e" May 29 20:38:08.772142 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.772106 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e"} err="failed to get container status \"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e\": rpc error: code = NotFound desc = could not find container \"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e\": container with ID starting with 1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e not found: ID does not exist" May 29 20:38:08.772142 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.772128 2551 scope.go:117] "RemoveContainer" containerID="5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff" May 29 20:38:08.772396 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:08.772365 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff\": container with ID starting with 5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff not found: ID does not exist" containerID="5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff" May 29 20:38:08.772448 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.772404 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff"} err="failed to get container status \"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff\": rpc error: code = NotFound desc = could not find container \"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff\": container with ID starting with 5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff not found: ID does not exist" May 29 20:38:08.772448 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.772426 2551 scope.go:117] "RemoveContainer" containerID="ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70" May 29 20:38:08.772784 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:08.772760 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70\": container with ID starting with ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70 not found: ID does not exist" containerID="ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70" May 29 20:38:08.772872 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.772792 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70"} err="failed to get container status \"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70\": rpc error: code = NotFound desc = could not find container \"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70\": container with ID starting with ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70 not found: ID does not exist" May 29 20:38:08.772872 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.772809 2551 scope.go:117] "RemoveContainer" containerID="858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12" May 29 20:38:08.772963 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.772877 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:38:08.773087 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:08.773065 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12\": container with ID starting with 858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12 not found: ID does not exist" containerID="858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12" May 29 20:38:08.773127 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773094 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12"} err="failed to get container status \"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12\": rpc error: code = NotFound desc = could not find container \"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12\": container with ID starting with 858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12 not found: ID does not exist" May 29 20:38:08.773127 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773112 2551 scope.go:117] "RemoveContainer" containerID="bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a" May 29 20:38:08.773236 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773220 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="alertmanager" May 29 20:38:08.773281 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773239 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="alertmanager" May 29 20:38:08.773281 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773257 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="prom-label-proxy" May 29 20:38:08.773281 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773265 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="prom-label-proxy" May 29 20:38:08.773281 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773277 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" containerName="registry" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773285 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" containerName="registry" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773299 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy-metric" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773308 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy-metric" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773320 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="config-reloader" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773328 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="config-reloader" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773336 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:08.773336 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a\": container with ID starting with bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a not found: ID does not exist" containerID="bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773358 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a"} err="failed to get container status \"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a\": rpc error: code = NotFound desc = could not find container \"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a\": container with ID starting with bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a not found: ID does not exist" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773371 2551 scope.go:117] "RemoveContainer" containerID="597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc" May 29 20:38:08.773414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773343 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773419 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="init-config-reloader" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773427 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="init-config-reloader" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773438 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy-web" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773446 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy-web" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773534 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="alertmanager" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773548 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy-metric" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773557 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="9495727e-73f1-4f79-8eb6-3fe2a3c7a11f" containerName="registry" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773567 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="config-reloader" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773576 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy-web" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773585 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="prom-label-proxy" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773595 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" containerName="kube-rbac-proxy" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:08.773669 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc\": container with ID starting with 597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc not found: ID does not exist" containerID="597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773692 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc"} err="failed to get container status \"597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc\": rpc error: code = NotFound desc = could not find container \"597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc\": container with ID starting with 597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc not found: ID does not exist" May 29 20:38:08.773791 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.773712 2551 scope.go:117] "RemoveContainer" containerID="bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d" May 29 20:38:08.774293 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774057 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d"} err="failed to get container status \"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d\": rpc error: code = NotFound desc = could not find container \"bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d\": container with ID starting with bbb5beda1bdf373fe8f04a3212320c1e6d30c1cdf90a70ec5b54bbfa1db9a66d not found: ID does not exist" May 29 20:38:08.774293 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774077 2551 scope.go:117] "RemoveContainer" containerID="1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e" May 29 20:38:08.774293 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774266 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e"} err="failed to get container status \"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e\": rpc error: code = NotFound desc = could not find container \"1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e\": container with ID starting with 1ab64bbcdb849772101a950662527ff5578e0caa6e1d51fbcef79c174d7d629e not found: ID does not exist" May 29 20:38:08.774293 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774287 2551 scope.go:117] "RemoveContainer" containerID="5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff" May 29 20:38:08.774486 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774470 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff"} err="failed to get container status \"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff\": rpc error: code = NotFound desc = could not find container \"5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff\": container with ID starting with 5c61de9b092b2df33d84d0dcc86a3bfbccda4642b975bbb757ef86236378f0ff not found: ID does not exist" May 29 20:38:08.774551 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774486 2551 scope.go:117] "RemoveContainer" containerID="ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70" May 29 20:38:08.774682 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774667 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70"} err="failed to get container status \"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70\": rpc error: code = NotFound desc = could not find container \"ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70\": container with ID starting with ebbbdcb119e740a23357eaea5f1b60e22b53f58cb84492b6cf2e7f9044371c70 not found: ID does not exist" May 29 20:38:08.774725 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774682 2551 scope.go:117] "RemoveContainer" containerID="858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12" May 29 20:38:08.774902 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774878 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12"} err="failed to get container status \"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12\": rpc error: code = NotFound desc = could not find container \"858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12\": container with ID starting with 858f3e38a436c391918605efb7937483fc948359876b3ae838e28d3602e05e12 not found: ID does not exist" May 29 20:38:08.774902 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.774901 2551 scope.go:117] "RemoveContainer" containerID="bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a" May 29 20:38:08.775122 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.775105 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a"} err="failed to get container status \"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a\": rpc error: code = NotFound desc = could not find container \"bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a\": container with ID starting with bbd427c99c66d85fa5b716d6cae0cbc9bf2a63cf2553b5873b5e28293594694a not found: ID does not exist" May 29 20:38:08.775168 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.775123 2551 scope.go:117] "RemoveContainer" containerID="597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc" May 29 20:38:08.775326 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.775307 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc"} err="failed to get container status \"597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc\": rpc error: code = NotFound desc = could not find container \"597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc\": container with ID starting with 597070af7ded2b379fe8ca58c3595296f27d45c610a9d7bba080c43a8f30bfbc not found: ID does not exist" May 29 20:38:08.777188 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.777172 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.779634 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.779605 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 29 20:38:08.779634 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.779615 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 29 20:38:08.779765 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.779616 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 29 20:38:08.779972 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.779956 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 29 20:38:08.780156 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.780140 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 29 20:38:08.780239 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.780227 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 29 20:38:08.780343 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.780323 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 29 20:38:08.780343 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.780335 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 29 20:38:08.780669 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.780656 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cjrl4\"" May 29 20:38:08.785826 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.785805 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 29 20:38:08.788884 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.788864 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:38:08.951043 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.950989 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951043 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951046 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951127 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951163 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951190 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951221 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951265 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951439 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951289 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs7n9\" (UniqueName: \"kubernetes.io/projected/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-kube-api-access-rs7n9\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951439 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951310 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-web-config\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951439 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951337 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951439 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951352 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-config-out\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951439 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951405 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.951619 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.951443 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:08.963768 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:08.963743 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d7e5d49-dcc6-4006-a835-c70a603a5feb" path="/var/lib/kubelet/pods/8d7e5d49-dcc6-4006-a835-c70a603a5feb/volumes" May 29 20:38:09.052587 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052460 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052587 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052515 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs7n9\" (UniqueName: \"kubernetes.io/projected/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-kube-api-access-rs7n9\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052587 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052569 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-web-config\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052603 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052620 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-config-out\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052648 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052679 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052711 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052737 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052778 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052804 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052835 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.052866 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.052860 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.053590 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.053558 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.053695 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.053644 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.055574 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.055550 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-config-out\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.055689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.055579 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.055689 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.055661 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-web-config\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.055802 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.055777 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.055864 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.055829 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.055864 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.055840 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.056190 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.056174 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.056236 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.056194 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.056267 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.056247 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.057368 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.057347 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.061185 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.061168 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs7n9\" (UniqueName: \"kubernetes.io/projected/2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3-kube-api-access-rs7n9\") pod \"alertmanager-main-0\" (UID: \"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3\") " pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.089610 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.089582 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 20:38:09.231049 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.231022 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 20:38:09.233555 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:38:09.233510 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4d6287_58ff_4d0a_9dd2_4dbf422c26c3.slice/crio-6bd0af638dfeb4cdcc7f71399dc03d69903aaf222240e0c6a3bc528d8f0590af WatchSource:0}: Error finding container 6bd0af638dfeb4cdcc7f71399dc03d69903aaf222240e0c6a3bc528d8f0590af: Status 404 returned error can't find the container with id 6bd0af638dfeb4cdcc7f71399dc03d69903aaf222240e0c6a3bc528d8f0590af May 29 20:38:09.722444 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.722406 2551 generic.go:358] "Generic (PLEG): container finished" podID="2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3" containerID="e0d126a54770258cc0774a9459cb8a0846f3cb8c93584b5ef61aa66a164e9afc" exitCode=0 May 29 20:38:09.722915 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.722488 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3","Type":"ContainerDied","Data":"e0d126a54770258cc0774a9459cb8a0846f3cb8c93584b5ef61aa66a164e9afc"} May 29 20:38:09.722915 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:09.722541 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3","Type":"ContainerStarted","Data":"6bd0af638dfeb4cdcc7f71399dc03d69903aaf222240e0c6a3bc528d8f0590af"} May 29 20:38:10.730337 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:10.730304 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3","Type":"ContainerStarted","Data":"e9548ae6eaefe2f5e0ee932d91e6d8cc121c96896c009a61986c7bcc373530ce"} May 29 20:38:10.730337 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:10.730340 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3","Type":"ContainerStarted","Data":"5ebc8a0a1e945dc0b72a3de26e585ad573c708f18453abebd266fae1e3e036ed"} May 29 20:38:10.730757 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:10.730350 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3","Type":"ContainerStarted","Data":"576eeafde8ff70ad65d9c617d88fb254e824204b7797880bcd4cc4e1f0330543"} May 29 20:38:10.730757 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:10.730359 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3","Type":"ContainerStarted","Data":"f3a39277c394df0c4799426fb92434cea8b0dfe3fdd1fe68296949597a6ceca7"} May 29 20:38:10.730757 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:10.730367 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3","Type":"ContainerStarted","Data":"36df4660570f0ab06a7eab8cc5a05637eef86bed3fd212eb1985c51ca8f43db9"} May 29 20:38:10.730757 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:10.730376 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3","Type":"ContainerStarted","Data":"9738fed075c40a53ca510c805853c5272a8b176b77aa3fb9491b5540129c8e9a"} May 29 20:38:10.761169 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:10.761120 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.761104036 podStartE2EDuration="2.761104036s" podCreationTimestamp="2026-05-29 20:38:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:38:10.758232737 +0000 UTC m=+214.630869910" watchObservedRunningTime="2026-05-29 20:38:10.761104036 +0000 UTC m=+214.633741217" May 29 20:38:11.393384 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.393345 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:38:11.395249 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.395205 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" gracePeriod=600 May 29 20:38:11.395405 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.395384 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy" containerID="cri-o://1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" gracePeriod=600 May 29 20:38:11.395535 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.395487 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="prometheus" containerID="cri-o://186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" gracePeriod=600 May 29 20:38:11.395681 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.395653 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="thanos-sidecar" containerID="cri-o://79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" gracePeriod=600 May 29 20:38:11.395750 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.395684 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="config-reloader" containerID="cri-o://bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" gracePeriod=600 May 29 20:38:11.395750 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.395712 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy-web" containerID="cri-o://1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" gracePeriod=600 May 29 20:38:11.631880 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.631856 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.675243 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675153 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-kubelet-serving-ca-bundle\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675243 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675200 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-tls\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675243 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675234 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675263 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675294 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-metrics-client-certs\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675319 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-tls-assets\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675351 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc5hz\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-kube-api-access-fc5hz\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675394 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-db\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675421 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675461 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-kube-rbac-proxy\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.675511 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675496 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-grpc-tls\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675546 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config-out\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675574 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-metrics-client-ca\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675598 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-web-config\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675608 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675640 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-serving-certs-ca-bundle\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675720 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-trusted-ca-bundle\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675856 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-rulefiles-0\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.675901 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-thanos-prometheus-http-client-file\") pod \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\" (UID: \"2d1e48ec-3e75-4c74-babd-c1b2d2b10494\") " May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.676101 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.676156 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.676484 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:38:11.677109 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.676969 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:38:11.678167 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.678138 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 20:38:11.678262 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.678239 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 20:38:11.678330 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.678311 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config" (OuterVolumeSpecName: "config") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.679782 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.679753 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.679928 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.679906 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.680224 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.680187 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-kube-api-access-fc5hz" (OuterVolumeSpecName: "kube-api-access-fc5hz") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "kube-api-access-fc5hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 20:38:11.680731 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.680705 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.680819 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.680752 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.680864 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.680849 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 20:38:11.680941 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.680923 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config-out" (OuterVolumeSpecName: "config-out") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 20:38:11.681196 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.681174 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.681901 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.681881 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.682673 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.682654 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.693743 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.693715 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-web-config" (OuterVolumeSpecName: "web-config") pod "2d1e48ec-3e75-4c74-babd-c1b2d2b10494" (UID: "2d1e48ec-3e75-4c74-babd-c1b2d2b10494"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 20:38:11.736874 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736840 2551 generic.go:358] "Generic (PLEG): container finished" podID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" exitCode=0 May 29 20:38:11.736874 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736873 2551 generic.go:358] "Generic (PLEG): container finished" podID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" exitCode=0 May 29 20:38:11.736874 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736882 2551 generic.go:358] "Generic (PLEG): container finished" podID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" exitCode=0 May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736890 2551 generic.go:358] "Generic (PLEG): container finished" podID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" exitCode=0 May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736898 2551 generic.go:358] "Generic (PLEG): container finished" podID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" exitCode=0 May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736905 2551 generic.go:358] "Generic (PLEG): container finished" podID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" exitCode=0 May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736922 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerDied","Data":"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23"} May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736962 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerDied","Data":"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7"} May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736967 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736976 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerDied","Data":"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e"} May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736986 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerDied","Data":"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29"} May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.736994 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerDied","Data":"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3"} May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.737004 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerDied","Data":"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97"} May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.737014 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d1e48ec-3e75-4c74-babd-c1b2d2b10494","Type":"ContainerDied","Data":"f74ee2e99c0788b5ae74148213f5a06d36b247472093ad0d479726ac903b1922"} May 29 20:38:11.737323 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.737038 2551 scope.go:117] "RemoveContainer" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" May 29 20:38:11.744931 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.744777 2551 scope.go:117] "RemoveContainer" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" May 29 20:38:11.751592 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.751576 2551 scope.go:117] "RemoveContainer" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" May 29 20:38:11.757971 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.757955 2551 scope.go:117] "RemoveContainer" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" May 29 20:38:11.761285 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.761262 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:38:11.765025 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.765011 2551 scope.go:117] "RemoveContainer" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" May 29 20:38:11.768885 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.768866 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:38:11.772339 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.772325 2551 scope.go:117] "RemoveContainer" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" May 29 20:38:11.777001 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.776968 2551 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-metrics-client-certs\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777001 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.776995 2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-tls-assets\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777013 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc5hz\" (UniqueName: \"kubernetes.io/projected/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-kube-api-access-fc5hz\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777029 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-db\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777047 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777064 2551 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-kube-rbac-proxy\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777079 2551 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-grpc-tls\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777094 2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config-out\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777106 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-metrics-client-ca\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777121 2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-web-config\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777140 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777135 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777551 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777152 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777551 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777168 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777551 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777184 2551 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777551 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777201 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777551 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777215 2551 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-config\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.777551 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.777232 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d1e48ec-3e75-4c74-babd-c1b2d2b10494-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-100.ec2.internal\" DevicePath \"\"" May 29 20:38:11.779123 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.779109 2551 scope.go:117] "RemoveContainer" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" May 29 20:38:11.785414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.785397 2551 scope.go:117] "RemoveContainer" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" May 29 20:38:11.785729 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:11.785710 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": container with ID starting with a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23 not found: ID does not exist" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" May 29 20:38:11.785782 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.785737 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23"} err="failed to get container status \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": rpc error: code = NotFound desc = could not find container \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": container with ID starting with a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23 not found: ID does not exist" May 29 20:38:11.785782 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.785755 2551 scope.go:117] "RemoveContainer" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" May 29 20:38:11.785990 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:11.785973 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": container with ID starting with 1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7 not found: ID does not exist" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" May 29 20:38:11.786037 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.785993 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7"} err="failed to get container status \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": rpc error: code = NotFound desc = could not find container \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": container with ID starting with 1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7 not found: ID does not exist" May 29 20:38:11.786037 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.786007 2551 scope.go:117] "RemoveContainer" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" May 29 20:38:11.786234 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:11.786219 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": container with ID starting with 1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e not found: ID does not exist" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" May 29 20:38:11.786269 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.786239 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e"} err="failed to get container status \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": rpc error: code = NotFound desc = could not find container \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": container with ID starting with 1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e not found: ID does not exist" May 29 20:38:11.786269 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.786258 2551 scope.go:117] "RemoveContainer" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" May 29 20:38:11.786483 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:11.786466 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": container with ID starting with 79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29 not found: ID does not exist" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" May 29 20:38:11.786559 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.786489 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29"} err="failed to get container status \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": rpc error: code = NotFound desc = could not find container \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": container with ID starting with 79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29 not found: ID does not exist" May 29 20:38:11.786559 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.786506 2551 scope.go:117] "RemoveContainer" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" May 29 20:38:11.786827 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:11.786808 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": container with ID starting with bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3 not found: ID does not exist" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" May 29 20:38:11.786888 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.786831 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3"} err="failed to get container status \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": rpc error: code = NotFound desc = could not find container \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": container with ID starting with bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3 not found: ID does not exist" May 29 20:38:11.786888 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.786845 2551 scope.go:117] "RemoveContainer" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" May 29 20:38:11.787232 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:11.787123 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": container with ID starting with 186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97 not found: ID does not exist" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" May 29 20:38:11.787310 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.787251 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97"} err="failed to get container status \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": rpc error: code = NotFound desc = could not find container \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": container with ID starting with 186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97 not found: ID does not exist" May 29 20:38:11.787310 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.787288 2551 scope.go:117] "RemoveContainer" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" May 29 20:38:11.787583 ip-10-0-138-100 kubenswrapper[2551]: E0529 20:38:11.787554 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": container with ID starting with f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b not found: ID does not exist" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" May 29 20:38:11.787677 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.787589 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b"} err="failed to get container status \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": rpc error: code = NotFound desc = could not find container \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": container with ID starting with f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b not found: ID does not exist" May 29 20:38:11.787677 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.787610 2551 scope.go:117] "RemoveContainer" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" May 29 20:38:11.787883 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.787863 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23"} err="failed to get container status \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": rpc error: code = NotFound desc = could not find container \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": container with ID starting with a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23 not found: ID does not exist" May 29 20:38:11.787931 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.787885 2551 scope.go:117] "RemoveContainer" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" May 29 20:38:11.788108 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788090 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7"} err="failed to get container status \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": rpc error: code = NotFound desc = could not find container \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": container with ID starting with 1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7 not found: ID does not exist" May 29 20:38:11.788151 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788110 2551 scope.go:117] "RemoveContainer" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" May 29 20:38:11.788318 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788302 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e"} err="failed to get container status \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": rpc error: code = NotFound desc = could not find container \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": container with ID starting with 1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e not found: ID does not exist" May 29 20:38:11.788318 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788317 2551 scope.go:117] "RemoveContainer" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" May 29 20:38:11.788496 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788478 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29"} err="failed to get container status \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": rpc error: code = NotFound desc = could not find container \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": container with ID starting with 79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29 not found: ID does not exist" May 29 20:38:11.788554 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788496 2551 scope.go:117] "RemoveContainer" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" May 29 20:38:11.788720 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788701 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3"} err="failed to get container status \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": rpc error: code = NotFound desc = could not find container \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": container with ID starting with bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3 not found: ID does not exist" May 29 20:38:11.788720 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788719 2551 scope.go:117] "RemoveContainer" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" May 29 20:38:11.788905 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788886 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97"} err="failed to get container status \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": rpc error: code = NotFound desc = could not find container \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": container with ID starting with 186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97 not found: ID does not exist" May 29 20:38:11.788905 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.788901 2551 scope.go:117] "RemoveContainer" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" May 29 20:38:11.789086 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.789070 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b"} err="failed to get container status \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": rpc error: code = NotFound desc = could not find container \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": container with ID starting with f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b not found: ID does not exist" May 29 20:38:11.789086 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.789086 2551 scope.go:117] "RemoveContainer" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" May 29 20:38:11.789292 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.789270 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23"} err="failed to get container status \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": rpc error: code = NotFound desc = could not find container \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": container with ID starting with a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23 not found: ID does not exist" May 29 20:38:11.789292 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.789289 2551 scope.go:117] "RemoveContainer" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" May 29 20:38:11.789510 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.789493 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7"} err="failed to get container status \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": rpc error: code = NotFound desc = could not find container \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": container with ID starting with 1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7 not found: ID does not exist" May 29 20:38:11.789629 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.789510 2551 scope.go:117] "RemoveContainer" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" May 29 20:38:11.791872 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.791845 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e"} err="failed to get container status \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": rpc error: code = NotFound desc = could not find container \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": container with ID starting with 1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e not found: ID does not exist" May 29 20:38:11.791872 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.791871 2551 scope.go:117] "RemoveContainer" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" May 29 20:38:11.792339 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.792321 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29"} err="failed to get container status \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": rpc error: code = NotFound desc = could not find container \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": container with ID starting with 79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29 not found: ID does not exist" May 29 20:38:11.792395 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.792343 2551 scope.go:117] "RemoveContainer" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" May 29 20:38:11.792607 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.792588 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3"} err="failed to get container status \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": rpc error: code = NotFound desc = could not find container \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": container with ID starting with bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3 not found: ID does not exist" May 29 20:38:11.792667 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.792607 2551 scope.go:117] "RemoveContainer" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" May 29 20:38:11.792843 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.792828 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97"} err="failed to get container status \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": rpc error: code = NotFound desc = could not find container \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": container with ID starting with 186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97 not found: ID does not exist" May 29 20:38:11.792895 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.792844 2551 scope.go:117] "RemoveContainer" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" May 29 20:38:11.793086 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793063 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b"} err="failed to get container status \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": rpc error: code = NotFound desc = could not find container \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": container with ID starting with f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b not found: ID does not exist" May 29 20:38:11.793086 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793085 2551 scope.go:117] "RemoveContainer" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" May 29 20:38:11.793331 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793310 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23"} err="failed to get container status \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": rpc error: code = NotFound desc = could not find container \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": container with ID starting with a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23 not found: ID does not exist" May 29 20:38:11.793382 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793332 2551 scope.go:117] "RemoveContainer" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" May 29 20:38:11.793551 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793533 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7"} err="failed to get container status \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": rpc error: code = NotFound desc = could not find container \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": container with ID starting with 1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7 not found: ID does not exist" May 29 20:38:11.793593 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793552 2551 scope.go:117] "RemoveContainer" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" May 29 20:38:11.793736 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793720 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e"} err="failed to get container status \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": rpc error: code = NotFound desc = could not find container \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": container with ID starting with 1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e not found: ID does not exist" May 29 20:38:11.793780 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793736 2551 scope.go:117] "RemoveContainer" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" May 29 20:38:11.793918 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793904 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29"} err="failed to get container status \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": rpc error: code = NotFound desc = could not find container \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": container with ID starting with 79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29 not found: ID does not exist" May 29 20:38:11.793957 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.793917 2551 scope.go:117] "RemoveContainer" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" May 29 20:38:11.794089 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794074 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3"} err="failed to get container status \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": rpc error: code = NotFound desc = could not find container \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": container with ID starting with bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3 not found: ID does not exist" May 29 20:38:11.794126 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794089 2551 scope.go:117] "RemoveContainer" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" May 29 20:38:11.794240 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794222 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97"} err="failed to get container status \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": rpc error: code = NotFound desc = could not find container \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": container with ID starting with 186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97 not found: ID does not exist" May 29 20:38:11.794293 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794241 2551 scope.go:117] "RemoveContainer" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" May 29 20:38:11.794445 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794427 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b"} err="failed to get container status \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": rpc error: code = NotFound desc = could not find container \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": container with ID starting with f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b not found: ID does not exist" May 29 20:38:11.794492 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794446 2551 scope.go:117] "RemoveContainer" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" May 29 20:38:11.794673 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794627 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23"} err="failed to get container status \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": rpc error: code = NotFound desc = could not find container \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": container with ID starting with a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23 not found: ID does not exist" May 29 20:38:11.794727 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794673 2551 scope.go:117] "RemoveContainer" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" May 29 20:38:11.794973 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794945 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7"} err="failed to get container status \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": rpc error: code = NotFound desc = could not find container \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": container with ID starting with 1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7 not found: ID does not exist" May 29 20:38:11.794973 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.794972 2551 scope.go:117] "RemoveContainer" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" May 29 20:38:11.795428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.795260 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e"} err="failed to get container status \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": rpc error: code = NotFound desc = could not find container \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": container with ID starting with 1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e not found: ID does not exist" May 29 20:38:11.795428 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.795285 2551 scope.go:117] "RemoveContainer" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" May 29 20:38:11.795659 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.795606 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29"} err="failed to get container status \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": rpc error: code = NotFound desc = could not find container \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": container with ID starting with 79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29 not found: ID does not exist" May 29 20:38:11.795760 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.795662 2551 scope.go:117] "RemoveContainer" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" May 29 20:38:11.796018 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.795992 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3"} err="failed to get container status \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": rpc error: code = NotFound desc = could not find container \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": container with ID starting with bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3 not found: ID does not exist" May 29 20:38:11.796018 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796017 2551 scope.go:117] "RemoveContainer" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" May 29 20:38:11.796268 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796243 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97"} err="failed to get container status \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": rpc error: code = NotFound desc = could not find container \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": container with ID starting with 186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97 not found: ID does not exist" May 29 20:38:11.796346 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796271 2551 scope.go:117] "RemoveContainer" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" May 29 20:38:11.796556 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796503 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b"} err="failed to get container status \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": rpc error: code = NotFound desc = could not find container \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": container with ID starting with f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b not found: ID does not exist" May 29 20:38:11.796556 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796536 2551 scope.go:117] "RemoveContainer" containerID="a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23" May 29 20:38:11.796771 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796743 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23"} err="failed to get container status \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": rpc error: code = NotFound desc = could not find container \"a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23\": container with ID starting with a9ac53d7a5c922e519dcf814401f3d893bc25c4e3b45abddcee03fa519745b23 not found: ID does not exist" May 29 20:38:11.796771 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796764 2551 scope.go:117] "RemoveContainer" containerID="1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7" May 29 20:38:11.796987 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796968 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:38:11.797072 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.796987 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7"} err="failed to get container status \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": rpc error: code = NotFound desc = could not find container \"1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7\": container with ID starting with 1b816779becef5e2890aa08ef62f145f8ac77068ece6c55fa3be9a424b19adc7 not found: ID does not exist" May 29 20:38:11.797072 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797007 2551 scope.go:117] "RemoveContainer" containerID="1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e" May 29 20:38:11.797249 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797224 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e"} err="failed to get container status \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": rpc error: code = NotFound desc = could not find container \"1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e\": container with ID starting with 1dbd386a767c7ca4962e9f9fdf80c31c902b9d8ac746a1abbbc98f0bd866e51e not found: ID does not exist" May 29 20:38:11.797304 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797251 2551 scope.go:117] "RemoveContainer" containerID="79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29" May 29 20:38:11.797304 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797299 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="prometheus" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797310 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="prometheus" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797318 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="config-reloader" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797328 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="config-reloader" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797340 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="thanos-sidecar" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797346 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="thanos-sidecar" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797358 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy-web" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797363 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy-web" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797373 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="init-config-reloader" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797379 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="init-config-reloader" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797389 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy" May 29 20:38:11.797397 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797397 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797416 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy-thanos" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797424 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy-thanos" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797436 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29"} err="failed to get container status \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": rpc error: code = NotFound desc = could not find container \"79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29\": container with ID starting with 79c340051aea13111b62ec7ec9870a0f9e87029ea1db731a926c01e2f1427f29 not found: ID does not exist" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797456 2551 scope.go:117] "RemoveContainer" containerID="bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797492 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy-thanos" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797507 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797535 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="prometheus" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797549 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="kube-rbac-proxy-web" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797558 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="thanos-sidecar" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797566 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" containerName="config-reloader" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797687 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3"} err="failed to get container status \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": rpc error: code = NotFound desc = could not find container \"bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3\": container with ID starting with bb837f19d1e6ab0f4344ba783849cf7f15d63870dba11be05fcaf07322fc6eb3 not found: ID does not exist" May 29 20:38:11.797817 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797717 2551 scope.go:117] "RemoveContainer" containerID="186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97" May 29 20:38:11.798220 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797968 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97"} err="failed to get container status \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": rpc error: code = NotFound desc = could not find container \"186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97\": container with ID starting with 186751900d15026536e7e6680511dea78ca6e7f7314d9b9fc9c7606f39ceaa97 not found: ID does not exist" May 29 20:38:11.798220 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.797987 2551 scope.go:117] "RemoveContainer" containerID="f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b" May 29 20:38:11.798220 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.798198 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b"} err="failed to get container status \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": rpc error: code = NotFound desc = could not find container \"f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b\": container with ID starting with f77af6015d83bb989b3d6be5dd39d85b7037290ba0762e4cc410e4c7207d5a0b not found: ID does not exist" May 29 20:38:11.801421 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.801405 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.803878 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.803862 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 20:38:11.803968 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.803867 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 20:38:11.804052 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804029 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 20:38:11.804138 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804039 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 20:38:11.804276 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804263 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 20:38:11.804352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804273 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 20:38:11.804352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804262 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 20:38:11.804352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804304 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 20:38:11.804352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804313 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 20:38:11.804352 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804314 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 20:38:11.804594 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804269 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nlfn6\"" May 29 20:38:11.804705 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.804690 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2qqj1u9pdmhp4\"" May 29 20:38:11.805023 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.805006 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 20:38:11.808668 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.808651 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 20:38:11.810177 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.810158 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 20:38:11.817166 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.817145 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:38:11.878367 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878338 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878367 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878375 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878398 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878422 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878487 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4dcd9d75-ca19-4970-9c38-ed2b977209c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878538 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878559 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878586 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878575 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878617 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878642 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878685 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878715 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4dcd9d75-ca19-4970-9c38-ed2b977209c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878736 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878764 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878755 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878930 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878781 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-config\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878930 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878803 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878930 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878828 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8x5p\" (UniqueName: \"kubernetes.io/projected/4dcd9d75-ca19-4970-9c38-ed2b977209c0-kube-api-access-p8x5p\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.878930 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.878848 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.979994 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.979904 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.979994 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.979941 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.979994 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.979975 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-config\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980000 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980028 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8x5p\" (UniqueName: \"kubernetes.io/projected/4dcd9d75-ca19-4970-9c38-ed2b977209c0-kube-api-access-p8x5p\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980149 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980186 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980218 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980250 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980275 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980273 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980300 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4dcd9d75-ca19-4970-9c38-ed2b977209c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980351 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980391 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980414 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980444 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980477 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980503 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.980678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980581 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4dcd9d75-ca19-4970-9c38-ed2b977209c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.981075 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980739 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.981075 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.980787 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.983536 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.983190 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.983536 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.983271 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.983536 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.983320 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-config\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.983536 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.983532 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.983876 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.983571 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4dcd9d75-ca19-4970-9c38-ed2b977209c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.983876 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.983647 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.984138 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.984114 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.984393 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.984373 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.984463 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.984380 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.984549 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.984509 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4dcd9d75-ca19-4970-9c38-ed2b977209c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.984881 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.984853 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.985437 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.985417 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.985611 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.985592 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.985692 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.985620 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4dcd9d75-ca19-4970-9c38-ed2b977209c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.986260 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.986244 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4dcd9d75-ca19-4970-9c38-ed2b977209c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:11.988942 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:11.988925 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8x5p\" (UniqueName: \"kubernetes.io/projected/4dcd9d75-ca19-4970-9c38-ed2b977209c0-kube-api-access-p8x5p\") pod \"prometheus-k8s-0\" (UID: \"4dcd9d75-ca19-4970-9c38-ed2b977209c0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:12.111492 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:12.111450 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:38:12.245727 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:12.245627 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 20:38:12.248309 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:38:12.248282 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcd9d75_ca19_4970_9c38_ed2b977209c0.slice/crio-57442e94b4e382aaf2b0f2b4af687b19abd7d9cfdc41fd263dfc7d1cf3af505a WatchSource:0}: Error finding container 57442e94b4e382aaf2b0f2b4af687b19abd7d9cfdc41fd263dfc7d1cf3af505a: Status 404 returned error can't find the container with id 57442e94b4e382aaf2b0f2b4af687b19abd7d9cfdc41fd263dfc7d1cf3af505a May 29 20:38:12.742796 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:12.742766 2551 generic.go:358] "Generic (PLEG): container finished" podID="4dcd9d75-ca19-4970-9c38-ed2b977209c0" containerID="13d076b4ef616f0459cd9686443c5119cc63a05f480d35eccf7788137ec0d363" exitCode=0 May 29 20:38:12.743203 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:12.742821 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dcd9d75-ca19-4970-9c38-ed2b977209c0","Type":"ContainerDied","Data":"13d076b4ef616f0459cd9686443c5119cc63a05f480d35eccf7788137ec0d363"} May 29 20:38:12.743203 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:12.742842 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dcd9d75-ca19-4970-9c38-ed2b977209c0","Type":"ContainerStarted","Data":"57442e94b4e382aaf2b0f2b4af687b19abd7d9cfdc41fd263dfc7d1cf3af505a"} May 29 20:38:12.967246 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:12.967214 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d1e48ec-3e75-4c74-babd-c1b2d2b10494" path="/var/lib/kubelet/pods/2d1e48ec-3e75-4c74-babd-c1b2d2b10494/volumes" May 29 20:38:13.748188 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:13.748153 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dcd9d75-ca19-4970-9c38-ed2b977209c0","Type":"ContainerStarted","Data":"97639558c405e1ab71f0e2c5cfe2ab3686b973363ec5ee6f9398ee25da44adc6"} May 29 20:38:13.748188 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:13.748188 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dcd9d75-ca19-4970-9c38-ed2b977209c0","Type":"ContainerStarted","Data":"b1eda2a0b654cafd4cfd20e1525a2e09f1801831d907e1cbcd94606f7371f538"} May 29 20:38:13.748188 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:13.748198 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dcd9d75-ca19-4970-9c38-ed2b977209c0","Type":"ContainerStarted","Data":"1bee12e6854fc5692de8f4d4d183e767d34adff8f23a65800fdd4b6d6ccdc89f"} May 29 20:38:13.748671 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:13.748207 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dcd9d75-ca19-4970-9c38-ed2b977209c0","Type":"ContainerStarted","Data":"d33b2f0a8375f3206534df5972667d2b61d5015e01451b3e94bc8339a17bff9f"} May 29 20:38:13.748671 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:13.748215 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dcd9d75-ca19-4970-9c38-ed2b977209c0","Type":"ContainerStarted","Data":"2cadfaa245be7aa658439e0a3e09cdccfd2f33904c4a053a99232370dd7a24da"} May 29 20:38:13.748671 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:13.748227 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dcd9d75-ca19-4970-9c38-ed2b977209c0","Type":"ContainerStarted","Data":"68c08d74a03124f6196340a9c2476dfabe49847ebc9846401678e6558d0d3879"} May 29 20:38:13.779172 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:13.779111 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.779094442 podStartE2EDuration="2.779094442s" podCreationTimestamp="2026-05-29 20:38:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:38:13.777407056 +0000 UTC m=+217.650044237" watchObservedRunningTime="2026-05-29 20:38:13.779094442 +0000 UTC m=+217.651731625" May 29 20:38:17.111959 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:38:17.111919 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:39:12.112379 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:12.112284 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:39:12.127843 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:12.127817 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:39:12.937043 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:12.937018 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 20:39:36.828388 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:36.828360 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/2.log" May 29 20:39:36.834664 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:36.834636 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/2.log" May 29 20:39:36.835941 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:36.835919 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-acl-logging/0.log" May 29 20:39:36.839876 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:36.839857 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-acl-logging/0.log" May 29 20:39:36.841181 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:36.841161 2551 kubelet.go:1628] "Image garbage collection succeeded" May 29 20:39:45.433997 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.433958 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-42qbr"] May 29 20:39:45.436226 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.436209 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.438806 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.438781 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 20:39:45.448462 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.448441 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-42qbr"] May 29 20:39:45.566616 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.566574 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dff3faf-1b54-4828-b0b6-67e58f496de8-dbus\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.566798 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.566684 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dff3faf-1b54-4828-b0b6-67e58f496de8-original-pull-secret\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.566798 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.566734 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dff3faf-1b54-4828-b0b6-67e58f496de8-kubelet-config\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.667867 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.667834 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dff3faf-1b54-4828-b0b6-67e58f496de8-kubelet-config\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.668036 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.667877 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dff3faf-1b54-4828-b0b6-67e58f496de8-dbus\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.668036 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.667944 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dff3faf-1b54-4828-b0b6-67e58f496de8-original-pull-secret\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.668036 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.667958 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dff3faf-1b54-4828-b0b6-67e58f496de8-kubelet-config\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.668139 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.668079 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dff3faf-1b54-4828-b0b6-67e58f496de8-dbus\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.670136 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.670118 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dff3faf-1b54-4828-b0b6-67e58f496de8-original-pull-secret\") pod \"global-pull-secret-syncer-42qbr\" (UID: \"8dff3faf-1b54-4828-b0b6-67e58f496de8\") " pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.745610 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.745485 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42qbr" May 29 20:39:45.870759 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.870733 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-42qbr"] May 29 20:39:45.873339 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:39:45.873311 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dff3faf_1b54_4828_b0b6_67e58f496de8.slice/crio-a7bc1561101f3845c553ccc901106e2d81173b6c06726144dda5e94e8650947b WatchSource:0}: Error finding container a7bc1561101f3845c553ccc901106e2d81173b6c06726144dda5e94e8650947b: Status 404 returned error can't find the container with id a7bc1561101f3845c553ccc901106e2d81173b6c06726144dda5e94e8650947b May 29 20:39:45.874932 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:45.874917 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 20:39:46.021670 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:46.021582 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-42qbr" event={"ID":"8dff3faf-1b54-4828-b0b6-67e58f496de8","Type":"ContainerStarted","Data":"a7bc1561101f3845c553ccc901106e2d81173b6c06726144dda5e94e8650947b"} May 29 20:39:50.036189 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:50.036152 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-42qbr" event={"ID":"8dff3faf-1b54-4828-b0b6-67e58f496de8","Type":"ContainerStarted","Data":"096fb8359aee9cd78ce71f47f5c8d1afbeac4028220d99aaf1ad4050af8c9748"} May 29 20:39:50.057542 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:39:50.053831 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-42qbr" podStartSLOduration=1.328439141 podStartE2EDuration="5.053813129s" podCreationTimestamp="2026-05-29 20:39:45 +0000 UTC" firstStartedPulling="2026-05-29 20:39:45.875066716 +0000 UTC m=+309.747703876" lastFinishedPulling="2026-05-29 20:39:49.600440684 +0000 UTC m=+313.473077864" observedRunningTime="2026-05-29 20:39:50.052239493 +0000 UTC m=+313.924876677" watchObservedRunningTime="2026-05-29 20:39:50.053813129 +0000 UTC m=+313.926450314" May 29 20:40:12.586593 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:12.586559 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-42qbr_8dff3faf-1b54-4828-b0b6-67e58f496de8/global-pull-secret-syncer/0.log" May 29 20:40:12.777609 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:12.777578 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5jfcl_474a0bc1-0455-4d61-8c50-7288545cdd8d/konnectivity-agent/0.log" May 29 20:40:12.860305 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:12.860227 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-100.ec2.internal_01d3640ada4dbd31bc20de996727f289/haproxy/0.log" May 29 20:40:15.244816 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.244782 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3/alertmanager/0.log" May 29 20:40:15.277273 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.277242 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3/config-reloader/0.log" May 29 20:40:15.313220 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.313193 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3/kube-rbac-proxy-web/0.log" May 29 20:40:15.352306 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.352284 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3/kube-rbac-proxy/0.log" May 29 20:40:15.395172 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.395147 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3/kube-rbac-proxy-metric/0.log" May 29 20:40:15.463283 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.463255 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3/prom-label-proxy/0.log" May 29 20:40:15.526414 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.526347 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c4d6287-58ff-4d0a-9dd2-4dbf422c26c3/init-config-reloader/0.log" May 29 20:40:15.645557 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.645509 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-ptxgz_8e5e54ff-6512-4b23-ac0f-3370a8be7c90/kube-state-metrics/0.log" May 29 20:40:15.682366 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.682337 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-ptxgz_8e5e54ff-6512-4b23-ac0f-3370a8be7c90/kube-rbac-proxy-main/0.log" May 29 20:40:15.711473 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:15.711447 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-ptxgz_8e5e54ff-6512-4b23-ac0f-3370a8be7c90/kube-rbac-proxy-self/0.log" May 29 20:40:16.066443 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.066365 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-whn5n_b16293a7-e6f7-49b7-8669-1552ee6be5a6/node-exporter/0.log" May 29 20:40:16.097138 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.097113 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-whn5n_b16293a7-e6f7-49b7-8669-1552ee6be5a6/kube-rbac-proxy/0.log" May 29 20:40:16.124502 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.124479 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-whn5n_b16293a7-e6f7-49b7-8669-1552ee6be5a6/init-textfile/0.log" May 29 20:40:16.156080 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.156054 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-zk258_535ad954-ae5e-431c-b028-67c8e20487af/kube-rbac-proxy-main/0.log" May 29 20:40:16.185116 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.185090 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-zk258_535ad954-ae5e-431c-b028-67c8e20487af/kube-rbac-proxy-self/0.log" May 29 20:40:16.209683 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.209659 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-zk258_535ad954-ae5e-431c-b028-67c8e20487af/openshift-state-metrics/0.log" May 29 20:40:16.249541 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.249502 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dcd9d75-ca19-4970-9c38-ed2b977209c0/prometheus/0.log" May 29 20:40:16.279752 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.279730 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dcd9d75-ca19-4970-9c38-ed2b977209c0/config-reloader/0.log" May 29 20:40:16.308819 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.308795 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dcd9d75-ca19-4970-9c38-ed2b977209c0/thanos-sidecar/0.log" May 29 20:40:16.334081 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.334012 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dcd9d75-ca19-4970-9c38-ed2b977209c0/kube-rbac-proxy-web/0.log" May 29 20:40:16.363344 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.363322 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dcd9d75-ca19-4970-9c38-ed2b977209c0/kube-rbac-proxy/0.log" May 29 20:40:16.389325 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.389296 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dcd9d75-ca19-4970-9c38-ed2b977209c0/kube-rbac-proxy-thanos/0.log" May 29 20:40:16.422909 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.422881 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dcd9d75-ca19-4970-9c38-ed2b977209c0/init-config-reloader/0.log" May 29 20:40:16.544565 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.544536 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-4hrxt_2e9884f8-f66a-4cd8-b37a-eda444ec43c6/prometheus-operator-admission-webhook/0.log" May 29 20:40:16.680200 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.680176 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845fbcfdcb-zxlhs_1a1b94ef-bbfd-4930-9e36-a08093cbb883/thanos-query/0.log" May 29 20:40:16.724818 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.724797 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845fbcfdcb-zxlhs_1a1b94ef-bbfd-4930-9e36-a08093cbb883/kube-rbac-proxy-web/0.log" May 29 20:40:16.795432 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.795404 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845fbcfdcb-zxlhs_1a1b94ef-bbfd-4930-9e36-a08093cbb883/kube-rbac-proxy/0.log" May 29 20:40:16.864942 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.864871 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845fbcfdcb-zxlhs_1a1b94ef-bbfd-4930-9e36-a08093cbb883/prom-label-proxy/0.log" May 29 20:40:16.952014 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.951986 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845fbcfdcb-zxlhs_1a1b94ef-bbfd-4930-9e36-a08093cbb883/kube-rbac-proxy-rules/0.log" May 29 20:40:16.983841 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:16.983810 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845fbcfdcb-zxlhs_1a1b94ef-bbfd-4930-9e36-a08093cbb883/kube-rbac-proxy-metrics/0.log" May 29 20:40:18.539138 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.539106 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/2.log" May 29 20:40:18.543122 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.543103 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-z7z9m_5a5c4037-1bac-48cc-a663-c172c9b959e1/console-operator/3.log" May 29 20:40:18.846185 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.846150 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj"] May 29 20:40:18.849824 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.849802 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:18.852125 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.852110 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-87jkr\"/\"default-dockercfg-njmn5\"" May 29 20:40:18.852211 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.852124 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87jkr\"/\"openshift-service-ca.crt\"" May 29 20:40:18.852211 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.852124 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87jkr\"/\"kube-root-ca.crt\"" May 29 20:40:18.857179 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.857156 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj"] May 29 20:40:18.923680 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.923643 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-lib-modules\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:18.923871 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.923696 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-podres\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:18.923871 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.923762 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-proc\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:18.923871 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.923809 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-sys\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:18.923871 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:18.923849 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79t9k\" (UniqueName: \"kubernetes.io/projected/0bf12da5-09d2-4368-ae59-4fb024706e85-kube-api-access-79t9k\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024268 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024222 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-proc\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024268 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024277 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-sys\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024501 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024307 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79t9k\" (UniqueName: \"kubernetes.io/projected/0bf12da5-09d2-4368-ae59-4fb024706e85-kube-api-access-79t9k\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024501 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024337 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-lib-modules\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024501 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024366 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-podres\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024501 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024361 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-proc\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024501 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024425 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-sys\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024501 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024490 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-lib-modules\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.024501 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.024491 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bf12da5-09d2-4368-ae59-4fb024706e85-podres\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.033452 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.033432 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79t9k\" (UniqueName: \"kubernetes.io/projected/0bf12da5-09d2-4368-ae59-4fb024706e85-kube-api-access-79t9k\") pod \"perf-node-gather-daemonset-tgmqj\" (UID: \"0bf12da5-09d2-4368-ae59-4fb024706e85\") " pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.160706 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.160672 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:19.289032 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:19.289003 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj"] May 29 20:40:19.292927 ip-10-0-138-100 kubenswrapper[2551]: W0529 20:40:19.292904 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0bf12da5_09d2_4368_ae59_4fb024706e85.slice/crio-a80a4ab2232007ae7bc74c04c2ff95fb99589da3ecb3211bd790406eebc0105d WatchSource:0}: Error finding container a80a4ab2232007ae7bc74c04c2ff95fb99589da3ecb3211bd790406eebc0105d: Status 404 returned error can't find the container with id a80a4ab2232007ae7bc74c04c2ff95fb99589da3ecb3211bd790406eebc0105d May 29 20:40:20.014449 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:20.014422 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vn2sw_369261b1-d15d-4ebb-b917-d226cbe15df2/dns/0.log" May 29 20:40:20.035649 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:20.035577 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vn2sw_369261b1-d15d-4ebb-b917-d226cbe15df2/kube-rbac-proxy/0.log" May 29 20:40:20.101492 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:20.101463 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l85tw_442072e3-d69d-41f9-aa51-be411b2779d8/dns-node-resolver/0.log" May 29 20:40:20.128534 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:20.128487 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" event={"ID":"0bf12da5-09d2-4368-ae59-4fb024706e85","Type":"ContainerStarted","Data":"6f047f0fbd4c06effcd49e86cd9da42ef9adaf69900e6366ee3fd27c38558138"} May 29 20:40:20.128534 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:20.128531 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" event={"ID":"0bf12da5-09d2-4368-ae59-4fb024706e85","Type":"ContainerStarted","Data":"a80a4ab2232007ae7bc74c04c2ff95fb99589da3ecb3211bd790406eebc0105d"} May 29 20:40:20.128763 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:20.128555 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:20.146721 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:20.146669 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" podStartSLOduration=2.146655409 podStartE2EDuration="2.146655409s" podCreationTimestamp="2026-05-29 20:40:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:40:20.146037415 +0000 UTC m=+344.018674596" watchObservedRunningTime="2026-05-29 20:40:20.146655409 +0000 UTC m=+344.019292591" May 29 20:40:20.623748 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:20.623718 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nnhvx_c9c8631f-eea5-4184-aa19-e53c413b83a0/node-ca/0.log" May 29 20:40:21.716949 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:21.716920 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-psvfr_53193993-66d7-4d8e-ad4c-2cfed635ac59/serve-healthcheck-canary/0.log" May 29 20:40:22.256574 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:22.256549 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wbggh_c9906f14-6f9b-4812-8fd8-0eab762db2ca/kube-rbac-proxy/0.log" May 29 20:40:22.283062 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:22.283033 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wbggh_c9906f14-6f9b-4812-8fd8-0eab762db2ca/exporter/0.log" May 29 20:40:22.312010 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:22.311989 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wbggh_c9906f14-6f9b-4812-8fd8-0eab762db2ca/extractor/0.log" May 29 20:40:26.141098 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:26.141068 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-87jkr/perf-node-gather-daemonset-tgmqj" May 29 20:40:26.387130 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:26.387096 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-xqr2m_316bb3bc-606a-4901-aed2-0a5babbe670b/migrator/0.log" May 29 20:40:26.409510 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:26.409437 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-xqr2m_316bb3bc-606a-4901-aed2-0a5babbe670b/graceful-termination/0.log" May 29 20:40:26.726469 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:26.726394 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-q7qdd_a8ea1ac4-5d53-436f-b509-dc2346412523/kube-storage-version-migrator-operator/1.log" May 29 20:40:26.727265 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:26.727247 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-q7qdd_a8ea1ac4-5d53-436f-b509-dc2346412523/kube-storage-version-migrator-operator/0.log" May 29 20:40:27.662599 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:27.662568 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9c275_2556e896-125e-4055-8b95-a7b4fad103dd/kube-multus/0.log" May 29 20:40:27.692490 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:27.692463 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tczx_d4abbd14-0a52-432e-b13b-a727b13d0af7/kube-multus-additional-cni-plugins/0.log" May 29 20:40:27.717120 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:27.717097 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tczx_d4abbd14-0a52-432e-b13b-a727b13d0af7/egress-router-binary-copy/0.log" May 29 20:40:27.789131 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:27.789106 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tczx_d4abbd14-0a52-432e-b13b-a727b13d0af7/cni-plugins/0.log" May 29 20:40:27.821660 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:27.821600 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tczx_d4abbd14-0a52-432e-b13b-a727b13d0af7/bond-cni-plugin/0.log" May 29 20:40:27.847372 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:27.847349 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tczx_d4abbd14-0a52-432e-b13b-a727b13d0af7/routeoverride-cni/0.log" May 29 20:40:27.870467 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:27.870446 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tczx_d4abbd14-0a52-432e-b13b-a727b13d0af7/whereabouts-cni-bincopy/0.log" May 29 20:40:27.893715 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:27.893689 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tczx_d4abbd14-0a52-432e-b13b-a727b13d0af7/whereabouts-cni/0.log" May 29 20:40:28.372423 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:28.372383 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2lh64_0c41df73-e24e-4b29-8408-e96237e180de/network-metrics-daemon/0.log" May 29 20:40:28.398088 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:28.398044 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2lh64_0c41df73-e24e-4b29-8408-e96237e180de/kube-rbac-proxy/0.log" May 29 20:40:29.902135 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:29.902111 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-controller/0.log" May 29 20:40:29.924500 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:29.924478 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-acl-logging/0.log" May 29 20:40:29.926216 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:29.926201 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovn-acl-logging/1.log" May 29 20:40:29.946505 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:29.946488 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/kube-rbac-proxy-node/0.log" May 29 20:40:29.969431 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:29.969409 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/kube-rbac-proxy-ovn-metrics/0.log" May 29 20:40:29.989319 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:29.989255 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/northd/0.log" May 29 20:40:30.010478 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:30.010455 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/nbdb/0.log" May 29 20:40:30.032530 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:30.032507 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/sbdb/0.log" May 29 20:40:30.136491 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:30.136458 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdc94_e22f5f5a-58aa-4bb0-9384-9e15d81c74de/ovnkube-controller/0.log" May 29 20:40:31.119911 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:31.119878 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pd62t_91afabc6-d251-4003-9185-00a9f362a82b/network-check-target-container/0.log" May 29 20:40:32.145678 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:32.145654 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-2t5dr_776c8f3d-8ded-4fb6-982a-36fed858beb3/iptables-alerter/0.log" May 29 20:40:32.805589 ip-10-0-138-100 kubenswrapper[2551]: I0529 20:40:32.805559 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4hnf5_be09a3ab-0870-4d32-9031-b969a978b0fb/tuned/0.log"