May 29 00:47:17.953113 ip-10-0-131-222 systemd[1]: Starting Kubernetes Kubelet... May 29 00:47:18.481408 ip-10-0-131-222 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 00:47:18.481408 ip-10-0-131-222 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 00:47:18.481408 ip-10-0-131-222 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 00:47:18.481408 ip-10-0-131-222 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 00:47:18.481408 ip-10-0-131-222 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 00:47:18.484770 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.484663 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 00:47:18.493500 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493471 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:18.493500 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493496 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:18.493500 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493499 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:18.493500 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493502 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:18.493500 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493506 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:18.493500 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493510 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493513 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493516 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493519 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493521 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493524 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493527 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493530 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493532 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493535 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493538 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493542 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493544 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493547 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493549 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493552 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493554 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493558 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493560 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493562 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:18.493783 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493565 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493567 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493570 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493572 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493575 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493577 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493580 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493582 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493585 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493588 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493590 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493592 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493595 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493597 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493600 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493604 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493606 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493609 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493614 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493616 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:18.494307 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493619 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493621 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493623 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493627 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493629 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493631 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493634 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493636 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493639 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493641 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493644 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493646 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493649 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493652 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493654 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493657 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493659 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493662 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493664 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493667 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:18.494828 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493669 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493694 2563 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493698 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493701 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493704 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493707 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493712 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493715 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493718 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493738 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493742 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493745 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493747 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493751 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493754 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493758 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493762 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493765 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493768 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:18.495313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493771 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.493774 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494209 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494215 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494218 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494221 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494224 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494227 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494229 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494232 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494235 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494237 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494240 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494242 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494245 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494247 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494250 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494252 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494255 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:18.495787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494259 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494262 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494265 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494268 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494272 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494276 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494279 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494283 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494286 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494289 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494292 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494294 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494297 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494300 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494302 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494305 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494308 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494310 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494313 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:18.496244 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494316 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494318 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494321 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494323 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494326 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494328 2563 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494331 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494333 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494336 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494338 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494341 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494343 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494347 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494351 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494354 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494356 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494359 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494362 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494365 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494367 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:18.496764 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494370 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494373 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494375 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494377 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494380 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494382 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494385 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494387 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494389 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494392 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494394 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494397 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494399 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494401 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494404 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494406 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494409 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494412 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494415 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494417 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:18.497270 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494419 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494422 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494424 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494427 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494430 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494433 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494436 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494438 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494440 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.494458 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495065 2563 flags.go:64] FLAG: --address="0.0.0.0" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495074 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495081 2563 flags.go:64] FLAG: --anonymous-auth="true" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495086 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495091 2563 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495094 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495099 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495103 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495106 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495109 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495113 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 00:47:18.497787 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495116 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495119 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495122 2563 flags.go:64] FLAG: --cgroup-root="" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495125 2563 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495127 2563 flags.go:64] FLAG: --client-ca-file="" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495130 2563 flags.go:64] FLAG: --cloud-config="" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495133 2563 flags.go:64] FLAG: --cloud-provider="external" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495136 2563 flags.go:64] FLAG: --cluster-dns="[]" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495140 2563 flags.go:64] FLAG: --cluster-domain="" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495143 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495147 2563 flags.go:64] FLAG: --config-dir="" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495150 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495153 2563 flags.go:64] FLAG: --container-log-max-files="5" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495157 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495160 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495163 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495167 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495170 2563 flags.go:64] FLAG: --contention-profiling="false" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495173 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495176 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495179 2563 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495182 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495186 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495189 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495192 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 00:47:18.498315 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495195 2563 flags.go:64] FLAG: --enable-load-reader="false" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495199 2563 flags.go:64] FLAG: --enable-server="true" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495202 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495207 2563 flags.go:64] FLAG: --event-burst="100" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495210 2563 flags.go:64] FLAG: --event-qps="50" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495213 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495216 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495219 2563 flags.go:64] FLAG: --eviction-hard="" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495223 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495226 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495228 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495231 2563 flags.go:64] FLAG: --eviction-soft="" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495234 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495237 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495240 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495243 2563 flags.go:64] FLAG: --experimental-mounter-path="" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495245 2563 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495248 2563 flags.go:64] FLAG: --fail-swap-on="true" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495251 2563 flags.go:64] FLAG: --feature-gates="" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495255 2563 flags.go:64] FLAG: --file-check-frequency="20s" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495258 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495261 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495264 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495268 2563 flags.go:64] FLAG: --healthz-port="10248" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495271 2563 flags.go:64] FLAG: --help="false" May 29 00:47:18.498939 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495273 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-131-222.ec2.internal" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495277 2563 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495280 2563 flags.go:64] FLAG: --http-check-frequency="20s" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495283 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495286 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495289 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495292 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495294 2563 flags.go:64] FLAG: --image-service-endpoint="" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495297 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495301 2563 flags.go:64] FLAG: --kube-api-burst="100" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495304 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495307 2563 flags.go:64] FLAG: --kube-api-qps="50" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495310 2563 flags.go:64] FLAG: --kube-reserved="" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495313 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495315 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495319 2563 flags.go:64] FLAG: --kubelet-cgroups="" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495321 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495324 2563 flags.go:64] FLAG: --lock-file="" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495327 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495330 2563 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495333 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495339 2563 flags.go:64] FLAG: --log-json-split-stream="false" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495342 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495345 2563 flags.go:64] FLAG: --log-text-split-stream="false" May 29 00:47:18.499535 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495348 2563 flags.go:64] FLAG: --logging-format="text" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495351 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495355 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495358 2563 flags.go:64] FLAG: --manifest-url="" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495360 2563 flags.go:64] FLAG: --manifest-url-header="" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495366 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495369 2563 flags.go:64] FLAG: --max-open-files="1000000" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495373 2563 flags.go:64] FLAG: --max-pods="110" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495376 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495379 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495382 2563 flags.go:64] FLAG: --memory-manager-policy="None" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495385 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495388 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495391 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495394 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495401 2563 flags.go:64] FLAG: --node-status-max-images="50" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495404 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495407 2563 flags.go:64] FLAG: --oom-score-adj="-999" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495411 2563 flags.go:64] FLAG: --pod-cidr="" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495414 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495419 2563 flags.go:64] FLAG: --pod-manifest-path="" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495422 2563 flags.go:64] FLAG: --pod-max-pids="-1" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495425 2563 flags.go:64] FLAG: --pods-per-core="0" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495428 2563 flags.go:64] FLAG: --port="10250" May 29 00:47:18.500224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495431 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495434 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0047ef650e7f2f348" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495437 2563 flags.go:64] FLAG: --qos-reserved="" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495440 2563 flags.go:64] FLAG: --read-only-port="10255" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495442 2563 flags.go:64] FLAG: --register-node="true" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495445 2563 flags.go:64] FLAG: --register-schedulable="true" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495448 2563 flags.go:64] FLAG: --register-with-taints="" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495452 2563 flags.go:64] FLAG: --registry-burst="10" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495454 2563 flags.go:64] FLAG: --registry-qps="5" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495461 2563 flags.go:64] FLAG: --reserved-cpus="" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495464 2563 flags.go:64] FLAG: --reserved-memory="" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495468 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495471 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495476 2563 flags.go:64] FLAG: --rotate-certificates="false" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495478 2563 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495481 2563 flags.go:64] FLAG: --runonce="false" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495484 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495488 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495491 2563 flags.go:64] FLAG: --seccomp-default="false" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495494 2563 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495497 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495500 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495503 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495506 2563 flags.go:64] FLAG: --storage-driver-password="root" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495509 2563 flags.go:64] FLAG: --storage-driver-secure="false" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495512 2563 flags.go:64] FLAG: --storage-driver-table="stats" May 29 00:47:18.500835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495514 2563 flags.go:64] FLAG: --storage-driver-user="root" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495518 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495521 2563 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495524 2563 flags.go:64] FLAG: --system-cgroups="" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495527 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495533 2563 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495536 2563 flags.go:64] FLAG: --tls-cert-file="" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495539 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495543 2563 flags.go:64] FLAG: --tls-min-version="" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495546 2563 flags.go:64] FLAG: --tls-private-key-file="" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495548 2563 flags.go:64] FLAG: --topology-manager-policy="none" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495551 2563 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495554 2563 flags.go:64] FLAG: --topology-manager-scope="container" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495557 2563 flags.go:64] FLAG: --v="2" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495566 2563 flags.go:64] FLAG: --version="false" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495572 2563 flags.go:64] FLAG: --vmodule="" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495576 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.495580 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495681 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495686 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495689 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495692 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495695 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:18.501463 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495699 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495703 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495705 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495708 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495710 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495713 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495715 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495717 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495720 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495740 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495743 2563 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495746 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495748 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495751 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495753 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495756 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495759 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495762 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495764 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495767 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:18.502066 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495769 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495772 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495775 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495777 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495781 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495783 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495787 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495791 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495795 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495798 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495801 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495804 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495807 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495810 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495812 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495815 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495817 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495820 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495822 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:18.502608 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495825 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495828 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495830 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495832 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495835 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495838 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495840 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495843 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495845 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495848 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495850 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495852 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495854 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495857 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495859 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495862 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495864 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495868 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495870 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495873 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:18.503119 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495875 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495878 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495881 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495884 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495886 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495889 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495891 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495894 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495896 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495898 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495901 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495904 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495906 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495909 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495911 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495914 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495916 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495919 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495922 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495924 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:18.503623 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495927 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:18.504152 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.495929 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:18.504152 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.496947 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 00:47:18.504566 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.504543 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 29 00:47:18.504596 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.504567 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 00:47:18.504629 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504620 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:18.504629 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504626 2563 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504630 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504633 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504636 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504639 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504642 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504645 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504647 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504650 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504652 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504655 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504657 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504660 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504663 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504665 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504668 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504671 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504674 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504676 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504679 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:18.504681 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504681 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504684 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504687 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504690 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504693 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504696 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504698 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504701 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504704 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504706 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504710 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504712 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504715 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504717 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504737 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504742 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504746 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504749 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504751 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:18.505216 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504754 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504757 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504759 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504761 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504764 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504766 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504770 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504774 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504776 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504779 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504782 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504784 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504787 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504790 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504792 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504796 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504799 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504801 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504804 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:18.505714 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504807 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504809 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504812 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504814 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504817 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504820 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504823 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504825 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504828 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504830 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504832 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504835 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504837 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504840 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504842 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504861 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504865 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504868 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504871 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504874 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:18.506232 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504877 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504880 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504884 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504887 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504890 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504892 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.504895 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.504900 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505001 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505005 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505008 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505012 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505014 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505017 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505020 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:18.506746 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505023 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505025 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505028 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505031 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505033 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505036 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505038 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505040 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505044 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505048 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505050 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505053 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505055 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505058 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505061 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505064 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505066 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505068 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505071 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505073 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:18.507220 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505076 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505079 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505081 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505083 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505086 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505089 2563 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505092 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505095 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505098 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505100 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505103 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505106 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505108 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505111 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505113 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505115 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505118 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505121 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505123 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505125 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:18.507734 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505128 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505130 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505133 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505135 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505138 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505140 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505142 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505145 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505147 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505150 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505152 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505154 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505157 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505160 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505162 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505164 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505167 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505169 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505172 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:18.508227 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505175 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505178 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505181 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505185 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505188 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505191 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505193 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505195 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505198 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505200 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505203 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505206 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505208 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505210 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505213 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505215 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505218 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505220 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505223 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:18.508689 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:18.505226 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:18.509173 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.505231 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 00:47:18.509173 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.506085 2563 server.go:962] "Client rotation is on, will bootstrap in background" May 29 00:47:18.510925 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.510910 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 00:47:18.511950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.511936 2563 server.go:1019] "Starting client certificate rotation" May 29 00:47:18.512074 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.512054 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 00:47:18.512128 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.512111 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 00:47:18.539811 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.539781 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 00:47:18.545694 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.545663 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 00:47:18.567106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.567079 2563 log.go:25] "Validated CRI v1 runtime API" May 29 00:47:18.572805 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.572780 2563 log.go:25] "Validated CRI v1 image API" May 29 00:47:18.574160 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.574145 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 00:47:18.574775 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.574759 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 00:47:18.577770 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.577746 2563 fs.go:135] Filesystem UUIDs: map[1fd5564d-7e35-4136-bb6a-bd507a3b2922:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b5a2b315-c64c-409d-9c0a-b4de8c203409:/dev/nvme0n1p3] May 29 00:47:18.577843 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.577769 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 00:47:18.582220 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.582101 2563 manager.go:217] Machine: {Timestamp:2026-05-29 00:47:18.58151631 +0000 UTC m=+0.476727768 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111009 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22cf0ad24f746f3bffd0d33b85ad81 SystemUUID:ec22cf0a-d24f-746f-3bff-d0d33b85ad81 BootID:f81ba29a-6b7b-43cf-b9ba-1b3c52e584c0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:ae:92:d4:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:ae:92:d4:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:9c:5f:63:70:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 00:47:18.582220 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.582212 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 00:47:18.582340 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.582294 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 00:47:18.586106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.586060 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 00:47:18.586256 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.586109 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 00:47:18.586309 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.586266 2563 topology_manager.go:138] "Creating topology manager with none policy" May 29 00:47:18.586309 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.586276 2563 container_manager_linux.go:306] "Creating device plugin manager" May 29 00:47:18.586309 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.586289 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 00:47:18.586309 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.586305 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 00:47:18.587499 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.587488 2563 state_mem.go:36] "Initialized new in-memory state store" May 29 00:47:18.587616 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.587607 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 00:47:18.591909 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.591893 2563 kubelet.go:491] "Attempting to sync node with API server" May 29 00:47:18.591998 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.591901 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86xzb" May 29 00:47:18.591998 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.591917 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 00:47:18.592768 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.592756 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 00:47:18.592824 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.592778 2563 kubelet.go:397] "Adding apiserver pod source" May 29 00:47:18.592824 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.592791 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 00:47:18.594111 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.594095 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 00:47:18.594193 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.594119 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 00:47:18.597911 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.597893 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 29 00:47:18.599621 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.599591 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86xzb" May 29 00:47:18.599810 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.599777 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 00:47:18.600453 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.600425 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 29 00:47:18.600708 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.600461 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 29 00:47:18.601056 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601033 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601061 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601072 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601090 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601103 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601110 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601118 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601126 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601136 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 00:47:18.601140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601145 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 00:47:18.601462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601158 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 00:47:18.601462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.601367 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 00:47:18.602378 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.602356 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 00:47:18.602378 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.602377 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 00:47:18.605863 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.605845 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 00:47:18.605962 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.605912 2563 server.go:1295] "Started kubelet" May 29 00:47:18.606030 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.605948 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 00:47:18.606084 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.606030 2563 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 00:47:18.606799 ip-10-0-131-222 systemd[1]: Started Kubernetes Kubelet. May 29 00:47:18.610777 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.610742 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 00:47:18.610868 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.610849 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 00:47:18.612711 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.612693 2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-222.ec2.internal" not found May 29 00:47:18.612971 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.612958 2563 server.go:317] "Adding debug handlers to kubelet server" May 29 00:47:18.617397 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.617379 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 00:47:18.617505 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.617430 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 00:47:18.617505 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.617479 2563 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 00:47:18.617505 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.617494 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 00:47:18.617650 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.617637 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 00:47:18.617701 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.617675 2563 reconstruct.go:97] "Volume reconstruction finished" May 29 00:47:18.617701 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.617684 2563 reconciler.go:26] "Reconciler: start to sync state" May 29 00:47:18.618610 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.618149 2563 factory.go:55] Registering systemd factory May 29 00:47:18.618610 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.618207 2563 factory.go:223] Registration of the systemd container factory successfully May 29 00:47:18.618903 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.618615 2563 factory.go:153] Registering CRI-O factory May 29 00:47:18.618903 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.618635 2563 factory.go:223] Registration of the crio container factory successfully May 29 00:47:18.618903 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.618716 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 00:47:18.618903 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.618761 2563 factory.go:103] Registering Raw factory May 29 00:47:18.618903 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.618777 2563 manager.go:1196] Started watching for new ooms in manager May 29 00:47:18.618903 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.618815 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:18.619213 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.619199 2563 manager.go:319] Starting recovery of all containers May 29 00:47:18.619439 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.619413 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 00:47:18.620241 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.620220 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:18.621138 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.621115 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-222.ec2.internal\" not found" node="ip-10-0-131-222.ec2.internal" May 29 00:47:18.626549 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.626365 2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-222.ec2.internal" not found May 29 00:47:18.629350 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.629337 2563 manager.go:324] Recovery completed May 29 00:47:18.633650 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.633635 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:18.635641 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.635625 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:18.635757 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.635654 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:18.635757 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.635664 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:18.637158 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.637145 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 00:47:18.637158 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.637156 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 00:47:18.637251 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.637184 2563 state_mem.go:36] "Initialized new in-memory state store" May 29 00:47:18.639600 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.639587 2563 policy_none.go:49] "None policy: Start" May 29 00:47:18.639652 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.639603 2563 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 00:47:18.639652 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.639613 2563 state_mem.go:35] "Initializing new in-memory state store" May 29 00:47:18.680437 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.680417 2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-222.ec2.internal" not found May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.683375 2563 manager.go:341] "Starting Device Plugin manager" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.683413 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.683423 2563 server.go:85] "Starting device plugin registration server" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.683700 2563 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.683713 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.683835 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.683905 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.683913 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.684440 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 00:47:18.690607 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.684486 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:18.750991 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.750902 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 00:47:18.752296 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.752278 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 00:47:18.752296 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.752299 2563 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 00:47:18.752511 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.752318 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 00:47:18.752511 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.752325 2563 kubelet.go:2451] "Starting kubelet main sync loop" May 29 00:47:18.752511 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.752363 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 00:47:18.758139 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.758119 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:18.784499 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.784481 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:18.785623 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.785605 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:18.785694 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.785643 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:18.785694 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.785659 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:18.785694 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.785685 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-222.ec2.internal" May 29 00:47:18.794286 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.794270 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-222.ec2.internal" May 29 00:47:18.794346 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.794295 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-222.ec2.internal\": node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:18.814215 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.814188 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:18.853464 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.853436 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal"] May 29 00:47:18.853530 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.853510 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:18.854432 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.854413 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:18.854540 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.854442 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:18.854540 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.854452 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:18.855964 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.855952 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:18.856123 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.856108 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:18.856162 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.856141 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:18.857479 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.856852 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:18.857479 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.856879 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:18.857479 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.856892 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:18.857822 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.857798 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:18.857903 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.857840 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:18.857903 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.857856 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:18.859079 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.859061 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" May 29 00:47:18.859168 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.859093 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:18.859806 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.859788 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:18.859806 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.859817 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:18.859925 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:18.859826 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:18.887525 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.887504 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-222.ec2.internal\" not found" node="ip-10-0-131-222.ec2.internal" May 29 00:47:18.892088 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.892069 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-222.ec2.internal\" not found" node="ip-10-0-131-222.ec2.internal" May 29 00:47:18.914251 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:18.914226 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.014792 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.014690 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.018980 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.018958 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fde578dffbcfc02d42fcb16feac52cec-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal\" (UID: \"fde578dffbcfc02d42fcb16feac52cec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:19.019053 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.018989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde578dffbcfc02d42fcb16feac52cec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal\" (UID: \"fde578dffbcfc02d42fcb16feac52cec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:19.019053 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.019010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ba471d749c4d61c36aa74f973a36c94-config\") pod \"kube-apiserver-proxy-ip-10-0-131-222.ec2.internal\" (UID: \"8ba471d749c4d61c36aa74f973a36c94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" May 29 00:47:19.115381 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.115335 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.119614 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.119592 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ba471d749c4d61c36aa74f973a36c94-config\") pod \"kube-apiserver-proxy-ip-10-0-131-222.ec2.internal\" (UID: \"8ba471d749c4d61c36aa74f973a36c94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" May 29 00:47:19.119684 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.119623 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fde578dffbcfc02d42fcb16feac52cec-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal\" (UID: \"fde578dffbcfc02d42fcb16feac52cec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:19.119684 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.119639 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde578dffbcfc02d42fcb16feac52cec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal\" (UID: \"fde578dffbcfc02d42fcb16feac52cec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:19.119791 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.119700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde578dffbcfc02d42fcb16feac52cec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal\" (UID: \"fde578dffbcfc02d42fcb16feac52cec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:19.119791 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.119708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fde578dffbcfc02d42fcb16feac52cec-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal\" (UID: \"fde578dffbcfc02d42fcb16feac52cec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:19.119791 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.119710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ba471d749c4d61c36aa74f973a36c94-config\") pod \"kube-apiserver-proxy-ip-10-0-131-222.ec2.internal\" (UID: \"8ba471d749c4d61c36aa74f973a36c94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" May 29 00:47:19.190737 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.190695 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:19.195557 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.195535 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" May 29 00:47:19.216307 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.216273 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.316881 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.316773 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.417255 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.417208 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.472708 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.472671 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:19.511481 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.511443 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 00:47:19.512066 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.511594 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 00:47:19.512066 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.511629 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 00:47:19.512066 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.511629 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 00:47:19.517605 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.517583 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.601678 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.601612 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 00:42:18 +0000 UTC" deadline="2028-01-19 10:19:57.419000435 +0000 UTC" May 29 00:47:19.601678 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.601672 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14409h32m37.817333962s" May 29 00:47:19.617819 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.617773 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.617819 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.617810 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 00:47:19.640196 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.640166 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 00:47:19.665844 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.665816 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-74p8d" May 29 00:47:19.668360 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:19.668330 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba471d749c4d61c36aa74f973a36c94.slice/crio-a697f8538fe56a90993416941a4a2179195fe0b6787c150781aeb53a05894b79 WatchSource:0}: Error finding container a697f8538fe56a90993416941a4a2179195fe0b6787c150781aeb53a05894b79: Status 404 returned error can't find the container with id a697f8538fe56a90993416941a4a2179195fe0b6787c150781aeb53a05894b79 May 29 00:47:19.668625 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:19.668609 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde578dffbcfc02d42fcb16feac52cec.slice/crio-cda070e27dc181dfb7c0b4cc5d4ff62a0ab33ee70d9141c102df1c9522bf4998 WatchSource:0}: Error finding container cda070e27dc181dfb7c0b4cc5d4ff62a0ab33ee70d9141c102df1c9522bf4998: Status 404 returned error can't find the container with id cda070e27dc181dfb7c0b4cc5d4ff62a0ab33ee70d9141c102df1c9522bf4998 May 29 00:47:19.670816 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.670798 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-74p8d" May 29 00:47:19.673002 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.672978 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 00:47:19.718601 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.718566 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.755988 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.755943 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" event={"ID":"8ba471d749c4d61c36aa74f973a36c94","Type":"ContainerStarted","Data":"a697f8538fe56a90993416941a4a2179195fe0b6787c150781aeb53a05894b79"} May 29 00:47:19.756837 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.756813 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" event={"ID":"fde578dffbcfc02d42fcb16feac52cec","Type":"ContainerStarted","Data":"cda070e27dc181dfb7c0b4cc5d4ff62a0ab33ee70d9141c102df1c9522bf4998"} May 29 00:47:19.819188 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.819106 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.919577 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:19.919543 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-222.ec2.internal\" not found" May 29 00:47:19.956559 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:19.956533 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:20.017819 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.017782 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" May 29 00:47:20.030527 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.030503 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 00:47:20.031824 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.031800 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" May 29 00:47:20.040154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.040126 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 00:47:20.594145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.594112 2563 apiserver.go:52] "Watching apiserver" May 29 00:47:20.601894 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.601858 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 00:47:20.602271 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.602247 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal","openshift-image-registry/node-ca-mdrgh","openshift-multus/multus-7drtj","openshift-multus/multus-additional-cni-plugins-6wbkg","openshift-network-diagnostics/network-check-target-7789b","openshift-ovn-kubernetes/ovnkube-node-2ftcp","kube-system/konnectivity-agent-chg5d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5","openshift-cluster-node-tuning-operator/tuned-vlpzb","openshift-dns/node-resolver-n9v8g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal","openshift-multus/network-metrics-daemon-5zjvq","openshift-network-operator/iptables-alerter-4xkz9"] May 29 00:47:20.605079 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.604851 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:20.608011 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.607992 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mxctp\"" May 29 00:47:20.608337 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.608308 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 00:47:20.608679 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.608661 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 00:47:20.610374 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.610352 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.612402 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.612371 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7drtj" May 29 00:47:20.612510 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.612471 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.613641 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.612923 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 00:47:20.613641 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.612978 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gq85h\"" May 29 00:47:20.613641 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.613050 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 00:47:20.613641 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.613250 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 00:47:20.614483 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.614461 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:20.614588 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:20.614554 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:20.614648 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.614629 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 00:47:20.614946 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.614921 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 00:47:20.615048 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.614926 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 00:47:20.615099 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.615064 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 00:47:20.615374 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.615350 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 00:47:20.615547 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.615530 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 00:47:20.615854 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.615835 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fhdtw\"" May 29 00:47:20.615957 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.615880 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-whpjh\"" May 29 00:47:20.616749 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.616710 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.619394 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.619374 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.619502 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.619485 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 00:47:20.619553 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.619510 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8cks6\"" May 29 00:47:20.619596 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.619557 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 00:47:20.619596 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.619490 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 00:47:20.619700 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.619682 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 00:47:20.619829 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.619787 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 00:47:20.619911 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.619841 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 00:47:20.622260 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.621938 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.622260 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.621984 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 00:47:20.622260 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.622005 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 00:47:20.622260 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.622025 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 00:47:20.622482 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.622411 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nsgw6\"" May 29 00:47:20.624086 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.624069 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.624447 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.624428 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 00:47:20.624757 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.624694 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 00:47:20.624757 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.624720 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qzgb\"" May 29 00:47:20.626444 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.626408 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:20.626542 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:20.626496 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:20.627061 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627027 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9jltw\"" May 29 00:47:20.627285 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627269 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 00:47:20.627487 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627472 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 00:47:20.627790 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ceed120-d7b0-4e23-a600-545bd7c79900-serviceca\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.627852 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-socket-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.627852 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-hostroot\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.627852 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-os-release\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.627967 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.627967 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.627967 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-ovnkube-config\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.627967 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-cni-netd\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.627987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.628106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-cnibin\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-socket-dir-parent\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-netns\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-daemon-config\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-systemd\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:20.628314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-conf-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.628314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-device-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.628314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.628314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79137623-f01b-4338-91c4-807834d1d3fa-konnectivity-ca\") pod \"konnectivity-agent-chg5d\" (UID: \"79137623-f01b-4338-91c4-807834d1d3fa\") " pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:20.628314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628274 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-cni-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3612180-cb43-4b20-b9c2-aaa11191ee34-cni-binary-copy\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j62rz\" (UniqueName: \"kubernetes.io/projected/a822de23-8992-414d-be69-f204e3496364-kube-api-access-j62rz\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-k8s-cni-cncf-io\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-etc-kubernetes\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a822de23-8992-414d-be69-f204e3496364-ovn-node-metrics-cert\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-run-netns\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-etc-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8jlp\" (UniqueName: \"kubernetes.io/projected/5c1695f9-b180-4f5a-8106-74202aa33a8e-kube-api-access-z8jlp\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twjl8\" (UniqueName: \"kubernetes.io/projected/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-kube-api-access-twjl8\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-run-ovn-kubernetes\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.628581 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-env-overrides\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628605 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-cni-bin\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d69z2\" (UniqueName: \"kubernetes.io/projected/9ceed120-d7b0-4e23-a600-545bd7c79900-kube-api-access-d69z2\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-system-cni-dir\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-var-lib-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ceed120-d7b0-4e23-a600-545bd7c79900-host\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88n9f\" (UniqueName: \"kubernetes.io/projected/d3612180-cb43-4b20-b9c2-aaa11191ee34-kube-api-access-88n9f\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-slash\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-ovn\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.628976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-node-log\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629028 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-sys-fs\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-cni-bin\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-kubelet\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-os-release\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-cni-multus\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-multus-certs\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-kubelet\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-systemd-units\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-log-socket\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-system-cni-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-ovnkube-script-lib\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-registration-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.629431 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79137623-f01b-4338-91c4-807834d1d3fa-agent-certs\") pod \"konnectivity-agent-chg5d\" (UID: \"79137623-f01b-4338-91c4-807834d1d3fa\") " pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:20.629875 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.629437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cnibin\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.631194 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.631176 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 00:47:20.631310 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.631296 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4mft7\"" May 29 00:47:20.631376 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.631370 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 00:47:20.631461 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.631439 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 00:47:20.671628 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.671595 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 00:42:19 +0000 UTC" deadline="2027-11-24 10:27:18.205066283 +0000 UTC" May 29 00:47:20.671628 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.671627 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13065h39m57.53344336s" May 29 00:47:20.718584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.718554 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 00:47:20.730158 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730126 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-cni-multus\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.730158 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730155 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-multus-certs\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730172 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-kubelet\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730188 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-systemd-units\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730206 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-log-socket\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730232 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-system-cni-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-cni-multus\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730257 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-kubelet\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730259 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-ovnkube-script-lib\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-multus-certs\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-systemd-units\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730298 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-log-socket\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730329 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-registration-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-system-cni-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730350 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79137623-f01b-4338-91c4-807834d1d3fa-agent-certs\") pod \"konnectivity-agent-chg5d\" (UID: \"79137623-f01b-4338-91c4-807834d1d3fa\") " pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730379 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cnibin\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.730372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730384 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-registration-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730404 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ceed120-d7b0-4e23-a600-545bd7c79900-serviceca\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730428 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-socket-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730452 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-hostroot\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cnibin\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730480 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-os-release\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730508 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysctl-d\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-hostroot\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730579 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730605 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-ovnkube-config\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730620 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-os-release\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-socket-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ceed120-d7b0-4e23-a600-545bd7c79900-serviceca\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-var-lib-kubelet\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730936 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysctl-conf\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.731108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-ovnkube-script-lib\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.730987 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-cni-netd\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-cni-netd\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731042 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731064 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-cnibin\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731084 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-socket-dir-parent\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731107 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-netns\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731136 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-daemon-config\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-cnibin\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731160 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-systemd\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-systemd\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731199 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731204 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-ovnkube-config\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-socket-dir-parent\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731285 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-netns\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731297 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-conf-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.731950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731326 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731346 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-conf-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-modprobe-d\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysconfig\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731402 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-sys\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf0454e9-24a1-4a3f-8ccd-335b81975306-hosts-file\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9l7c\" (UniqueName: \"kubernetes.io/projected/cf0454e9-24a1-4a3f-8ccd-335b81975306-kube-api-access-b9l7c\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731464 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-device-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731518 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731563 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-device-dir\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731566 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79137623-f01b-4338-91c4-807834d1d3fa-konnectivity-ca\") pod \"konnectivity-agent-chg5d\" (UID: \"79137623-f01b-4338-91c4-807834d1d3fa\") " pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731597 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-cni-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731641 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3612180-cb43-4b20-b9c2-aaa11191ee34-cni-binary-copy\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731667 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j62rz\" (UniqueName: \"kubernetes.io/projected/a822de23-8992-414d-be69-f204e3496364-kube-api-access-j62rz\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zvm\" (UniqueName: \"kubernetes.io/projected/a4b386c9-a3f7-44fe-ae52-c0db59b62381-kube-api-access-49zvm\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.732755 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731809 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-k8s-cni-cncf-io\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-daemon-config\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731835 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-etc-kubernetes\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731861 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a822de23-8992-414d-be69-f204e3496364-ovn-node-metrics-cert\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4b386c9-a3f7-44fe-ae52-c0db59b62381-tmp\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731928 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-run-netns\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731952 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-etc-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.731979 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732026 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-etc-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-lib-modules\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-host-slash\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-run-k8s-cni-cncf-io\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5s4p\" (UniqueName: \"kubernetes.io/projected/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-kube-api-access-m5s4p\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732138 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8jlp\" (UniqueName: \"kubernetes.io/projected/5c1695f9-b180-4f5a-8106-74202aa33a8e-kube-api-access-z8jlp\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-run-netns\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.733576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-etc-kubernetes\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79137623-f01b-4338-91c4-807834d1d3fa-konnectivity-ca\") pod \"konnectivity-agent-chg5d\" (UID: \"79137623-f01b-4338-91c4-807834d1d3fa\") " pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732249 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twjl8\" (UniqueName: \"kubernetes.io/projected/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-kube-api-access-twjl8\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732302 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-multus-cni-dir\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732355 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732391 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3612180-cb43-4b20-b9c2-aaa11191ee34-cni-binary-copy\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732477 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732501 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-run-ovn-kubernetes\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732543 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-env-overrides\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-run-ovn-kubernetes\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-systemd\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732606 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-cni-bin\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-run\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732671 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nct5d\" (UniqueName: \"kubernetes.io/projected/d6804979-c10d-4438-b86d-a07db1614952-kube-api-access-nct5d\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-iptables-alerter-script\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732717 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d69z2\" (UniqueName: \"kubernetes.io/projected/9ceed120-d7b0-4e23-a600-545bd7c79900-kube-api-access-d69z2\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-cni-bin\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.734420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732765 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-system-cni-dir\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732836 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-system-cni-dir\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732925 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a822de23-8992-414d-be69-f204e3496364-env-overrides\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732951 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-var-lib-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-kubernetes\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.732998 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-var-lib-openvswitch\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-host\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733053 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733057 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ceed120-d7b0-4e23-a600-545bd7c79900-host\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733098 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88n9f\" (UniqueName: \"kubernetes.io/projected/d3612180-cb43-4b20-b9c2-aaa11191ee34-kube-api-access-88n9f\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733122 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-slash\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733148 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-ovn\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733100 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ceed120-d7b0-4e23-a600-545bd7c79900-host\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733172 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-node-log\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.735248 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-host-slash\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf0454e9-24a1-4a3f-8ccd-335b81975306-tmp-dir\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733250 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-sys-fs\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733277 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-cni-bin\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-run-ovn\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733310 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-kubelet\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c1695f9-b180-4f5a-8106-74202aa33a8e-sys-fs\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-tuned\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733345 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-cni-bin\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a822de23-8992-414d-be69-f204e3496364-node-log\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733399 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-host-var-lib-kubelet\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733860 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-os-release\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.736145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.733969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3612180-cb43-4b20-b9c2-aaa11191ee34-os-release\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.736701 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.736474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a822de23-8992-414d-be69-f204e3496364-ovn-node-metrics-cert\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.736701 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.736594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79137623-f01b-4338-91c4-807834d1d3fa-agent-certs\") pod \"konnectivity-agent-chg5d\" (UID: \"79137623-f01b-4338-91c4-807834d1d3fa\") " pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:20.739869 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:20.739846 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:20.739987 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:20.739875 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:20.739987 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:20.739889 2563 projected.go:194] Error preparing data for projected volume kube-api-access-z6fm4 for pod openshift-network-diagnostics/network-check-target-7789b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:20.739987 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:20.739959 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4 podName:333130a7-e69f-412f-8a2f-b95230ac3247 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:21.239937285 +0000 UTC m=+3.135148752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z6fm4" (UniqueName: "kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4") pod "network-check-target-7789b" (UID: "333130a7-e69f-412f-8a2f-b95230ac3247") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:20.744030 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.743987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d69z2\" (UniqueName: \"kubernetes.io/projected/9ceed120-d7b0-4e23-a600-545bd7c79900-kube-api-access-d69z2\") pod \"node-ca-mdrgh\" (UID: \"9ceed120-d7b0-4e23-a600-545bd7c79900\") " pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.744186 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.744164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twjl8\" (UniqueName: \"kubernetes.io/projected/8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed-kube-api-access-twjl8\") pod \"multus-additional-cni-plugins-6wbkg\" (UID: \"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed\") " pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.744261 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.744201 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88n9f\" (UniqueName: \"kubernetes.io/projected/d3612180-cb43-4b20-b9c2-aaa11191ee34-kube-api-access-88n9f\") pod \"multus-7drtj\" (UID: \"d3612180-cb43-4b20-b9c2-aaa11191ee34\") " pod="openshift-multus/multus-7drtj" May 29 00:47:20.744356 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.744341 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j62rz\" (UniqueName: \"kubernetes.io/projected/a822de23-8992-414d-be69-f204e3496364-kube-api-access-j62rz\") pod \"ovnkube-node-2ftcp\" (UID: \"a822de23-8992-414d-be69-f204e3496364\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.744415 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.744352 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8jlp\" (UniqueName: \"kubernetes.io/projected/5c1695f9-b180-4f5a-8106-74202aa33a8e-kube-api-access-z8jlp\") pod \"aws-ebs-csi-driver-node-lnqm5\" (UID: \"5c1695f9-b180-4f5a-8106-74202aa33a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.804257 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.804219 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:20.835185 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835148 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-modprobe-d\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835185 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835187 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysconfig\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835415 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835213 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-sys\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835415 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysconfig\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835415 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835316 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf0454e9-24a1-4a3f-8ccd-335b81975306-hosts-file\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.835415 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835338 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-modprobe-d\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835415 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835362 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9l7c\" (UniqueName: \"kubernetes.io/projected/cf0454e9-24a1-4a3f-8ccd-335b81975306-kube-api-access-b9l7c\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.835415 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835399 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49zvm\" (UniqueName: \"kubernetes.io/projected/a4b386c9-a3f7-44fe-ae52-c0db59b62381-kube-api-access-49zvm\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835415 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-sys\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835422 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835460 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4b386c9-a3f7-44fe-ae52-c0db59b62381-tmp\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835424 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf0454e9-24a1-4a3f-8ccd-335b81975306-hosts-file\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835481 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-lib-modules\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:20.835519 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835549 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-host-slash\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835575 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-lib-modules\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835517 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-host-slash\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:20.835622 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs podName:d6804979-c10d-4438-b86d-a07db1614952 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:21.335601259 +0000 UTC m=+3.230812741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs") pod "network-metrics-daemon-5zjvq" (UID: "d6804979-c10d-4438-b86d-a07db1614952") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835643 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5s4p\" (UniqueName: \"kubernetes.io/projected/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-kube-api-access-m5s4p\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.835697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835678 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-systemd\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835705 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-run\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835744 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nct5d\" (UniqueName: \"kubernetes.io/projected/d6804979-c10d-4438-b86d-a07db1614952-kube-api-access-nct5d\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835763 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-iptables-alerter-script\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835816 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-run\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835853 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-kubernetes\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835879 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-host\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835904 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-systemd\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835911 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf0454e9-24a1-4a3f-8ccd-335b81975306-tmp-dir\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835963 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-tuned\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-kubernetes\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.835968 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-host\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.836007 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysctl-d\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.836053 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-var-lib-kubelet\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.836078 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysctl-conf\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.836144 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysctl-d\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.836160 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-var-lib-kubelet\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.836199 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf0454e9-24a1-4a3f-8ccd-335b81975306-tmp-dir\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.836259 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.836208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-sysctl-conf\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.837022 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.836271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-iptables-alerter-script\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.838353 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.838315 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4b386c9-a3f7-44fe-ae52-c0db59b62381-tmp\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.838466 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.838413 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4b386c9-a3f7-44fe-ae52-c0db59b62381-etc-tuned\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.843006 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.842828 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:20.844685 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.844631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9l7c\" (UniqueName: \"kubernetes.io/projected/cf0454e9-24a1-4a3f-8ccd-335b81975306-kube-api-access-b9l7c\") pod \"node-resolver-n9v8g\" (UID: \"cf0454e9-24a1-4a3f-8ccd-335b81975306\") " pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.845077 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.845058 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nct5d\" (UniqueName: \"kubernetes.io/projected/d6804979-c10d-4438-b86d-a07db1614952-kube-api-access-nct5d\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:20.845538 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.845521 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5s4p\" (UniqueName: \"kubernetes.io/projected/c7dfcb4c-47ac-460e-988b-089fbfcc09ff-kube-api-access-m5s4p\") pod \"iptables-alerter-4xkz9\" (UID: \"c7dfcb4c-47ac-460e-988b-089fbfcc09ff\") " pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:20.845637 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.845550 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zvm\" (UniqueName: \"kubernetes.io/projected/a4b386c9-a3f7-44fe-ae52-c0db59b62381-kube-api-access-49zvm\") pod \"tuned-vlpzb\" (UID: \"a4b386c9-a3f7-44fe-ae52-c0db59b62381\") " pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.917486 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.917441 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:20.925271 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.925244 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mdrgh" May 29 00:47:20.936994 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.936965 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7drtj" May 29 00:47:20.942457 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.942438 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" May 29 00:47:20.950127 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.950100 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:20.956792 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.956775 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" May 29 00:47:20.962392 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.962374 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" May 29 00:47:20.967912 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.967888 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n9v8g" May 29 00:47:20.974448 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:20.974430 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xkz9" May 29 00:47:21.285259 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.285229 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0454e9_24a1_4a3f_8ccd_335b81975306.slice/crio-d85a12d57dbfa29de78dd71d420a8e9d7d4659c464cedfdb40397973fe134474 WatchSource:0}: Error finding container d85a12d57dbfa29de78dd71d420a8e9d7d4659c464cedfdb40397973fe134474: Status 404 returned error can't find the container with id d85a12d57dbfa29de78dd71d420a8e9d7d4659c464cedfdb40397973fe134474 May 29 00:47:21.286254 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.286232 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda822de23_8992_414d_be69_f204e3496364.slice/crio-1fdc23d69507576496e35182851373ee9a4d905fb91f816366acd55b63c9352f WatchSource:0}: Error finding container 1fdc23d69507576496e35182851373ee9a4d905fb91f816366acd55b63c9352f: Status 404 returned error can't find the container with id 1fdc23d69507576496e35182851373ee9a4d905fb91f816366acd55b63c9352f May 29 00:47:21.287671 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.287647 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dfcb4c_47ac_460e_988b_089fbfcc09ff.slice/crio-d809dad81b2f5ca241c77fe67283ea3a14e17f28f57bc89ba22831febe185e1a WatchSource:0}: Error finding container d809dad81b2f5ca241c77fe67283ea3a14e17f28f57bc89ba22831febe185e1a: Status 404 returned error can't find the container with id d809dad81b2f5ca241c77fe67283ea3a14e17f28f57bc89ba22831febe185e1a May 29 00:47:21.291881 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.291852 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79137623_f01b_4338_91c4_807834d1d3fa.slice/crio-4025bc8affdbc9dded86c6a21fabb808d38e9357abc30dd437743cf70b55bb97 WatchSource:0}: Error finding container 4025bc8affdbc9dded86c6a21fabb808d38e9357abc30dd437743cf70b55bb97: Status 404 returned error can't find the container with id 4025bc8affdbc9dded86c6a21fabb808d38e9357abc30dd437743cf70b55bb97 May 29 00:47:21.292209 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.292178 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ceed120_d7b0_4e23_a600_545bd7c79900.slice/crio-e6f17462053cb8d9c2e82da242e3f251d4d9e3234c5be4f9e8bbf2d0853b6ce8 WatchSource:0}: Error finding container e6f17462053cb8d9c2e82da242e3f251d4d9e3234c5be4f9e8bbf2d0853b6ce8: Status 404 returned error can't find the container with id e6f17462053cb8d9c2e82da242e3f251d4d9e3234c5be4f9e8bbf2d0853b6ce8 May 29 00:47:21.293171 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.293104 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b386c9_a3f7_44fe_ae52_c0db59b62381.slice/crio-89784022f0f76c9803ed3f886b48ed20501fcadc1a27ad883a036f25335a9b92 WatchSource:0}: Error finding container 89784022f0f76c9803ed3f886b48ed20501fcadc1a27ad883a036f25335a9b92: Status 404 returned error can't find the container with id 89784022f0f76c9803ed3f886b48ed20501fcadc1a27ad883a036f25335a9b92 May 29 00:47:21.295179 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.295061 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e09b6d3_1d79_4384_a0cf_f5ef2dc3e7ed.slice/crio-575677044e4b160ef1e774f9373d538d02cd8511e8f78fb6fef16c39b4a26ee0 WatchSource:0}: Error finding container 575677044e4b160ef1e774f9373d538d02cd8511e8f78fb6fef16c39b4a26ee0: Status 404 returned error can't find the container with id 575677044e4b160ef1e774f9373d538d02cd8511e8f78fb6fef16c39b4a26ee0 May 29 00:47:21.297297 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.296804 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3612180_cb43_4b20_b9c2_aaa11191ee34.slice/crio-929c05a77b593f667d569f239ad8c464f1cbf930bb4f4630dfc9535658005348 WatchSource:0}: Error finding container 929c05a77b593f667d569f239ad8c464f1cbf930bb4f4630dfc9535658005348: Status 404 returned error can't find the container with id 929c05a77b593f667d569f239ad8c464f1cbf930bb4f4630dfc9535658005348 May 29 00:47:21.297785 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:21.297406 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1695f9_b180_4f5a_8106_74202aa33a8e.slice/crio-fda1349f644861659b6676ccd09a7b59d9c14fd43df864d714e2ffcef81c3ce8 WatchSource:0}: Error finding container fda1349f644861659b6676ccd09a7b59d9c14fd43df864d714e2ffcef81c3ce8: Status 404 returned error can't find the container with id fda1349f644861659b6676ccd09a7b59d9c14fd43df864d714e2ffcef81c3ce8 May 29 00:47:21.339927 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.339757 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:21.339927 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:21.339915 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:21.340063 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:21.339936 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:21.340063 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:21.339950 2563 projected.go:194] Error preparing data for projected volume kube-api-access-z6fm4 for pod openshift-network-diagnostics/network-check-target-7789b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:21.340063 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.339961 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:21.340063 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:21.340005 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4 podName:333130a7-e69f-412f-8a2f-b95230ac3247 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:22.33998728 +0000 UTC m=+4.235198742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z6fm4" (UniqueName: "kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4") pod "network-check-target-7789b" (UID: "333130a7-e69f-412f-8a2f-b95230ac3247") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:21.340063 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:21.340047 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:21.340235 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:21.340079 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs podName:d6804979-c10d-4438-b86d-a07db1614952 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:22.34007116 +0000 UTC m=+4.235282606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs") pod "network-metrics-daemon-5zjvq" (UID: "d6804979-c10d-4438-b86d-a07db1614952") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:21.672255 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.672206 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 00:42:19 +0000 UTC" deadline="2027-12-20 21:53:57.403336342 +0000 UTC" May 29 00:47:21.672255 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.672248 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13701h6m35.731092147s" May 29 00:47:21.752616 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.752585 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:21.752788 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:21.752759 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:21.753199 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.753179 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:21.753292 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:21.753272 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:21.763308 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.763273 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7drtj" event={"ID":"d3612180-cb43-4b20-b9c2-aaa11191ee34","Type":"ContainerStarted","Data":"929c05a77b593f667d569f239ad8c464f1cbf930bb4f4630dfc9535658005348"} May 29 00:47:21.768819 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.768747 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerStarted","Data":"575677044e4b160ef1e774f9373d538d02cd8511e8f78fb6fef16c39b4a26ee0"} May 29 00:47:21.771445 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.771419 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mdrgh" event={"ID":"9ceed120-d7b0-4e23-a600-545bd7c79900","Type":"ContainerStarted","Data":"e6f17462053cb8d9c2e82da242e3f251d4d9e3234c5be4f9e8bbf2d0853b6ce8"} May 29 00:47:21.778676 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.778642 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-chg5d" event={"ID":"79137623-f01b-4338-91c4-807834d1d3fa","Type":"ContainerStarted","Data":"4025bc8affdbc9dded86c6a21fabb808d38e9357abc30dd437743cf70b55bb97"} May 29 00:47:21.790513 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.790477 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xkz9" event={"ID":"c7dfcb4c-47ac-460e-988b-089fbfcc09ff","Type":"ContainerStarted","Data":"d809dad81b2f5ca241c77fe67283ea3a14e17f28f57bc89ba22831febe185e1a"} May 29 00:47:21.793308 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.793279 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n9v8g" event={"ID":"cf0454e9-24a1-4a3f-8ccd-335b81975306","Type":"ContainerStarted","Data":"d85a12d57dbfa29de78dd71d420a8e9d7d4659c464cedfdb40397973fe134474"} May 29 00:47:21.797438 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.797410 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" event={"ID":"8ba471d749c4d61c36aa74f973a36c94","Type":"ContainerStarted","Data":"41c959bab9714d3b8514ffbc469ac54c443177f958bfdd61e38f60cf451797d5"} May 29 00:47:21.807858 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.807782 2563 generic.go:358] "Generic (PLEG): container finished" podID="fde578dffbcfc02d42fcb16feac52cec" containerID="e4f0549c46fb89cab6172fd6eda71e151bf1a7fe4f092bd62fbc23cacc766919" exitCode=0 May 29 00:47:21.808083 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.808059 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" event={"ID":"fde578dffbcfc02d42fcb16feac52cec","Type":"ContainerDied","Data":"e4f0549c46fb89cab6172fd6eda71e151bf1a7fe4f092bd62fbc23cacc766919"} May 29 00:47:21.815246 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.815204 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" event={"ID":"5c1695f9-b180-4f5a-8106-74202aa33a8e","Type":"ContainerStarted","Data":"fda1349f644861659b6676ccd09a7b59d9c14fd43df864d714e2ffcef81c3ce8"} May 29 00:47:21.824425 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.824280 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" event={"ID":"a4b386c9-a3f7-44fe-ae52-c0db59b62381","Type":"ContainerStarted","Data":"89784022f0f76c9803ed3f886b48ed20501fcadc1a27ad883a036f25335a9b92"} May 29 00:47:21.826140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.824954 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-222.ec2.internal" podStartSLOduration=1.8249386749999998 podStartE2EDuration="1.824938675s" podCreationTimestamp="2026-05-29 00:47:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:47:21.811668282 +0000 UTC m=+3.706879753" watchObservedRunningTime="2026-05-29 00:47:21.824938675 +0000 UTC m=+3.720150145" May 29 00:47:21.835347 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.835316 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"1fdc23d69507576496e35182851373ee9a4d905fb91f816366acd55b63c9352f"} May 29 00:47:21.939915 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:21.939814 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:22.330006 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.329907 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bkwvp"] May 29 00:47:22.333377 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.333186 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.333377 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.333341 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:22.348946 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.348171 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:22.348946 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.348232 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:22.348946 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.348407 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:22.348946 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.348466 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs podName:d6804979-c10d-4438-b86d-a07db1614952 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:24.348447459 +0000 UTC m=+6.243658921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs") pod "network-metrics-daemon-5zjvq" (UID: "d6804979-c10d-4438-b86d-a07db1614952") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:22.348946 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.348845 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:22.348946 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.348863 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:22.348946 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.348876 2563 projected.go:194] Error preparing data for projected volume kube-api-access-z6fm4 for pod openshift-network-diagnostics/network-check-target-7789b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:22.348946 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.348919 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4 podName:333130a7-e69f-412f-8a2f-b95230ac3247 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:24.348904573 +0000 UTC m=+6.244116023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z6fm4" (UniqueName: "kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4") pod "network-check-target-7789b" (UID: "333130a7-e69f-412f-8a2f-b95230ac3247") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:22.449867 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.449583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.449867 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.449637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b815e754-e8e4-458a-94e9-140867f50cd9-kubelet-config\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.449867 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.449763 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b815e754-e8e4-458a-94e9-140867f50cd9-dbus\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.550697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.550657 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b815e754-e8e4-458a-94e9-140867f50cd9-dbus\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.550894 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.550718 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.550894 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.550763 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b815e754-e8e4-458a-94e9-140867f50cd9-kubelet-config\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.550995 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.550914 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b815e754-e8e4-458a-94e9-140867f50cd9-kubelet-config\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.551554 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.551062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b815e754-e8e4-458a-94e9-140867f50cd9-dbus\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:22.551554 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.551173 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:22.551554 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:22.551232 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret podName:b815e754-e8e4-458a-94e9-140867f50cd9 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:23.051212588 +0000 UTC m=+4.946424050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret") pod "global-pull-secret-syncer-bkwvp" (UID: "b815e754-e8e4-458a-94e9-140867f50cd9") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:22.846805 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.846772 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" event={"ID":"fde578dffbcfc02d42fcb16feac52cec","Type":"ContainerStarted","Data":"32dccb068abc9cf86e31524021c5b04ee773558a50e21c762e2709bec6b86f15"} May 29 00:47:22.862767 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:22.862445 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-222.ec2.internal" podStartSLOduration=2.862424429 podStartE2EDuration="2.862424429s" podCreationTimestamp="2026-05-29 00:47:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:47:22.861710515 +0000 UTC m=+4.756921984" watchObservedRunningTime="2026-05-29 00:47:22.862424429 +0000 UTC m=+4.757635898" May 29 00:47:23.054707 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:23.054666 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:23.054946 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:23.054926 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:23.055015 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:23.055002 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret podName:b815e754-e8e4-458a-94e9-140867f50cd9 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:24.054981926 +0000 UTC m=+5.950193378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret") pod "global-pull-secret-syncer-bkwvp" (UID: "b815e754-e8e4-458a-94e9-140867f50cd9") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:23.752678 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:23.752599 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:23.752871 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:23.752750 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:23.752871 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:23.752822 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:23.752871 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:23.752838 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:23.753027 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:23.752900 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:23.753027 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:23.752993 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:24.063657 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:24.062714 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:24.063657 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:24.062901 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:24.063657 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:24.062961 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret podName:b815e754-e8e4-458a-94e9-140867f50cd9 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:26.062943552 +0000 UTC m=+7.958155005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret") pod "global-pull-secret-syncer-bkwvp" (UID: "b815e754-e8e4-458a-94e9-140867f50cd9") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:24.366516 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:24.365670 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:24.366516 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:24.365752 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:24.366516 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:24.365895 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:24.366516 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:24.365964 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs podName:d6804979-c10d-4438-b86d-a07db1614952 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:28.365944671 +0000 UTC m=+10.261156119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs") pod "network-metrics-daemon-5zjvq" (UID: "d6804979-c10d-4438-b86d-a07db1614952") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:24.366516 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:24.366353 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:24.366516 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:24.366372 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:24.366516 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:24.366385 2563 projected.go:194] Error preparing data for projected volume kube-api-access-z6fm4 for pod openshift-network-diagnostics/network-check-target-7789b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:24.366516 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:24.366429 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4 podName:333130a7-e69f-412f-8a2f-b95230ac3247 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:28.366414719 +0000 UTC m=+10.261626167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z6fm4" (UniqueName: "kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4") pod "network-check-target-7789b" (UID: "333130a7-e69f-412f-8a2f-b95230ac3247") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:25.752586 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:25.752547 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:25.753138 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:25.752712 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:25.753138 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:25.753117 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:25.753255 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:25.753231 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:25.753341 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:25.753283 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:25.753394 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:25.753351 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:26.081144 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:26.081049 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:26.081319 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:26.081245 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:26.081319 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:26.081311 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret podName:b815e754-e8e4-458a-94e9-140867f50cd9 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:30.081291678 +0000 UTC m=+11.976503126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret") pod "global-pull-secret-syncer-bkwvp" (UID: "b815e754-e8e4-458a-94e9-140867f50cd9") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:27.753317 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:27.753280 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:27.753816 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:27.753446 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:27.753975 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:27.753945 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:27.754169 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:27.754029 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:27.754288 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:27.754249 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:27.754356 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:27.754343 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:28.399805 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:28.399763 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:28.399997 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:28.399829 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:28.399997 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:28.399958 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:28.400124 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:28.400015 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs podName:d6804979-c10d-4438-b86d-a07db1614952 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:36.399996436 +0000 UTC m=+18.295207886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs") pod "network-metrics-daemon-5zjvq" (UID: "d6804979-c10d-4438-b86d-a07db1614952") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:28.400124 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:28.400093 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:28.400124 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:28.400107 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:28.400124 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:28.400117 2563 projected.go:194] Error preparing data for projected volume kube-api-access-z6fm4 for pod openshift-network-diagnostics/network-check-target-7789b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:28.400321 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:28.400142 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4 podName:333130a7-e69f-412f-8a2f-b95230ac3247 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:36.400133958 +0000 UTC m=+18.295345404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z6fm4" (UniqueName: "kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4") pod "network-check-target-7789b" (UID: "333130a7-e69f-412f-8a2f-b95230ac3247") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:29.753387 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:29.753345 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:29.753387 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:29.753378 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:29.753908 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:29.753409 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:29.753908 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:29.753478 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:29.754027 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:29.753999 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:29.754122 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:29.754101 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:30.112673 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:30.112587 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:30.112932 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:30.112780 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:30.112932 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:30.112858 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret podName:b815e754-e8e4-458a-94e9-140867f50cd9 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:38.112837527 +0000 UTC m=+20.008048980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret") pod "global-pull-secret-syncer-bkwvp" (UID: "b815e754-e8e4-458a-94e9-140867f50cd9") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:31.753549 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:31.753451 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:31.753549 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:31.753478 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:31.753549 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:31.753478 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:31.754103 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:31.753581 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:31.754103 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:31.753668 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:31.754103 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:31.753751 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:33.752571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:33.752534 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:33.753025 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:33.752661 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:33.753087 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:33.753060 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:33.753166 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:33.753147 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:33.753221 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:33.753212 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:33.753280 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:33.753267 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:35.752919 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:35.752875 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:35.752919 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:35.752898 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:35.753361 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:35.752883 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:35.753361 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:35.752985 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:35.753361 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:35.753103 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:35.753361 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:35.753176 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:36.457875 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:36.457828 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:36.458057 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:36.457894 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:36.458057 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:36.458016 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:36.458057 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:36.458052 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:36.458206 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:36.458066 2563 projected.go:194] Error preparing data for projected volume kube-api-access-z6fm4 for pod openshift-network-diagnostics/network-check-target-7789b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:36.458206 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:36.458024 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:36.458206 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:36.458125 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4 podName:333130a7-e69f-412f-8a2f-b95230ac3247 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:52.45810938 +0000 UTC m=+34.353320842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z6fm4" (UniqueName: "kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4") pod "network-check-target-7789b" (UID: "333130a7-e69f-412f-8a2f-b95230ac3247") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:36.458206 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:36.458171 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs podName:d6804979-c10d-4438-b86d-a07db1614952 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:52.458153921 +0000 UTC m=+34.353365387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs") pod "network-metrics-daemon-5zjvq" (UID: "d6804979-c10d-4438-b86d-a07db1614952") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:37.753421 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:37.753385 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:37.753968 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:37.753385 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:37.753968 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:37.753507 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:37.753968 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:37.753609 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:37.753968 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:37.753385 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:37.753968 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:37.753748 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:38.167835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:38.167750 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:38.167991 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:38.167921 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:38.168033 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:38.167995 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret podName:b815e754-e8e4-458a-94e9-140867f50cd9 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:54.167978978 +0000 UTC m=+36.063190424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret") pod "global-pull-secret-syncer-bkwvp" (UID: "b815e754-e8e4-458a-94e9-140867f50cd9") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:39.752888 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.752632 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:39.753419 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.752788 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:39.753419 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:39.752981 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:39.753419 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.752826 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:39.753419 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:39.753049 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:39.753419 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:39.753105 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:39.883486 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.883418 2563 generic.go:358] "Generic (PLEG): container finished" podID="8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed" containerID="d14ff950970d0d4e5a84151bfb8978a77c2466014950d1aa545a36997093c664" exitCode=0 May 29 00:47:39.883586 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.883490 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerDied","Data":"d14ff950970d0d4e5a84151bfb8978a77c2466014950d1aa545a36997093c664"} May 29 00:47:39.885461 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.885438 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mdrgh" event={"ID":"9ceed120-d7b0-4e23-a600-545bd7c79900","Type":"ContainerStarted","Data":"ae0521064cbc8211b7bc8a0d948e92dee4403f9c035228a9c270585e16ccf36e"} May 29 00:47:39.887713 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.887690 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-chg5d" event={"ID":"79137623-f01b-4338-91c4-807834d1d3fa","Type":"ContainerStarted","Data":"849ae5cb364556cda046bbf8bc4f020c1960c922c3cb27773caca87201b7017b"} May 29 00:47:39.889059 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.889036 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n9v8g" event={"ID":"cf0454e9-24a1-4a3f-8ccd-335b81975306","Type":"ContainerStarted","Data":"a13731cb8aff39cb76c50a72f4f37ef216ac28bdfc905e0e2cad77bf6fbd5f81"} May 29 00:47:39.890619 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.890553 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" event={"ID":"5c1695f9-b180-4f5a-8106-74202aa33a8e","Type":"ContainerStarted","Data":"edb1b169c448f16d921375cdf66dbcd0583b236866f072c09088cadf6c910fbc"} May 29 00:47:39.892136 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.892114 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" event={"ID":"a4b386c9-a3f7-44fe-ae52-c0db59b62381","Type":"ContainerStarted","Data":"4c11d26eccf442cfcb50053aa76402addc6375d0a847f6a4d174869f42e62d04"} May 29 00:47:39.893830 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.893807 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:47:39.894224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.894200 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"a4c1dc40824c8cfad17eb18946550dd363bea6cac66f0efa6c2864e9e3dc8e0a"} May 29 00:47:39.894320 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.894234 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"7c9256e01cf83b2b74a6257a18798fbd9985496892c53b34e499eefb02e48daa"} May 29 00:47:39.895426 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.895403 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7drtj" event={"ID":"d3612180-cb43-4b20-b9c2-aaa11191ee34","Type":"ContainerStarted","Data":"7b667de30e8419f95d4a687da55a36077b19163ad6d9aa1036f7e972d0e59542"} May 29 00:47:39.931828 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.931777 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vlpzb" podStartSLOduration=3.8516337160000003 podStartE2EDuration="21.931757867s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.294998606 +0000 UTC m=+3.190210058" lastFinishedPulling="2026-05-29 00:47:39.375122758 +0000 UTC m=+21.270334209" observedRunningTime="2026-05-29 00:47:39.930904894 +0000 UTC m=+21.826116361" watchObservedRunningTime="2026-05-29 00:47:39.931757867 +0000 UTC m=+21.826969336" May 29 00:47:39.945591 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.945552 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-n9v8g" podStartSLOduration=3.860769784 podStartE2EDuration="21.945537585s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.287442994 +0000 UTC m=+3.182654444" lastFinishedPulling="2026-05-29 00:47:39.372210783 +0000 UTC m=+21.267422245" observedRunningTime="2026-05-29 00:47:39.94517195 +0000 UTC m=+21.840383420" watchObservedRunningTime="2026-05-29 00:47:39.945537585 +0000 UTC m=+21.840749044" May 29 00:47:39.958998 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.958956 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-chg5d" podStartSLOduration=7.385911059 podStartE2EDuration="21.958941921s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.293561335 +0000 UTC m=+3.188772795" lastFinishedPulling="2026-05-29 00:47:35.866592208 +0000 UTC m=+17.761803657" observedRunningTime="2026-05-29 00:47:39.958451215 +0000 UTC m=+21.853662686" watchObservedRunningTime="2026-05-29 00:47:39.958941921 +0000 UTC m=+21.854153389" May 29 00:47:39.977224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.977175 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mdrgh" podStartSLOduration=7.404697648 podStartE2EDuration="21.977157252s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.294185524 +0000 UTC m=+3.189396970" lastFinishedPulling="2026-05-29 00:47:35.866645115 +0000 UTC m=+17.761856574" observedRunningTime="2026-05-29 00:47:39.971424464 +0000 UTC m=+21.866635929" watchObservedRunningTime="2026-05-29 00:47:39.977157252 +0000 UTC m=+21.872368717" May 29 00:47:39.993020 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:39.992881 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7drtj" podStartSLOduration=3.580200644 podStartE2EDuration="21.992865591s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.297954251 +0000 UTC m=+3.193165711" lastFinishedPulling="2026-05-29 00:47:39.710619207 +0000 UTC m=+21.605830658" observedRunningTime="2026-05-29 00:47:39.992425215 +0000 UTC m=+21.887636683" watchObservedRunningTime="2026-05-29 00:47:39.992865591 +0000 UTC m=+21.888077058" May 29 00:47:40.899674 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:40.899644 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:47:40.900235 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:40.900035 2563 generic.go:358] "Generic (PLEG): container finished" podID="a822de23-8992-414d-be69-f204e3496364" containerID="a4c1dc40824c8cfad17eb18946550dd363bea6cac66f0efa6c2864e9e3dc8e0a" exitCode=1 May 29 00:47:40.900235 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:40.900162 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerDied","Data":"a4c1dc40824c8cfad17eb18946550dd363bea6cac66f0efa6c2864e9e3dc8e0a"} May 29 00:47:40.900235 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:40.900198 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"4b78543edd46d3cf22079bc372c480abcd531d8be5c5b9a2aeae1f666bd47e1b"} May 29 00:47:40.900235 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:40.900207 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"05df51e167ae3924a043723981c96261a70baf529f64069180668b8a05e0f666"} May 29 00:47:40.900235 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:40.900218 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"3ea329013ee5beebd57163d306383b9194f6e63229b2c5f6dfc123685997e47f"} May 29 00:47:40.900235 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:40.900231 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"00cf6ceb83e465ab3d4d2a36b94dc9c39855f3d35d80f4fc0e6bc87910943658"} May 29 00:47:40.919145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:40.919117 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 00:47:41.696831 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.696695 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T00:47:40.919140975Z","UUID":"c02b800f-d8ce-4877-9a72-6d7bfc675787","Handler":null,"Name":"","Endpoint":""} May 29 00:47:41.699137 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.698699 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 00:47:41.699137 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.698757 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 00:47:41.752892 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.752855 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:41.753082 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.752859 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:41.753082 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:41.753002 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:41.753203 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:41.753123 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:41.753203 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.753159 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:41.753284 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:41.753255 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:41.903558 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.903522 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" event={"ID":"5c1695f9-b180-4f5a-8106-74202aa33a8e","Type":"ContainerStarted","Data":"bec80a25fa84ec069a969a36a628dd949229a62210723775543d00db5dfc272b"} May 29 00:47:41.904773 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.904748 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xkz9" event={"ID":"c7dfcb4c-47ac-460e-988b-089fbfcc09ff","Type":"ContainerStarted","Data":"b1d61db1e0198f8101487ff48128be72a8d68ef6972cabc07b1aa14c748c74b9"} May 29 00:47:41.917851 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:41.917813 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4xkz9" podStartSLOduration=5.83492593 podStartE2EDuration="23.917800716s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.28965186 +0000 UTC m=+3.184863320" lastFinishedPulling="2026-05-29 00:47:39.372526661 +0000 UTC m=+21.267738106" observedRunningTime="2026-05-29 00:47:41.91754004 +0000 UTC m=+23.812751498" watchObservedRunningTime="2026-05-29 00:47:41.917800716 +0000 UTC m=+23.813012183" May 29 00:47:42.908641 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:42.908406 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" event={"ID":"5c1695f9-b180-4f5a-8106-74202aa33a8e","Type":"ContainerStarted","Data":"4435375f4c34fcabbae8bc4af82b085c82158befa30cd4bc1f1bdaac59a85bcd"} May 29 00:47:42.911434 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:42.911409 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:47:42.911853 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:42.911825 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"b2d542e66fb82c6d342e1ed20cbb4160c0c75e43d29ffd9b0701848874f8c04c"} May 29 00:47:42.926488 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:42.926434 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnqm5" podStartSLOduration=4.301651834 podStartE2EDuration="24.926420328s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.2992522 +0000 UTC m=+3.194463646" lastFinishedPulling="2026-05-29 00:47:41.92402068 +0000 UTC m=+23.819232140" observedRunningTime="2026-05-29 00:47:42.926273266 +0000 UTC m=+24.821484750" watchObservedRunningTime="2026-05-29 00:47:42.926420328 +0000 UTC m=+24.821631807" May 29 00:47:43.076141 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:43.076101 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:43.077242 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:43.077215 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:43.752799 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:43.752755 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:43.752799 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:43.752798 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:43.753042 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:43.752879 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:43.753042 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:43.752779 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:43.753042 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:43.753006 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:43.753182 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:43.753100 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:43.913706 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:43.913669 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:43.914368 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:43.914180 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-chg5d" May 29 00:47:44.917861 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.917834 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:47:44.918419 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.918148 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"9a9fcf8478e1acc303755914d39329f78407672cc3701cc650fe8fd5c38b1de5"} May 29 00:47:44.918519 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.918475 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:44.918519 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.918506 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:44.918519 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.918520 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:44.918832 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.918814 2563 scope.go:117] "RemoveContainer" containerID="a4c1dc40824c8cfad17eb18946550dd363bea6cac66f0efa6c2864e9e3dc8e0a" May 29 00:47:44.920789 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.920769 2563 generic.go:358] "Generic (PLEG): container finished" podID="8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed" containerID="65edc9067b474161e4bd8c683c74a86080e04dd964aa0410395122be7764a373" exitCode=0 May 29 00:47:44.920960 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.920844 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerDied","Data":"65edc9067b474161e4bd8c683c74a86080e04dd964aa0410395122be7764a373"} May 29 00:47:44.937495 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.937472 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:44.940515 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:44.940491 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:47:45.756574 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:45.753105 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:45.756574 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:45.753247 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:45.756574 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:45.753710 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:45.756574 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:45.753819 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:45.756574 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:45.753895 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:45.756574 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:45.753960 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:45.926360 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:45.926338 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:47:45.926742 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:45.926699 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" event={"ID":"a822de23-8992-414d-be69-f204e3496364","Type":"ContainerStarted","Data":"0189191d2d27643fc1888525f7d118707ab89bf188ee7df3caee5d98398814ab"} May 29 00:47:45.962303 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:45.962262 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" podStartSLOduration=9.830945468 podStartE2EDuration="27.962248133s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.28856317 +0000 UTC m=+3.183774627" lastFinishedPulling="2026-05-29 00:47:39.41986583 +0000 UTC m=+21.315077292" observedRunningTime="2026-05-29 00:47:45.960511816 +0000 UTC m=+27.855723307" watchObservedRunningTime="2026-05-29 00:47:45.962248133 +0000 UTC m=+27.857459601" May 29 00:47:46.410260 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:46.410224 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bkwvp"] May 29 00:47:46.410444 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:46.410351 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:46.410521 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:46.410444 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:46.410860 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:46.410834 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5zjvq"] May 29 00:47:46.410970 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:46.410956 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:46.411104 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:46.411085 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:46.412797 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:46.412771 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7789b"] May 29 00:47:46.412896 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:46.412863 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:46.412951 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:46.412935 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:46.930261 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:46.930224 2563 generic.go:358] "Generic (PLEG): container finished" podID="8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed" containerID="0297ffdd099a7d11c6c5648f9c381cc44c9d23626f15ea1d6e79272f23b9b545" exitCode=0 May 29 00:47:46.930657 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:46.930295 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerDied","Data":"0297ffdd099a7d11c6c5648f9c381cc44c9d23626f15ea1d6e79272f23b9b545"} May 29 00:47:47.753017 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:47.752935 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:47.753162 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:47.753052 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:47.753162 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:47.753087 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:47.753162 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:47.753155 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:47.936894 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:47.936856 2563 generic.go:358] "Generic (PLEG): container finished" podID="8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed" containerID="bb0dc57c6db23296d2a1364f64420f3b43b9b7e0e42a0958c2d5c7da769b3e3f" exitCode=0 May 29 00:47:47.937289 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:47.936914 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerDied","Data":"bb0dc57c6db23296d2a1364f64420f3b43b9b7e0e42a0958c2d5c7da769b3e3f"} May 29 00:47:48.754679 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:48.754645 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:48.754966 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:48.754802 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:49.752878 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:49.752840 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:49.753404 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:49.752944 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:49.753404 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:49.753001 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:49.753404 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:49.753097 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:50.753279 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:50.753244 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:50.753701 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:50.753367 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zjvq" podUID="d6804979-c10d-4438-b86d-a07db1614952" May 29 00:47:51.753023 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:51.752990 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:51.753207 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:51.752993 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:51.753207 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:51.753095 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7789b" podUID="333130a7-e69f-412f-8a2f-b95230ac3247" May 29 00:47:51.753207 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:51.753194 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkwvp" podUID="b815e754-e8e4-458a-94e9-140867f50cd9" May 29 00:47:52.343092 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.343013 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-222.ec2.internal" event="NodeReady" May 29 00:47:52.343410 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.343148 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 00:47:52.374117 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.374081 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-88d576cfc-264k9"] May 29 00:47:52.440482 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.440444 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-frppt"] May 29 00:47:52.440678 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.440633 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.443582 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.443548 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fnqb5\"" May 29 00:47:52.443582 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.443567 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 00:47:52.443872 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.443848 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 00:47:52.443988 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.443943 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 00:47:52.449663 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.449636 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 00:47:52.454828 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.454800 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nxvd8"] May 29 00:47:52.454995 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.454977 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frppt" May 29 00:47:52.457662 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.457637 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7vx5w\"" May 29 00:47:52.457800 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.457705 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 00:47:52.457800 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.457719 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 00:47:52.476990 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.476828 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88d576cfc-264k9"] May 29 00:47:52.476990 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.476926 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frppt"] May 29 00:47:52.476990 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.476943 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nxvd8"] May 29 00:47:52.476990 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.476960 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:52.477324 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.477060 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:52.477324 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.477099 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:52.477324 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.477226 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:52.477324 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.477292 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs podName:d6804979-c10d-4438-b86d-a07db1614952 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:24.477274242 +0000 UTC m=+66.372485693 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs") pod "network-metrics-daemon-5zjvq" (UID: "d6804979-c10d-4438-b86d-a07db1614952") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:52.477538 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.477371 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:52.477538 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.477391 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:52.477538 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.477404 2563 projected.go:194] Error preparing data for projected volume kube-api-access-z6fm4 for pod openshift-network-diagnostics/network-check-target-7789b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:52.477538 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.477474 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4 podName:333130a7-e69f-412f-8a2f-b95230ac3247 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:24.477458412 +0000 UTC m=+66.372669872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z6fm4" (UniqueName: "kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4") pod "network-check-target-7789b" (UID: "333130a7-e69f-412f-8a2f-b95230ac3247") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:52.479891 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.479860 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nghjs\"" May 29 00:47:52.480011 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.479922 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 00:47:52.480740 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.480214 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 00:47:52.480740 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.480239 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 00:47:52.577830 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.577791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-trusted-ca\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.577830 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.577836 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94f75f66-3473-4bd4-947b-bda5c8a3f20a-config-volume\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.578067 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.577939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-image-registry-private-configuration\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.578067 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.577976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x6v9\" (UniqueName: \"kubernetes.io/projected/94f75f66-3473-4bd4-947b-bda5c8a3f20a-kube-api-access-9x6v9\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.578067 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-certificates\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.578067 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-bound-sa-token\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.578067 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578055 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t99td\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-kube-api-access-t99td\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.578323 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-installation-pull-secrets\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.578323 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrsv7\" (UniqueName: \"kubernetes.io/projected/9d070427-f9ce-42e0-a897-35562ec8045f-kube-api-access-vrsv7\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:52.578323 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:52.578323 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.578323 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.578323 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f75f66-3473-4bd4-947b-bda5c8a3f20a-tmp-dir\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.578323 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.578267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eed0547e-57d1-4902-8664-08a4e8d00e72-ca-trust-extracted\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679280 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679243 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-trusted-ca\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679280 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679278 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94f75f66-3473-4bd4-947b-bda5c8a3f20a-config-volume\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.679505 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679436 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-image-registry-private-configuration\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679505 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679480 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9x6v9\" (UniqueName: \"kubernetes.io/projected/94f75f66-3473-4bd4-947b-bda5c8a3f20a-kube-api-access-9x6v9\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.679576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679515 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-certificates\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679548 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-bound-sa-token\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679670 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679573 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t99td\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-kube-api-access-t99td\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679670 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679604 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-installation-pull-secrets\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679805 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679676 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrsv7\" (UniqueName: \"kubernetes.io/projected/9d070427-f9ce-42e0-a897-35562ec8045f-kube-api-access-vrsv7\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:52.679805 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679750 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:52.679805 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679785 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679951 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679809 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.679951 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679835 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f75f66-3473-4bd4-947b-bda5c8a3f20a-tmp-dir\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.679951 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679867 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eed0547e-57d1-4902-8664-08a4e8d00e72-ca-trust-extracted\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.679951 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.679872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94f75f66-3473-4bd4-947b-bda5c8a3f20a-config-volume\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.680137 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.680016 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 00:47:52.680137 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.680032 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88d576cfc-264k9: secret "image-registry-tls" not found May 29 00:47:52.680137 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.680081 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls podName:eed0547e-57d1-4902-8664-08a4e8d00e72 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:53.180065163 +0000 UTC m=+35.075276609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls") pod "image-registry-88d576cfc-264k9" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72") : secret "image-registry-tls" not found May 29 00:47:52.680309 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.680163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-certificates\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.680309 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.680175 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:47:52.680309 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.680217 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert podName:9d070427-f9ce-42e0-a897-35562ec8045f nodeName:}" failed. No retries permitted until 2026-05-29 00:47:53.180203848 +0000 UTC m=+35.075415294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert") pod "ingress-canary-nxvd8" (UID: "9d070427-f9ce-42e0-a897-35562ec8045f") : secret "canary-serving-cert" not found May 29 00:47:52.680309 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.680241 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eed0547e-57d1-4902-8664-08a4e8d00e72-ca-trust-extracted\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.680309 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.680290 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:47:52.680554 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:52.680325 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls podName:94f75f66-3473-4bd4-947b-bda5c8a3f20a nodeName:}" failed. No retries permitted until 2026-05-29 00:47:53.180313933 +0000 UTC m=+35.075525380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls") pod "dns-default-frppt" (UID: "94f75f66-3473-4bd4-947b-bda5c8a3f20a") : secret "dns-default-metrics-tls" not found May 29 00:47:52.680554 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.680380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-trusted-ca\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.680656 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.680559 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f75f66-3473-4bd4-947b-bda5c8a3f20a-tmp-dir\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.683676 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.683653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-image-registry-private-configuration\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.683676 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.683667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-installation-pull-secrets\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.692616 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.692595 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-bound-sa-token\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.693061 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.693030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrsv7\" (UniqueName: \"kubernetes.io/projected/9d070427-f9ce-42e0-a897-35562ec8045f-kube-api-access-vrsv7\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:52.693165 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.693151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x6v9\" (UniqueName: \"kubernetes.io/projected/94f75f66-3473-4bd4-947b-bda5c8a3f20a-kube-api-access-9x6v9\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:52.693338 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.693319 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t99td\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-kube-api-access-t99td\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:52.752643 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.752608 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:47:52.755426 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.755395 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 00:47:52.755953 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:52.755524 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rlrhs\"" May 29 00:47:53.183819 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.183784 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:53.183819 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.183832 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:53.184170 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:53.183942 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 00:47:53.184170 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.183953 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:53.184170 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:53.183965 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88d576cfc-264k9: secret "image-registry-tls" not found May 29 00:47:53.184170 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:53.183984 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:47:53.184170 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:53.184046 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls podName:eed0547e-57d1-4902-8664-08a4e8d00e72 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:54.184024671 +0000 UTC m=+36.079236123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls") pod "image-registry-88d576cfc-264k9" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72") : secret "image-registry-tls" not found May 29 00:47:53.184170 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:53.184062 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls podName:94f75f66-3473-4bd4-947b-bda5c8a3f20a nodeName:}" failed. No retries permitted until 2026-05-29 00:47:54.184054811 +0000 UTC m=+36.079266261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls") pod "dns-default-frppt" (UID: "94f75f66-3473-4bd4-947b-bda5c8a3f20a") : secret "dns-default-metrics-tls" not found May 29 00:47:53.184170 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:53.184061 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:47:53.184170 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:53.184113 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert podName:9d070427-f9ce-42e0-a897-35562ec8045f nodeName:}" failed. No retries permitted until 2026-05-29 00:47:54.184096559 +0000 UTC m=+36.079308021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert") pod "ingress-canary-nxvd8" (UID: "9d070427-f9ce-42e0-a897-35562ec8045f") : secret "canary-serving-cert" not found May 29 00:47:53.753078 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.753041 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:53.753364 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.753041 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:47:53.756270 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.756242 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 00:47:53.756647 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.756416 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 00:47:53.756704 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.756670 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 00:47:53.757697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:53.757676 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c2thf\"" May 29 00:47:54.192322 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:54.192286 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:54.192322 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:54.192326 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:54.192590 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:54.192355 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:54.192590 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:54.192457 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:47:54.192590 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:54.192467 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 00:47:54.192590 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:54.192488 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88d576cfc-264k9: secret "image-registry-tls" not found May 29 00:47:54.192590 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:54.192457 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:47:54.192590 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:54.192521 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert podName:9d070427-f9ce-42e0-a897-35562ec8045f nodeName:}" failed. No retries permitted until 2026-05-29 00:47:56.192500707 +0000 UTC m=+38.087712154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert") pod "ingress-canary-nxvd8" (UID: "9d070427-f9ce-42e0-a897-35562ec8045f") : secret "canary-serving-cert" not found May 29 00:47:54.192590 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:54.192547 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls podName:eed0547e-57d1-4902-8664-08a4e8d00e72 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:56.192529927 +0000 UTC m=+38.087741395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls") pod "image-registry-88d576cfc-264k9" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72") : secret "image-registry-tls" not found May 29 00:47:54.192590 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:54.192570 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls podName:94f75f66-3473-4bd4-947b-bda5c8a3f20a nodeName:}" failed. No retries permitted until 2026-05-29 00:47:56.192560763 +0000 UTC m=+38.087772216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls") pod "dns-default-frppt" (UID: "94f75f66-3473-4bd4-947b-bda5c8a3f20a") : secret "dns-default-metrics-tls" not found May 29 00:47:54.192934 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:54.192647 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:54.195034 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:54.195018 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b815e754-e8e4-458a-94e9-140867f50cd9-original-pull-secret\") pod \"global-pull-secret-syncer-bkwvp\" (UID: \"b815e754-e8e4-458a-94e9-140867f50cd9\") " pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:54.364864 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:54.364824 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkwvp" May 29 00:47:54.537536 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:54.537345 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bkwvp"] May 29 00:47:54.541430 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:47:54.541373 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb815e754_e8e4_458a_94e9_140867f50cd9.slice/crio-1dac6cc696cd1c01d69252747f1801dd059fa1e5c0181b8ea6af7127c1829c63 WatchSource:0}: Error finding container 1dac6cc696cd1c01d69252747f1801dd059fa1e5c0181b8ea6af7127c1829c63: Status 404 returned error can't find the container with id 1dac6cc696cd1c01d69252747f1801dd059fa1e5c0181b8ea6af7127c1829c63 May 29 00:47:54.951712 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:54.951669 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bkwvp" event={"ID":"b815e754-e8e4-458a-94e9-140867f50cd9","Type":"ContainerStarted","Data":"1dac6cc696cd1c01d69252747f1801dd059fa1e5c0181b8ea6af7127c1829c63"} May 29 00:47:56.206271 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:56.206193 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:56.206307 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:56.206346 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:56.206378 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:56.206423 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert podName:9d070427-f9ce-42e0-a897-35562ec8045f nodeName:}" failed. No retries permitted until 2026-05-29 00:48:00.206401509 +0000 UTC m=+42.101612962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert") pod "ingress-canary-nxvd8" (UID: "9d070427-f9ce-42e0-a897-35562ec8045f") : secret "canary-serving-cert" not found May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:56.206502 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:56.206543 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls podName:94f75f66-3473-4bd4-947b-bda5c8a3f20a nodeName:}" failed. No retries permitted until 2026-05-29 00:48:00.206531503 +0000 UTC m=+42.101742948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls") pod "dns-default-frppt" (UID: "94f75f66-3473-4bd4-947b-bda5c8a3f20a") : secret "dns-default-metrics-tls" not found May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:56.206593 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:56.206600 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88d576cfc-264k9: secret "image-registry-tls" not found May 29 00:47:56.206631 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:47:56.206622 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls podName:eed0547e-57d1-4902-8664-08a4e8d00e72 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:00.206615401 +0000 UTC m=+42.101826847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls") pod "image-registry-88d576cfc-264k9" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72") : secret "image-registry-tls" not found May 29 00:47:57.960131 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:57.960081 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerStarted","Data":"69f5d74de37e50e5a2a458b54e9efa163a8f214259294e78389e51e7ba467031"} May 29 00:47:58.965223 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:58.965183 2563 generic.go:358] "Generic (PLEG): container finished" podID="8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed" containerID="69f5d74de37e50e5a2a458b54e9efa163a8f214259294e78389e51e7ba467031" exitCode=0 May 29 00:47:58.965678 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:47:58.965255 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerDied","Data":"69f5d74de37e50e5a2a458b54e9efa163a8f214259294e78389e51e7ba467031"} May 29 00:48:00.242106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:00.242075 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:00.242120 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:00.242150 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:00.242219 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:00.242270 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:00.242295 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert podName:9d070427-f9ce-42e0-a897-35562ec8045f nodeName:}" failed. No retries permitted until 2026-05-29 00:48:08.242279317 +0000 UTC m=+50.137490762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert") pod "ingress-canary-nxvd8" (UID: "9d070427-f9ce-42e0-a897-35562ec8045f") : secret "canary-serving-cert" not found May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:00.242297 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88d576cfc-264k9: secret "image-registry-tls" not found May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:00.242297 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:00.242345 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls podName:eed0547e-57d1-4902-8664-08a4e8d00e72 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:08.242331101 +0000 UTC m=+50.137542551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls") pod "image-registry-88d576cfc-264k9" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72") : secret "image-registry-tls" not found May 29 00:48:00.242492 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:00.242364 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls podName:94f75f66-3473-4bd4-947b-bda5c8a3f20a nodeName:}" failed. No retries permitted until 2026-05-29 00:48:08.242355229 +0000 UTC m=+50.137566675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls") pod "dns-default-frppt" (UID: "94f75f66-3473-4bd4-947b-bda5c8a3f20a") : secret "dns-default-metrics-tls" not found May 29 00:48:00.970951 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:00.970913 2563 generic.go:358] "Generic (PLEG): container finished" podID="8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed" containerID="5b593bf8a8f55034adb9c7a0b0638f909030391ce42d336c7b68bdd2948281ce" exitCode=0 May 29 00:48:00.971139 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:00.970986 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerDied","Data":"5b593bf8a8f55034adb9c7a0b0638f909030391ce42d336c7b68bdd2948281ce"} May 29 00:48:00.972231 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:00.972208 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bkwvp" event={"ID":"b815e754-e8e4-458a-94e9-140867f50cd9","Type":"ContainerStarted","Data":"d9e888a46e95e2ff9e9c034453465c4cb1b130c5b1b1f381b2349b0c79328687"} May 29 00:48:01.005592 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:01.005546 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bkwvp" podStartSLOduration=33.152118591 podStartE2EDuration="39.005531039s" podCreationTimestamp="2026-05-29 00:47:22 +0000 UTC" firstStartedPulling="2026-05-29 00:47:54.543506729 +0000 UTC m=+36.438718175" lastFinishedPulling="2026-05-29 00:48:00.396919174 +0000 UTC m=+42.292130623" observedRunningTime="2026-05-29 00:48:01.005045662 +0000 UTC m=+42.900257129" watchObservedRunningTime="2026-05-29 00:48:01.005531039 +0000 UTC m=+42.900742506" May 29 00:48:01.977057 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:01.977022 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" event={"ID":"8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed","Type":"ContainerStarted","Data":"c4a6f3239d74afa632f363f218755eca57a34f73216f9598ddff9df71d50de4a"} May 29 00:48:01.999986 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:01.999940 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6wbkg" podStartSLOduration=7.584233276 podStartE2EDuration="43.999925746s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:47:21.297663492 +0000 UTC m=+3.192874938" lastFinishedPulling="2026-05-29 00:47:57.71335596 +0000 UTC m=+39.608567408" observedRunningTime="2026-05-29 00:48:01.999405427 +0000 UTC m=+43.894616897" watchObservedRunningTime="2026-05-29 00:48:01.999925746 +0000 UTC m=+43.895137213" May 29 00:48:08.304924 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:08.304877 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:48:08.304924 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:08.304925 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:48:08.305465 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:08.304944 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:48:08.305465 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:08.305043 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:48:08.305465 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:08.305104 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:48:08.305465 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:08.305045 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 00:48:08.305465 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:08.305176 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88d576cfc-264k9: secret "image-registry-tls" not found May 29 00:48:08.305465 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:08.305110 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert podName:9d070427-f9ce-42e0-a897-35562ec8045f nodeName:}" failed. No retries permitted until 2026-05-29 00:48:24.305093805 +0000 UTC m=+66.200305251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert") pod "ingress-canary-nxvd8" (UID: "9d070427-f9ce-42e0-a897-35562ec8045f") : secret "canary-serving-cert" not found May 29 00:48:08.305465 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:08.305254 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls podName:94f75f66-3473-4bd4-947b-bda5c8a3f20a nodeName:}" failed. No retries permitted until 2026-05-29 00:48:24.3052397 +0000 UTC m=+66.200451150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls") pod "dns-default-frppt" (UID: "94f75f66-3473-4bd4-947b-bda5c8a3f20a") : secret "dns-default-metrics-tls" not found May 29 00:48:08.305465 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:08.305266 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls podName:eed0547e-57d1-4902-8664-08a4e8d00e72 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:24.305260635 +0000 UTC m=+66.200472081 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls") pod "image-registry-88d576cfc-264k9" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72") : secret "image-registry-tls" not found May 29 00:48:16.941704 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:16.941673 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ftcp" May 29 00:48:24.319242 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.319209 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:48:24.319242 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.319246 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:48:24.319786 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.319265 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:48:24.319786 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.319348 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 00:48:24.319786 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.319359 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88d576cfc-264k9: secret "image-registry-tls" not found May 29 00:48:24.319786 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.319358 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:48:24.319786 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.319406 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls podName:eed0547e-57d1-4902-8664-08a4e8d00e72 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:56.319390421 +0000 UTC m=+98.214601891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls") pod "image-registry-88d576cfc-264k9" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72") : secret "image-registry-tls" not found May 29 00:48:24.319786 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.319459 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert podName:9d070427-f9ce-42e0-a897-35562ec8045f nodeName:}" failed. No retries permitted until 2026-05-29 00:48:56.319438827 +0000 UTC m=+98.214650276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert") pod "ingress-canary-nxvd8" (UID: "9d070427-f9ce-42e0-a897-35562ec8045f") : secret "canary-serving-cert" not found May 29 00:48:24.319786 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.319460 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:48:24.319786 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.319529 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls podName:94f75f66-3473-4bd4-947b-bda5c8a3f20a nodeName:}" failed. No retries permitted until 2026-05-29 00:48:56.31951229 +0000 UTC m=+98.214723749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls") pod "dns-default-frppt" (UID: "94f75f66-3473-4bd4-947b-bda5c8a3f20a") : secret "dns-default-metrics-tls" not found May 29 00:48:24.520322 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.520283 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:48:24.520322 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.520326 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:48:24.523060 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.523040 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 00:48:24.523219 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.523198 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 00:48:24.531530 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.531509 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 00:48:24.531604 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:24.531557 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs podName:d6804979-c10d-4438-b86d-a07db1614952 nodeName:}" failed. No retries permitted until 2026-05-29 00:49:28.531543125 +0000 UTC m=+130.426754571 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs") pod "network-metrics-daemon-5zjvq" (UID: "d6804979-c10d-4438-b86d-a07db1614952") : secret "metrics-daemon-secret" not found May 29 00:48:24.534070 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.534055 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 00:48:24.546011 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.545986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6fm4\" (UniqueName: \"kubernetes.io/projected/333130a7-e69f-412f-8a2f-b95230ac3247-kube-api-access-z6fm4\") pod \"network-check-target-7789b\" (UID: \"333130a7-e69f-412f-8a2f-b95230ac3247\") " pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:48:24.684345 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.684316 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c2thf\"" May 29 00:48:24.690957 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.690935 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:48:24.823025 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:24.823001 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7789b"] May 29 00:48:24.825152 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:48:24.825121 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333130a7_e69f_412f_8a2f_b95230ac3247.slice/crio-25e5664a5a1e27641654ce913b20d29c7bb863affdd2ccabb10d7327738839b3 WatchSource:0}: Error finding container 25e5664a5a1e27641654ce913b20d29c7bb863affdd2ccabb10d7327738839b3: Status 404 returned error can't find the container with id 25e5664a5a1e27641654ce913b20d29c7bb863affdd2ccabb10d7327738839b3 May 29 00:48:25.023402 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:25.023310 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7789b" event={"ID":"333130a7-e69f-412f-8a2f-b95230ac3247","Type":"ContainerStarted","Data":"25e5664a5a1e27641654ce913b20d29c7bb863affdd2ccabb10d7327738839b3"} May 29 00:48:28.031949 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:28.031861 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7789b" event={"ID":"333130a7-e69f-412f-8a2f-b95230ac3247","Type":"ContainerStarted","Data":"09f1bd79551d4f75cc3d6eceff91e334552ccc96b71131dd479f8e4f9ff26be0"} May 29 00:48:28.032322 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:28.031983 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:48:49.775837 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.775780 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7789b" podStartSLOduration=88.945721323 podStartE2EDuration="1m31.775762205s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:48:24.826986861 +0000 UTC m=+66.722198306" lastFinishedPulling="2026-05-29 00:48:27.65702773 +0000 UTC m=+69.552239188" observedRunningTime="2026-05-29 00:48:28.046287893 +0000 UTC m=+69.941499386" watchObservedRunningTime="2026-05-29 00:48:49.775762205 +0000 UTC m=+91.670973673" May 29 00:48:49.776575 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.776552 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4"] May 29 00:48:49.779024 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.778999 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.779929 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.779905 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-66nzn"] May 29 00:48:49.781467 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.781441 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.782342 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.782318 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 29 00:48:49.782653 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.782363 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4rc6l\"" May 29 00:48:49.785631 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.784946 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 00:48:49.785631 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.785312 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 00:48:49.785631 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.785580 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 29 00:48:49.785852 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.785743 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 29 00:48:49.786137 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.785957 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 29 00:48:49.786137 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.786118 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bhdwm\"" May 29 00:48:49.786585 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.786273 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 00:48:49.786702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.786685 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 00:48:49.789776 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.789696 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4"] May 29 00:48:49.791844 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.791823 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-66nzn"] May 29 00:48:49.792065 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.792025 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 29 00:48:49.796622 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.796598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5bedacc3-4921-41db-a6e4-1bc9d62f877e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.796716 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.796648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pzzh\" (UniqueName: \"kubernetes.io/projected/5bedacc3-4921-41db-a6e4-1bc9d62f877e-kube-api-access-5pzzh\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.796716 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.796688 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.889546 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.889513 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b"] May 29 00:48:49.891352 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.891328 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:49.894066 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.894045 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 29 00:48:49.894066 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.894051 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 29 00:48:49.894224 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.894051 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cdqfv\"" May 29 00:48:49.894327 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.894312 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 29 00:48:49.896988 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.896968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-tmp\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.897095 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897010 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5bedacc3-4921-41db-a6e4-1bc9d62f877e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.897095 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.897216 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-snapshots\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.897272 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897225 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pzzh\" (UniqueName: \"kubernetes.io/projected/5bedacc3-4921-41db-a6e4-1bc9d62f877e-kube-api-access-5pzzh\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.897327 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897281 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.897489 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-serving-cert\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.897489 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-service-ca-bundle\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.897489 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsltn\" (UniqueName: \"kubernetes.io/projected/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-kube-api-access-wsltn\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.897821 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:49.897588 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 00:48:49.897821 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:49.897679 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls podName:5bedacc3-4921-41db-a6e4-1bc9d62f877e nodeName:}" failed. No retries permitted until 2026-05-29 00:48:50.397660213 +0000 UTC m=+92.292871676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zf7w4" (UID: "5bedacc3-4921-41db-a6e4-1bc9d62f877e") : secret "cluster-monitoring-operator-tls" not found May 29 00:48:49.898023 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.897998 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5bedacc3-4921-41db-a6e4-1bc9d62f877e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.904565 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.904545 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b"] May 29 00:48:49.912119 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.912097 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pzzh\" (UniqueName: \"kubernetes.io/projected/5bedacc3-4921-41db-a6e4-1bc9d62f877e-kube-api-access-5pzzh\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:49.998541 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.998508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqx7j\" (UniqueName: \"kubernetes.io/projected/2da72898-dccd-4efe-b72b-b9a321ef4772-kube-api-access-xqx7j\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:49.998711 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.998586 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-serving-cert\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.998711 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.998638 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-service-ca-bundle\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.998711 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.998696 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsltn\" (UniqueName: \"kubernetes.io/projected/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-kube-api-access-wsltn\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.998864 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.998718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:49.998864 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.998798 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-tmp\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.998864 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.998838 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.998993 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.998866 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-snapshots\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.999293 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.999204 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-tmp\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.999450 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.999377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-service-ca-bundle\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.999450 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.999393 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-snapshots\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:49.999778 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:49.999760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:50.000994 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.000974 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-serving-cert\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:50.006893 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.006874 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsltn\" (UniqueName: \"kubernetes.io/projected/31c35fd7-f103-4f3b-b39c-b5557b7ebe92-kube-api-access-wsltn\") pod \"insights-operator-78bdfb888c-66nzn\" (UID: \"31c35fd7-f103-4f3b-b39c-b5557b7ebe92\") " pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:50.097846 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.097822 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-66nzn" May 29 00:48:50.099611 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.099582 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqx7j\" (UniqueName: \"kubernetes.io/projected/2da72898-dccd-4efe-b72b-b9a321ef4772-kube-api-access-xqx7j\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:50.099712 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.099700 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:50.099865 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:50.099845 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 00:48:50.099952 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:50.099938 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls podName:2da72898-dccd-4efe-b72b-b9a321ef4772 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:50.599917056 +0000 UTC m=+92.495128526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls") pod "cluster-samples-operator-697587599-jgj8b" (UID: "2da72898-dccd-4efe-b72b-b9a321ef4772") : secret "samples-operator-tls" not found May 29 00:48:50.108314 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.108280 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqx7j\" (UniqueName: \"kubernetes.io/projected/2da72898-dccd-4efe-b72b-b9a321ef4772-kube-api-access-xqx7j\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:50.217511 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.217481 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-66nzn"] May 29 00:48:50.220420 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:48:50.220374 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c35fd7_f103_4f3b_b39c_b5557b7ebe92.slice/crio-dc1604061364e1314e5f9fbe8821be44417066371d5f40937a1357072fe70f4a WatchSource:0}: Error finding container dc1604061364e1314e5f9fbe8821be44417066371d5f40937a1357072fe70f4a: Status 404 returned error can't find the container with id dc1604061364e1314e5f9fbe8821be44417066371d5f40937a1357072fe70f4a May 29 00:48:50.401936 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.401853 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:50.402073 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:50.402002 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 00:48:50.402073 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:50.402067 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls podName:5bedacc3-4921-41db-a6e4-1bc9d62f877e nodeName:}" failed. No retries permitted until 2026-05-29 00:48:51.402051521 +0000 UTC m=+93.297262969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zf7w4" (UID: "5bedacc3-4921-41db-a6e4-1bc9d62f877e") : secret "cluster-monitoring-operator-tls" not found May 29 00:48:50.603416 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:50.603375 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:50.603581 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:50.603488 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 00:48:50.603581 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:50.603544 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls podName:2da72898-dccd-4efe-b72b-b9a321ef4772 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:51.603530464 +0000 UTC m=+93.498741912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls") pod "cluster-samples-operator-697587599-jgj8b" (UID: "2da72898-dccd-4efe-b72b-b9a321ef4772") : secret "samples-operator-tls" not found May 29 00:48:51.075139 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:51.075104 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-66nzn" event={"ID":"31c35fd7-f103-4f3b-b39c-b5557b7ebe92","Type":"ContainerStarted","Data":"dc1604061364e1314e5f9fbe8821be44417066371d5f40937a1357072fe70f4a"} May 29 00:48:51.409489 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:51.409451 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:51.409678 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:51.409617 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 00:48:51.409765 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:51.409697 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls podName:5bedacc3-4921-41db-a6e4-1bc9d62f877e nodeName:}" failed. No retries permitted until 2026-05-29 00:48:53.409676496 +0000 UTC m=+95.304887942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zf7w4" (UID: "5bedacc3-4921-41db-a6e4-1bc9d62f877e") : secret "cluster-monitoring-operator-tls" not found May 29 00:48:51.612140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:51.612102 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:51.612333 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:51.612272 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 00:48:51.612398 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:51.612354 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls podName:2da72898-dccd-4efe-b72b-b9a321ef4772 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:53.612330788 +0000 UTC m=+95.507542239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls") pod "cluster-samples-operator-697587599-jgj8b" (UID: "2da72898-dccd-4efe-b72b-b9a321ef4772") : secret "samples-operator-tls" not found May 29 00:48:52.078310 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:52.078277 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-66nzn" event={"ID":"31c35fd7-f103-4f3b-b39c-b5557b7ebe92","Type":"ContainerStarted","Data":"f0d5a8c2615caad085436599e78d66803da882bd0e328a6c58d587f3f3dbf0ff"} May 29 00:48:52.093921 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:52.093745 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-66nzn" podStartSLOduration=1.400379589 podStartE2EDuration="3.09371321s" podCreationTimestamp="2026-05-29 00:48:49 +0000 UTC" firstStartedPulling="2026-05-29 00:48:50.22226824 +0000 UTC m=+92.117479686" lastFinishedPulling="2026-05-29 00:48:51.915601861 +0000 UTC m=+93.810813307" observedRunningTime="2026-05-29 00:48:52.092996856 +0000 UTC m=+93.988208324" watchObservedRunningTime="2026-05-29 00:48:52.09371321 +0000 UTC m=+93.988924677" May 29 00:48:53.427543 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.427505 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:53.427976 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:53.427660 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 00:48:53.427976 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:53.427755 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls podName:5bedacc3-4921-41db-a6e4-1bc9d62f877e nodeName:}" failed. No retries permitted until 2026-05-29 00:48:57.42771454 +0000 UTC m=+99.322925985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zf7w4" (UID: "5bedacc3-4921-41db-a6e4-1bc9d62f877e") : secret "cluster-monitoring-operator-tls" not found May 29 00:48:53.628912 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.628874 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:53.629120 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:53.629026 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 00:48:53.629120 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:53.629108 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls podName:2da72898-dccd-4efe-b72b-b9a321ef4772 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:57.62909079 +0000 UTC m=+99.524302236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls") pod "cluster-samples-operator-697587599-jgj8b" (UID: "2da72898-dccd-4efe-b72b-b9a321ef4772") : secret "samples-operator-tls" not found May 29 00:48:53.698151 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.698086 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp"] May 29 00:48:53.699993 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.699978 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.702663 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.702634 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 29 00:48:53.702809 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.702664 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 29 00:48:53.702864 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.702807 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 29 00:48:53.702864 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.702815 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 29 00:48:53.703978 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.703960 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gbmtk\"" May 29 00:48:53.709031 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.709012 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp"] May 29 00:48:53.729967 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.729947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23591fcd-8159-497b-955d-6b65ec92d269-config\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.730070 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.729985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23591fcd-8159-497b-955d-6b65ec92d269-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.730111 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.730079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmtr8\" (UniqueName: \"kubernetes.io/projected/23591fcd-8159-497b-955d-6b65ec92d269-kube-api-access-xmtr8\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.831292 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.831252 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23591fcd-8159-497b-955d-6b65ec92d269-config\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.831457 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.831298 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23591fcd-8159-497b-955d-6b65ec92d269-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.831515 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.831465 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmtr8\" (UniqueName: \"kubernetes.io/projected/23591fcd-8159-497b-955d-6b65ec92d269-kube-api-access-xmtr8\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.831881 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.831860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23591fcd-8159-497b-955d-6b65ec92d269-config\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.833617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.833596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23591fcd-8159-497b-955d-6b65ec92d269-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:53.839630 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:53.839610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmtr8\" (UniqueName: \"kubernetes.io/projected/23591fcd-8159-497b-955d-6b65ec92d269-kube-api-access-xmtr8\") pod \"kube-storage-version-migrator-operator-565644f49-mgpmp\" (UID: \"23591fcd-8159-497b-955d-6b65ec92d269\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:54.009002 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:54.008919 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" May 29 00:48:54.130885 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:54.130830 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp"] May 29 00:48:54.133313 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:48:54.133277 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23591fcd_8159_497b_955d_6b65ec92d269.slice/crio-cd11df28ee9250026b94f889e62b32183cb5e669d78be05b9bd0ee73a5eda046 WatchSource:0}: Error finding container cd11df28ee9250026b94f889e62b32183cb5e669d78be05b9bd0ee73a5eda046: Status 404 returned error can't find the container with id cd11df28ee9250026b94f889e62b32183cb5e669d78be05b9bd0ee73a5eda046 May 29 00:48:55.088073 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:55.088033 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" event={"ID":"23591fcd-8159-497b-955d-6b65ec92d269","Type":"ContainerStarted","Data":"cd11df28ee9250026b94f889e62b32183cb5e669d78be05b9bd0ee73a5eda046"} May 29 00:48:55.371686 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:55.371659 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n9v8g_cf0454e9-24a1-4a3f-8ccd-335b81975306/dns-node-resolver/0.log" May 29 00:48:56.354981 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.354935 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.354996 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.355077 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:56.355113 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:56.355138 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88d576cfc-264k9: secret "image-registry-tls" not found May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:56.355183 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:56.355204 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:56.355216 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls podName:eed0547e-57d1-4902-8664-08a4e8d00e72 nodeName:}" failed. No retries permitted until 2026-05-29 00:50:00.35519439 +0000 UTC m=+162.250405848 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls") pod "image-registry-88d576cfc-264k9" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72") : secret "image-registry-tls" not found May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:56.355248 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls podName:94f75f66-3473-4bd4-947b-bda5c8a3f20a nodeName:}" failed. No retries permitted until 2026-05-29 00:50:00.355227946 +0000 UTC m=+162.250439407 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls") pod "dns-default-frppt" (UID: "94f75f66-3473-4bd4-947b-bda5c8a3f20a") : secret "dns-default-metrics-tls" not found May 29 00:48:56.355422 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:56.355270 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert podName:9d070427-f9ce-42e0-a897-35562ec8045f nodeName:}" failed. No retries permitted until 2026-05-29 00:50:00.355259817 +0000 UTC m=+162.250471273 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert") pod "ingress-canary-nxvd8" (UID: "9d070427-f9ce-42e0-a897-35562ec8045f") : secret "canary-serving-cert" not found May 29 00:48:56.570881 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.570843 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9"] May 29 00:48:56.572583 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.572560 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mdrgh_9ceed120-d7b0-4e23-a600-545bd7c79900/node-ca/0.log" May 29 00:48:56.573202 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.573186 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9" May 29 00:48:56.575869 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.575849 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bzs8l\"" May 29 00:48:56.580956 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.580878 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9"] May 29 00:48:56.658104 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.658013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-942jg\" (UniqueName: \"kubernetes.io/projected/eef96c15-269a-4728-b863-87a2756d1735-kube-api-access-942jg\") pod \"network-check-source-7f44b6dd87-4pfg9\" (UID: \"eef96c15-269a-4728-b863-87a2756d1735\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9" May 29 00:48:56.725379 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.725346 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g"] May 29 00:48:56.727165 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.727141 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.729695 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.729669 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 29 00:48:56.729859 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.729738 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 29 00:48:56.729859 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.729823 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2w7cf\"" May 29 00:48:56.729859 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.729841 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 29 00:48:56.730025 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.729913 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 29 00:48:56.735094 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.735073 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g"] May 29 00:48:56.759319 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.759300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f079fca-9020-4571-8911-a9fa43f296f7-config\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.759420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.759330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27mfn\" (UniqueName: \"kubernetes.io/projected/2f079fca-9020-4571-8911-a9fa43f296f7-kube-api-access-27mfn\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.759420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.759357 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-942jg\" (UniqueName: \"kubernetes.io/projected/eef96c15-269a-4728-b863-87a2756d1735-kube-api-access-942jg\") pod \"network-check-source-7f44b6dd87-4pfg9\" (UID: \"eef96c15-269a-4728-b863-87a2756d1735\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9" May 29 00:48:56.759536 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.759439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2f079fca-9020-4571-8911-a9fa43f296f7-serving-cert\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.766932 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.766908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-942jg\" (UniqueName: \"kubernetes.io/projected/eef96c15-269a-4728-b863-87a2756d1735-kube-api-access-942jg\") pod \"network-check-source-7f44b6dd87-4pfg9\" (UID: \"eef96c15-269a-4728-b863-87a2756d1735\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9" May 29 00:48:56.860434 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.860396 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2f079fca-9020-4571-8911-a9fa43f296f7-serving-cert\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.860616 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.860508 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f079fca-9020-4571-8911-a9fa43f296f7-config\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.860616 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.860542 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27mfn\" (UniqueName: \"kubernetes.io/projected/2f079fca-9020-4571-8911-a9fa43f296f7-kube-api-access-27mfn\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.861002 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.860982 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f079fca-9020-4571-8911-a9fa43f296f7-config\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.862831 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.862810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2f079fca-9020-4571-8911-a9fa43f296f7-serving-cert\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.868309 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.868287 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27mfn\" (UniqueName: \"kubernetes.io/projected/2f079fca-9020-4571-8911-a9fa43f296f7-kube-api-access-27mfn\") pod \"service-ca-operator-57b5b68b8-2hv7g\" (UID: \"2f079fca-9020-4571-8911-a9fa43f296f7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:56.884241 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:56.884215 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9" May 29 00:48:57.008339 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.008304 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9"] May 29 00:48:57.011168 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:48:57.011140 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef96c15_269a_4728_b863_87a2756d1735.slice/crio-9ffbe8b28289eb0792bb8d8660109756bf16a1e810ae0c4b86e1073af2f472cc WatchSource:0}: Error finding container 9ffbe8b28289eb0792bb8d8660109756bf16a1e810ae0c4b86e1073af2f472cc: Status 404 returned error can't find the container with id 9ffbe8b28289eb0792bb8d8660109756bf16a1e810ae0c4b86e1073af2f472cc May 29 00:48:57.037174 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.037148 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" May 29 00:48:57.095102 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.095042 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" event={"ID":"23591fcd-8159-497b-955d-6b65ec92d269","Type":"ContainerStarted","Data":"9126a17a9e1c7ee2be4044712c0eb4cb559ea8804720d211a404e159a0a4a666"} May 29 00:48:57.096802 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.096770 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9" event={"ID":"eef96c15-269a-4728-b863-87a2756d1735","Type":"ContainerStarted","Data":"11343a845f553f39e8c7df6e34042c2072cb2b38097207ac907a77b3b3594db7"} May 29 00:48:57.096929 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.096812 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9" event={"ID":"eef96c15-269a-4728-b863-87a2756d1735","Type":"ContainerStarted","Data":"9ffbe8b28289eb0792bb8d8660109756bf16a1e810ae0c4b86e1073af2f472cc"} May 29 00:48:57.128865 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.128811 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-4pfg9" podStartSLOduration=1.128792817 podStartE2EDuration="1.128792817s" podCreationTimestamp="2026-05-29 00:48:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:48:57.128055545 +0000 UTC m=+99.023267015" watchObservedRunningTime="2026-05-29 00:48:57.128792817 +0000 UTC m=+99.024004286" May 29 00:48:57.129223 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.129195 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" podStartSLOduration=1.508453323 podStartE2EDuration="4.129188837s" podCreationTimestamp="2026-05-29 00:48:53 +0000 UTC" firstStartedPulling="2026-05-29 00:48:54.135354242 +0000 UTC m=+96.030565687" lastFinishedPulling="2026-05-29 00:48:56.756089755 +0000 UTC m=+98.651301201" observedRunningTime="2026-05-29 00:48:57.110585624 +0000 UTC m=+99.005797093" watchObservedRunningTime="2026-05-29 00:48:57.129188837 +0000 UTC m=+99.024400307" May 29 00:48:57.180089 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.180063 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g"] May 29 00:48:57.182319 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:48:57.182290 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f079fca_9020_4571_8911_a9fa43f296f7.slice/crio-65c65ca18fe6707a27f5d0891b2cc21a0dbff47623fc7570544e86887d85199a WatchSource:0}: Error finding container 65c65ca18fe6707a27f5d0891b2cc21a0dbff47623fc7570544e86887d85199a: Status 404 returned error can't find the container with id 65c65ca18fe6707a27f5d0891b2cc21a0dbff47623fc7570544e86887d85199a May 29 00:48:57.465982 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.465893 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:48:57.466401 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:57.466037 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 00:48:57.466401 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:57.466103 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls podName:5bedacc3-4921-41db-a6e4-1bc9d62f877e nodeName:}" failed. No retries permitted until 2026-05-29 00:49:05.466086225 +0000 UTC m=+107.361297675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zf7w4" (UID: "5bedacc3-4921-41db-a6e4-1bc9d62f877e") : secret "cluster-monitoring-operator-tls" not found May 29 00:48:57.667916 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:57.667876 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:48:57.668073 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:57.668017 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 00:48:57.668120 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:48:57.668105 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls podName:2da72898-dccd-4efe-b72b-b9a321ef4772 nodeName:}" failed. No retries permitted until 2026-05-29 00:49:05.668087497 +0000 UTC m=+107.563298942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls") pod "cluster-samples-operator-697587599-jgj8b" (UID: "2da72898-dccd-4efe-b72b-b9a321ef4772") : secret "samples-operator-tls" not found May 29 00:48:58.102244 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:58.102202 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" event={"ID":"2f079fca-9020-4571-8911-a9fa43f296f7","Type":"ContainerStarted","Data":"65c65ca18fe6707a27f5d0891b2cc21a0dbff47623fc7570544e86887d85199a"} May 29 00:48:59.036106 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:48:59.036069 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7789b" May 29 00:49:00.107624 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:00.107584 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" event={"ID":"2f079fca-9020-4571-8911-a9fa43f296f7","Type":"ContainerStarted","Data":"029be778ddf6be9ef3432dbf9019299fa4a840829e14acaf91d53c89ab9a2a4e"} May 29 00:49:00.121860 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:00.121816 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" podStartSLOduration=1.70901316 podStartE2EDuration="4.121801827s" podCreationTimestamp="2026-05-29 00:48:56 +0000 UTC" firstStartedPulling="2026-05-29 00:48:57.184587533 +0000 UTC m=+99.079798979" lastFinishedPulling="2026-05-29 00:48:59.597376197 +0000 UTC m=+101.492587646" observedRunningTime="2026-05-29 00:49:00.121459132 +0000 UTC m=+102.016670599" watchObservedRunningTime="2026-05-29 00:49:00.121801827 +0000 UTC m=+102.017013331" May 29 00:49:03.055336 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.055299 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ltbr4"] May 29 00:49:03.057347 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.057331 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.060079 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.060053 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 29 00:49:03.061321 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.061296 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 29 00:49:03.061423 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.061329 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 29 00:49:03.061423 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.061388 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bhd59\"" May 29 00:49:03.061549 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.061441 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 29 00:49:03.064547 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.064527 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ltbr4"] May 29 00:49:03.116337 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.116298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-signing-cabundle\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.116505 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.116476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-signing-key\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.116558 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.116521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvs6b\" (UniqueName: \"kubernetes.io/projected/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-kube-api-access-pvs6b\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.217957 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.217917 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-signing-cabundle\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.218117 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.217980 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-signing-key\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.218183 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.218160 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvs6b\" (UniqueName: \"kubernetes.io/projected/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-kube-api-access-pvs6b\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.218608 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.218583 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-signing-cabundle\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.220603 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.220580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-signing-key\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.226344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.226320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvs6b\" (UniqueName: \"kubernetes.io/projected/e9737ea1-6442-4bf5-860a-2c4ec9da1aea-kube-api-access-pvs6b\") pod \"service-ca-67d667c7d-ltbr4\" (UID: \"e9737ea1-6442-4bf5-860a-2c4ec9da1aea\") " pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.366540 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.366509 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" May 29 00:49:03.487044 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:03.486939 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ltbr4"] May 29 00:49:03.489490 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:03.489463 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9737ea1_6442_4bf5_860a_2c4ec9da1aea.slice/crio-5050d0a030619adcba44fa73f33e18ee2990a9ac5c25dfaed0db13c3a4f0f3bb WatchSource:0}: Error finding container 5050d0a030619adcba44fa73f33e18ee2990a9ac5c25dfaed0db13c3a4f0f3bb: Status 404 returned error can't find the container with id 5050d0a030619adcba44fa73f33e18ee2990a9ac5c25dfaed0db13c3a4f0f3bb May 29 00:49:04.119599 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:04.119565 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" event={"ID":"e9737ea1-6442-4bf5-860a-2c4ec9da1aea","Type":"ContainerStarted","Data":"6857fe4ef37df05cea419be2acbf1b677b80eaab884f3157c3047184dc6cb95d"} May 29 00:49:04.119599 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:04.119603 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" event={"ID":"e9737ea1-6442-4bf5-860a-2c4ec9da1aea","Type":"ContainerStarted","Data":"5050d0a030619adcba44fa73f33e18ee2990a9ac5c25dfaed0db13c3a4f0f3bb"} May 29 00:49:04.141152 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:04.141096 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-ltbr4" podStartSLOduration=1.141079322 podStartE2EDuration="1.141079322s" podCreationTimestamp="2026-05-29 00:49:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:49:04.139169916 +0000 UTC m=+106.034381385" watchObservedRunningTime="2026-05-29 00:49:04.141079322 +0000 UTC m=+106.036290789" May 29 00:49:05.538967 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:05.538921 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:49:05.539427 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:05.539086 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 00:49:05.539427 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:05.539170 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls podName:5bedacc3-4921-41db-a6e4-1bc9d62f877e nodeName:}" failed. No retries permitted until 2026-05-29 00:49:21.539148833 +0000 UTC m=+123.434360282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zf7w4" (UID: "5bedacc3-4921-41db-a6e4-1bc9d62f877e") : secret "cluster-monitoring-operator-tls" not found May 29 00:49:05.741275 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:05.741229 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:49:05.743919 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:05.743893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da72898-dccd-4efe-b72b-b9a321ef4772-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgj8b\" (UID: \"2da72898-dccd-4efe-b72b-b9a321ef4772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:49:05.800774 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:05.800689 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" May 29 00:49:05.928108 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:05.928074 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b"] May 29 00:49:06.125348 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:06.125314 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" event={"ID":"2da72898-dccd-4efe-b72b-b9a321ef4772","Type":"ContainerStarted","Data":"89f89c5085a49caab94b38bd8fdbca13ceebc437c00d4a34bfc889d171539f52"} May 29 00:49:08.134013 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:08.133988 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" event={"ID":"2da72898-dccd-4efe-b72b-b9a321ef4772","Type":"ContainerStarted","Data":"ba7c652a777bd3b9644e804fed3c41c39c923032b2ee9384438bfff2fd44ce18"} May 29 00:49:09.138550 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:09.138519 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" event={"ID":"2da72898-dccd-4efe-b72b-b9a321ef4772","Type":"ContainerStarted","Data":"33234a3a57fe58b09399aee75d609b3e2ae2b0e83fdc038400bcaf55937e15a1"} May 29 00:49:09.156128 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:09.155962 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgj8b" podStartSLOduration=18.095410011 podStartE2EDuration="20.15594708s" podCreationTimestamp="2026-05-29 00:48:49 +0000 UTC" firstStartedPulling="2026-05-29 00:49:05.966685803 +0000 UTC m=+107.861897249" lastFinishedPulling="2026-05-29 00:49:08.027222873 +0000 UTC m=+109.922434318" observedRunningTime="2026-05-29 00:49:09.155414292 +0000 UTC m=+111.050625761" watchObservedRunningTime="2026-05-29 00:49:09.15594708 +0000 UTC m=+111.051158548" May 29 00:49:21.577949 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:21.577910 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:49:21.580555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:21.580527 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bedacc3-4921-41db-a6e4-1bc9d62f877e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zf7w4\" (UID: \"5bedacc3-4921-41db-a6e4-1bc9d62f877e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:49:21.592532 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:21.592503 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4rc6l\"" May 29 00:49:21.600780 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:21.600759 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" May 29 00:49:21.730130 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:21.730100 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4"] May 29 00:49:21.732898 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:21.732860 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bedacc3_4921_41db_a6e4_1bc9d62f877e.slice/crio-b7e3eedecae09c5574c6482b47e8a7e163281887549b8e023acb49cd6237b4fe WatchSource:0}: Error finding container b7e3eedecae09c5574c6482b47e8a7e163281887549b8e023acb49cd6237b4fe: Status 404 returned error can't find the container with id b7e3eedecae09c5574c6482b47e8a7e163281887549b8e023acb49cd6237b4fe May 29 00:49:22.172226 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.172186 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" event={"ID":"5bedacc3-4921-41db-a6e4-1bc9d62f877e","Type":"ContainerStarted","Data":"b7e3eedecae09c5574c6482b47e8a7e163281887549b8e023acb49cd6237b4fe"} May 29 00:49:22.508433 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.508337 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7gnqf"] May 29 00:49:22.510720 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.510696 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.513612 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.513582 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 00:49:22.515230 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.515211 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4g569\"" May 29 00:49:22.515317 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.515220 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 00:49:22.522094 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.522074 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7gnqf"] May 29 00:49:22.612442 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.612406 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd"] May 29 00:49:22.616526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.616505 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" May 29 00:49:22.619420 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.619401 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 29 00:49:22.620734 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.620704 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n6fv4\"" May 29 00:49:22.620866 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.620846 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 29 00:49:22.625034 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.625014 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd"] May 29 00:49:22.686217 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.686182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-crio-socket\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.686416 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.686229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlgpg\" (UniqueName: \"kubernetes.io/projected/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-kube-api-access-qlgpg\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.686416 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.686346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.687811 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.686783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.687811 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.687033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-data-volume\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.788462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788366 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-data-volume\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.788462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788457 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-crio-socket\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.788812 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788492 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlgpg\" (UniqueName: \"kubernetes.io/projected/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-kube-api-access-qlgpg\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.788812 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-crio-socket\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.788812 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788652 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.788812 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788705 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.788812 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-data-volume\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.788812 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bed9de2f-ebdf-4978-a45b-a7e82710a219-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6h5qd\" (UID: \"bed9de2f-ebdf-4978-a45b-a7e82710a219\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" May 29 00:49:22.788812 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.788810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bed9de2f-ebdf-4978-a45b-a7e82710a219-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6h5qd\" (UID: \"bed9de2f-ebdf-4978-a45b-a7e82710a219\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" May 29 00:49:22.789194 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.789170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.791619 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.791599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.799831 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.799809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlgpg\" (UniqueName: \"kubernetes.io/projected/c71853f0-9092-44c9-b0dd-d2e0419fe3dc-kube-api-access-qlgpg\") pod \"insights-runtime-extractor-7gnqf\" (UID: \"c71853f0-9092-44c9-b0dd-d2e0419fe3dc\") " pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.820284 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.820259 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7gnqf" May 29 00:49:22.889991 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.889954 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bed9de2f-ebdf-4978-a45b-a7e82710a219-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6h5qd\" (UID: \"bed9de2f-ebdf-4978-a45b-a7e82710a219\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" May 29 00:49:22.890140 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.890007 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bed9de2f-ebdf-4978-a45b-a7e82710a219-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6h5qd\" (UID: \"bed9de2f-ebdf-4978-a45b-a7e82710a219\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" May 29 00:49:22.890912 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.890887 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bed9de2f-ebdf-4978-a45b-a7e82710a219-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6h5qd\" (UID: \"bed9de2f-ebdf-4978-a45b-a7e82710a219\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" May 29 00:49:22.893786 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.893756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bed9de2f-ebdf-4978-a45b-a7e82710a219-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6h5qd\" (UID: \"bed9de2f-ebdf-4978-a45b-a7e82710a219\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" May 29 00:49:22.928496 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.928469 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" May 29 00:49:22.967230 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:22.967048 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7gnqf"] May 29 00:49:22.969656 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:22.969514 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71853f0_9092_44c9_b0dd_d2e0419fe3dc.slice/crio-84bd7b5d1c37a74ca88d60131a6d822e1b4bf308b4c75f2a83ca929f0e5ce025 WatchSource:0}: Error finding container 84bd7b5d1c37a74ca88d60131a6d822e1b4bf308b4c75f2a83ca929f0e5ce025: Status 404 returned error can't find the container with id 84bd7b5d1c37a74ca88d60131a6d822e1b4bf308b4c75f2a83ca929f0e5ce025 May 29 00:49:23.094532 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:23.094501 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd"] May 29 00:49:23.177046 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:23.177006 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gnqf" event={"ID":"c71853f0-9092-44c9-b0dd-d2e0419fe3dc","Type":"ContainerStarted","Data":"42ed482691bafcf6587739f8b460f0ff3dae5ef9d56ba111a82526fabc36f2e4"} May 29 00:49:23.177046 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:23.177054 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gnqf" event={"ID":"c71853f0-9092-44c9-b0dd-d2e0419fe3dc","Type":"ContainerStarted","Data":"84bd7b5d1c37a74ca88d60131a6d822e1b4bf308b4c75f2a83ca929f0e5ce025"} May 29 00:49:23.528575 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:23.528537 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed9de2f_ebdf_4978_a45b_a7e82710a219.slice/crio-e1d0b9bc87a8689ccc29f8404e7d07b1f13d23d21b960c95008f9808836804b5 WatchSource:0}: Error finding container e1d0b9bc87a8689ccc29f8404e7d07b1f13d23d21b960c95008f9808836804b5: Status 404 returned error can't find the container with id e1d0b9bc87a8689ccc29f8404e7d07b1f13d23d21b960c95008f9808836804b5 May 29 00:49:24.057035 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.057002 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl"] May 29 00:49:24.060229 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.060206 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" May 29 00:49:24.062589 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.062568 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 29 00:49:24.062933 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.062916 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5svvc\"" May 29 00:49:24.068425 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.068371 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl"] May 29 00:49:24.182051 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.181969 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gnqf" event={"ID":"c71853f0-9092-44c9-b0dd-d2e0419fe3dc","Type":"ContainerStarted","Data":"27aa015002863d312d772ce227758a728bec41553a4cf4541104899973656205"} May 29 00:49:24.183423 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.183389 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" event={"ID":"bed9de2f-ebdf-4978-a45b-a7e82710a219","Type":"ContainerStarted","Data":"e1d0b9bc87a8689ccc29f8404e7d07b1f13d23d21b960c95008f9808836804b5"} May 29 00:49:24.184906 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.184875 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" event={"ID":"5bedacc3-4921-41db-a6e4-1bc9d62f877e","Type":"ContainerStarted","Data":"8bda786b97cad6fae178fc6a7b15fbbdb02c6aedd587e66b0abf20ab75636bbd"} May 29 00:49:24.200610 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.200551 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zf7w4" podStartSLOduration=33.380239922 podStartE2EDuration="35.200535947s" podCreationTimestamp="2026-05-29 00:48:49 +0000 UTC" firstStartedPulling="2026-05-29 00:49:21.734870411 +0000 UTC m=+123.630081857" lastFinishedPulling="2026-05-29 00:49:23.555166436 +0000 UTC m=+125.450377882" observedRunningTime="2026-05-29 00:49:24.200175878 +0000 UTC m=+126.095387346" watchObservedRunningTime="2026-05-29 00:49:24.200535947 +0000 UTC m=+126.095747415" May 29 00:49:24.203500 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.203480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl\" (UID: \"e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" May 29 00:49:24.304284 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.304241 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl\" (UID: \"e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" May 29 00:49:24.304472 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:24.304440 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 29 00:49:24.304552 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:24.304539 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d-tls-certificates podName:e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d nodeName:}" failed. No retries permitted until 2026-05-29 00:49:24.804505603 +0000 UTC m=+126.699717050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" (UID: "e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d") : secret "prometheus-operator-admission-webhook-tls" not found May 29 00:49:24.809095 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.809055 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl\" (UID: \"e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" May 29 00:49:24.812132 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.812104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl\" (UID: \"e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" May 29 00:49:24.972091 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:24.972046 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" May 29 00:49:25.189559 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:25.189523 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" event={"ID":"bed9de2f-ebdf-4978-a45b-a7e82710a219","Type":"ContainerStarted","Data":"064edff9ee5424d2950b081eafb9d5ad57417b7535bff28683f7d4afafd978d3"} May 29 00:49:25.204658 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:25.204604 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6h5qd" podStartSLOduration=1.897355243 podStartE2EDuration="3.204589612s" podCreationTimestamp="2026-05-29 00:49:22 +0000 UTC" firstStartedPulling="2026-05-29 00:49:23.530403769 +0000 UTC m=+125.425615216" lastFinishedPulling="2026-05-29 00:49:24.837638132 +0000 UTC m=+126.732849585" observedRunningTime="2026-05-29 00:49:25.20413517 +0000 UTC m=+127.099346640" watchObservedRunningTime="2026-05-29 00:49:25.204589612 +0000 UTC m=+127.099801091" May 29 00:49:25.392912 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:25.392843 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl"] May 29 00:49:25.395366 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:25.395330 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49e0ff4_a8bb_4cf0_bb4f_2c045e9ac64d.slice/crio-a721a00d65dc3bd9f4a606ad25345656c1d087062cf3bee9b01b0d8bbb51fc0b WatchSource:0}: Error finding container a721a00d65dc3bd9f4a606ad25345656c1d087062cf3bee9b01b0d8bbb51fc0b: Status 404 returned error can't find the container with id a721a00d65dc3bd9f4a606ad25345656c1d087062cf3bee9b01b0d8bbb51fc0b May 29 00:49:26.195966 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:26.195926 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gnqf" event={"ID":"c71853f0-9092-44c9-b0dd-d2e0419fe3dc","Type":"ContainerStarted","Data":"bbc97579e9024a35aecc44d20baf6822edfc6319c883293e700db5e984c72fab"} May 29 00:49:26.197045 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:26.197016 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" event={"ID":"e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d","Type":"ContainerStarted","Data":"a721a00d65dc3bd9f4a606ad25345656c1d087062cf3bee9b01b0d8bbb51fc0b"} May 29 00:49:26.213075 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:26.213023 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7gnqf" podStartSLOduration=1.9487779079999998 podStartE2EDuration="4.213009257s" podCreationTimestamp="2026-05-29 00:49:22 +0000 UTC" firstStartedPulling="2026-05-29 00:49:23.050597674 +0000 UTC m=+124.945809125" lastFinishedPulling="2026-05-29 00:49:25.314829011 +0000 UTC m=+127.210040474" observedRunningTime="2026-05-29 00:49:26.211592885 +0000 UTC m=+128.106804354" watchObservedRunningTime="2026-05-29 00:49:26.213009257 +0000 UTC m=+128.108220724" May 29 00:49:27.201050 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:27.201014 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" event={"ID":"e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d","Type":"ContainerStarted","Data":"53db5b75aa7c2e0b0a163239829aebf56d3c9a8ba003016356246492ef81e700"} May 29 00:49:27.218050 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:27.217993 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" podStartSLOduration=2.148619323 podStartE2EDuration="3.217980428s" podCreationTimestamp="2026-05-29 00:49:24 +0000 UTC" firstStartedPulling="2026-05-29 00:49:25.397221518 +0000 UTC m=+127.292432964" lastFinishedPulling="2026-05-29 00:49:26.466582621 +0000 UTC m=+128.361794069" observedRunningTime="2026-05-29 00:49:27.21601805 +0000 UTC m=+129.111229518" watchObservedRunningTime="2026-05-29 00:49:27.217980428 +0000 UTC m=+129.113191895" May 29 00:49:28.203549 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:28.203516 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" May 29 00:49:28.208689 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:28.208660 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl" May 29 00:49:28.542695 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:28.542611 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:49:28.545013 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:28.544995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6804979-c10d-4438-b86d-a07db1614952-metrics-certs\") pod \"network-metrics-daemon-5zjvq\" (UID: \"d6804979-c10d-4438-b86d-a07db1614952\") " pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:49:28.765668 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:28.765637 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rlrhs\"" May 29 00:49:28.772990 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:28.772973 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zjvq" May 29 00:49:28.893323 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:28.893297 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5zjvq"] May 29 00:49:28.895656 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:28.895623 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6804979_c10d_4438_b86d_a07db1614952.slice/crio-f429ea8914c7ede9f29843a7825f8953244b6964e8062e328a45911a96b116c2 WatchSource:0}: Error finding container f429ea8914c7ede9f29843a7825f8953244b6964e8062e328a45911a96b116c2: Status 404 returned error can't find the container with id f429ea8914c7ede9f29843a7825f8953244b6964e8062e328a45911a96b116c2 May 29 00:49:29.209169 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:29.209132 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5zjvq" event={"ID":"d6804979-c10d-4438-b86d-a07db1614952","Type":"ContainerStarted","Data":"f429ea8914c7ede9f29843a7825f8953244b6964e8062e328a45911a96b116c2"} May 29 00:49:30.214034 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:30.213988 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5zjvq" event={"ID":"d6804979-c10d-4438-b86d-a07db1614952","Type":"ContainerStarted","Data":"c2faf1b058468f6d0ba7f69f2be98bdee747be586fd8a1898394758cfaca0444"} May 29 00:49:30.214034 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:30.214031 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5zjvq" event={"ID":"d6804979-c10d-4438-b86d-a07db1614952","Type":"ContainerStarted","Data":"f619767662721f2ca0ce8260e416bd68030dee2b84d3bce173de140de34b128a"} May 29 00:49:30.230391 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:30.230336 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5zjvq" podStartSLOduration=131.320988668 podStartE2EDuration="2m12.230320948s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:49:28.897625593 +0000 UTC m=+130.792837054" lastFinishedPulling="2026-05-29 00:49:29.806957873 +0000 UTC m=+131.702169334" observedRunningTime="2026-05-29 00:49:30.229125796 +0000 UTC m=+132.124337264" watchObservedRunningTime="2026-05-29 00:49:30.230320948 +0000 UTC m=+132.125532430" May 29 00:49:34.465848 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.465814 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf"] May 29 00:49:34.469097 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.469074 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.471919 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.471899 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 00:49:34.473126 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.473055 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jdrz2\"" May 29 00:49:34.473126 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.473064 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 29 00:49:34.473126 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.473098 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 29 00:49:34.480154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.480133 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf"] May 29 00:49:34.488490 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.488459 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw"] May 29 00:49:34.489403 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.489379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.489518 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.489463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.489594 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.489571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j9nt\" (UniqueName: \"kubernetes.io/projected/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-kube-api-access-6j9nt\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.489647 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.489619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.492434 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.492391 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.497095 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.496776 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 29 00:49:34.497095 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.496842 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 29 00:49:34.497095 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.497006 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k6s48\"" May 29 00:49:34.497316 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.497271 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 29 00:49:34.501636 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.501612 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-24bzb"] May 29 00:49:34.507243 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.507219 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw"] May 29 00:49:34.507373 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.507357 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.510416 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.510215 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 00:49:34.510416 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.510269 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ss4hn\"" May 29 00:49:34.510416 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.510219 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 00:49:34.510416 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.510292 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 00:49:34.590490 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-root\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.590490 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.590753 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2c7c9acb-4791-477b-9eb7-a66693545de6-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.590753 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.590753 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.590753 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c7c9acb-4791-477b-9eb7-a66693545de6-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.590753 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590682 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.590753 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-metrics-client-ca\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.591058 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.591058 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-textfile\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.591058 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.591058 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tj9k\" (UniqueName: \"kubernetes.io/projected/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-api-access-6tj9k\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.591058 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.590917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46mw5\" (UniqueName: \"kubernetes.io/projected/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-kube-api-access-46mw5\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.591058 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.591005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-tls\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.591344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.591069 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6j9nt\" (UniqueName: \"kubernetes.io/projected/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-kube-api-access-6j9nt\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.591344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.591111 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.591344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.591146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-wtmp\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.591344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.591183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-sys\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.591344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.591217 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.591963 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.591942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.593791 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.593765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.593940 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.593919 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.598817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.598788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j9nt\" (UniqueName: \"kubernetes.io/projected/6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111-kube-api-access-6j9nt\") pod \"openshift-state-metrics-9c959559f-bt4zf\" (UID: \"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.692223 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692190 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-metrics-client-ca\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692435 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692229 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.692435 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692256 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-textfile\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692435 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692275 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.692435 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692321 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tj9k\" (UniqueName: \"kubernetes.io/projected/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-api-access-6tj9k\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.692435 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692345 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46mw5\" (UniqueName: \"kubernetes.io/projected/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-kube-api-access-46mw5\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692435 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692371 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-tls\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692435 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692421 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-wtmp\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692449 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-sys\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692478 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-root\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692502 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692529 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2c7c9acb-4791-477b-9eb7-a66693545de6-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692559 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692586 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692619 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c7c9acb-4791-477b-9eb7-a66693545de6-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-textfile\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.692817 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692805 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-sys\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.693243 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.692981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-metrics-client-ca\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.693243 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.693056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-root\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.693243 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.693141 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.693243 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.693147 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2c7c9acb-4791-477b-9eb7-a66693545de6-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.693243 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.693235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c7c9acb-4791-477b-9eb7-a66693545de6-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.693484 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:34.693325 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 29 00:49:34.693484 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:34.693376 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-tls podName:98cd5fde-554b-4e4b-aec6-c2f178ddec4e nodeName:}" failed. No retries permitted until 2026-05-29 00:49:35.193359281 +0000 UTC m=+137.088570730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-tls") pod "node-exporter-24bzb" (UID: "98cd5fde-554b-4e4b-aec6-c2f178ddec4e") : secret "node-exporter-tls" not found May 29 00:49:34.693484 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.693414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-wtmp\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.693675 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.693640 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.695947 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.695925 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.696170 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.696152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.696317 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.696294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.700568 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.700544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tj9k\" (UniqueName: \"kubernetes.io/projected/2c7c9acb-4791-477b-9eb7-a66693545de6-kube-api-access-6tj9k\") pod \"kube-state-metrics-54fd6bc5c4-qfpcw\" (UID: \"2c7c9acb-4791-477b-9eb7-a66693545de6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.703148 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.703123 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46mw5\" (UniqueName: \"kubernetes.io/projected/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-kube-api-access-46mw5\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:34.779968 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.779894 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" May 29 00:49:34.809526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.808908 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" May 29 00:49:34.949226 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.949196 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf"] May 29 00:49:34.953246 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:34.953220 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2f365c_69f7_4eb1_a3c6_9ec84d8a5111.slice/crio-9c8d4bdbbc6783c3f8e73a4d9df95487d9042964fccaef73fbbf2dda5f742bd7 WatchSource:0}: Error finding container 9c8d4bdbbc6783c3f8e73a4d9df95487d9042964fccaef73fbbf2dda5f742bd7: Status 404 returned error can't find the container with id 9c8d4bdbbc6783c3f8e73a4d9df95487d9042964fccaef73fbbf2dda5f742bd7 May 29 00:49:34.979262 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:34.979203 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw"] May 29 00:49:34.983808 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:34.983773 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7c9acb_4791_477b_9eb7_a66693545de6.slice/crio-95357865fc683e67e04cdc5e2a0b9b76b6a3d115e743bff55d1ae3ae555e7521 WatchSource:0}: Error finding container 95357865fc683e67e04cdc5e2a0b9b76b6a3d115e743bff55d1ae3ae555e7521: Status 404 returned error can't find the container with id 95357865fc683e67e04cdc5e2a0b9b76b6a3d115e743bff55d1ae3ae555e7521 May 29 00:49:35.196797 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.196755 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-tls\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:35.199205 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.199182 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98cd5fde-554b-4e4b-aec6-c2f178ddec4e-node-exporter-tls\") pod \"node-exporter-24bzb\" (UID: \"98cd5fde-554b-4e4b-aec6-c2f178ddec4e\") " pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:35.229326 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.229290 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" event={"ID":"2c7c9acb-4791-477b-9eb7-a66693545de6","Type":"ContainerStarted","Data":"95357865fc683e67e04cdc5e2a0b9b76b6a3d115e743bff55d1ae3ae555e7521"} May 29 00:49:35.231037 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.231013 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" event={"ID":"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111","Type":"ContainerStarted","Data":"efd5219d681bb9fcb0016671d1049f864d10fa768f9556ca0cef448264714034"} May 29 00:49:35.231037 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.231039 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" event={"ID":"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111","Type":"ContainerStarted","Data":"31fc7e71cf8dd8d818725f76ccc1fa23e3d6d66506cba59e7741ca3b0f56b079"} May 29 00:49:35.231225 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.231049 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" event={"ID":"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111","Type":"ContainerStarted","Data":"9c8d4bdbbc6783c3f8e73a4d9df95487d9042964fccaef73fbbf2dda5f742bd7"} May 29 00:49:35.417303 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.417260 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-24bzb" May 29 00:49:35.427988 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:35.427959 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98cd5fde_554b_4e4b_aec6_c2f178ddec4e.slice/crio-0a29ed800351813f5fc60d4b933e197d071364990e897d62241c2556a1f31c7b WatchSource:0}: Error finding container 0a29ed800351813f5fc60d4b933e197d071364990e897d62241c2556a1f31c7b: Status 404 returned error can't find the container with id 0a29ed800351813f5fc60d4b933e197d071364990e897d62241c2556a1f31c7b May 29 00:49:35.539827 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.539792 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:49:35.544105 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.544076 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.546697 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.546672 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 29 00:49:35.546826 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.546697 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-crcg4\"" May 29 00:49:35.546826 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.546672 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 29 00:49:35.547127 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.547082 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 29 00:49:35.547230 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.547172 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 29 00:49:35.547571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.547347 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 29 00:49:35.547571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.547447 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 29 00:49:35.547571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.547551 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 29 00:49:35.547768 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.547643 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 29 00:49:35.547768 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.547760 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 29 00:49:35.555380 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.555359 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:49:35.600287 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600287 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600325 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-out\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-web-config\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb9dx\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-kube-api-access-mb9dx\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600526 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600814 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600814 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600638 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600814 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.600814 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.600759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702148 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702037 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702364 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702162 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mb9dx\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-kube-api-access-mb9dx\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702364 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702204 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702364 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702304 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702364 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702338 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702565 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702370 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702565 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702409 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702565 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702445 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.702565 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702502 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.703444 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702569 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-out\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.703444 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702622 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.703444 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702653 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.703444 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.702676 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-web-config\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.706445 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:35.706418 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle podName:dbaf2e92-c94a-40c2-b27b-485126a622e8 nodeName:}" failed. No retries permitted until 2026-05-29 00:49:36.206391039 +0000 UTC m=+138.101602504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8") : configmap references non-existent config key: ca-bundle.crt May 29 00:49:35.707368 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.707062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.707368 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:35.707181 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 29 00:49:35.707368 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:35.707244 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls podName:dbaf2e92-c94a-40c2-b27b-485126a622e8 nodeName:}" failed. No retries permitted until 2026-05-29 00:49:36.20722472 +0000 UTC m=+138.102436168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8") : secret "alertmanager-main-tls" not found May 29 00:49:35.707582 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.707392 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.707582 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.707565 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-web-config\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.708414 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.708387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.708512 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.708446 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.710014 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.709972 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.711112 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.710429 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-out\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.711112 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.710499 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.711112 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.710876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.713265 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.713223 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:35.714427 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:35.714385 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb9dx\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-kube-api-access-mb9dx\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:36.207190 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:36.207141 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:36.207390 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:36.207264 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:36.208058 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:36.208032 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:36.210068 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:36.210041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:36.236188 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:36.236145 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-24bzb" event={"ID":"98cd5fde-554b-4e4b-aec6-c2f178ddec4e","Type":"ContainerStarted","Data":"0a29ed800351813f5fc60d4b933e197d071364990e897d62241c2556a1f31c7b"} May 29 00:49:36.458752 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:36.458656 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 00:49:36.943188 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:36.943124 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:49:36.943188 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:36.943145 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbaf2e92_c94a_40c2_b27b_485126a622e8.slice/crio-23252631d9ce7ff5220cdd1f821b25b285d39722a259cb4f03cdb559f4b90c9e WatchSource:0}: Error finding container 23252631d9ce7ff5220cdd1f821b25b285d39722a259cb4f03cdb559f4b90c9e: Status 404 returned error can't find the container with id 23252631d9ce7ff5220cdd1f821b25b285d39722a259cb4f03cdb559f4b90c9e May 29 00:49:37.241213 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.241169 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" event={"ID":"2c7c9acb-4791-477b-9eb7-a66693545de6","Type":"ContainerStarted","Data":"d2838fb39a04b14bb4b106917cd3431649c140bef705e1d2fc7d369814c957b8"} May 29 00:49:37.241407 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.241221 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" event={"ID":"2c7c9acb-4791-477b-9eb7-a66693545de6","Type":"ContainerStarted","Data":"372a4d1cebd6ad51e4e88688b26d15cce279df6720b824096c03b45cbdc61174"} May 29 00:49:37.241407 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.241235 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" event={"ID":"2c7c9acb-4791-477b-9eb7-a66693545de6","Type":"ContainerStarted","Data":"5d81f0d4ab6c380fe8d138c1059f0fd9225217eefa9876940dc2c8fa0fd6e49b"} May 29 00:49:37.243110 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.243074 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" event={"ID":"6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111","Type":"ContainerStarted","Data":"86babc611e5c9921db83b4dffd01ecc5ea2cf4ebe6615f05b344e7f8afb35a92"} May 29 00:49:37.244784 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.244465 2563 generic.go:358] "Generic (PLEG): container finished" podID="98cd5fde-554b-4e4b-aec6-c2f178ddec4e" containerID="0a1f5073dd8262729b7a4c2b5df9fb47438800ae93f7cf213e6be70d93db75b8" exitCode=0 May 29 00:49:37.244784 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.244540 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-24bzb" event={"ID":"98cd5fde-554b-4e4b-aec6-c2f178ddec4e","Type":"ContainerDied","Data":"0a1f5073dd8262729b7a4c2b5df9fb47438800ae93f7cf213e6be70d93db75b8"} May 29 00:49:37.246402 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.245719 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerStarted","Data":"23252631d9ce7ff5220cdd1f821b25b285d39722a259cb4f03cdb559f4b90c9e"} May 29 00:49:37.258999 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.258910 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qfpcw" podStartSLOduration=1.45621862 podStartE2EDuration="3.258893259s" podCreationTimestamp="2026-05-29 00:49:34 +0000 UTC" firstStartedPulling="2026-05-29 00:49:34.985771144 +0000 UTC m=+136.880982590" lastFinishedPulling="2026-05-29 00:49:36.788445772 +0000 UTC m=+138.683657229" observedRunningTime="2026-05-29 00:49:37.257427327 +0000 UTC m=+139.152638795" watchObservedRunningTime="2026-05-29 00:49:37.258893259 +0000 UTC m=+139.154104728" May 29 00:49:37.273262 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:37.273220 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bt4zf" podStartSLOduration=1.578914004 podStartE2EDuration="3.273207562s" podCreationTimestamp="2026-05-29 00:49:34 +0000 UTC" firstStartedPulling="2026-05-29 00:49:35.094153485 +0000 UTC m=+136.989364930" lastFinishedPulling="2026-05-29 00:49:36.788447042 +0000 UTC m=+138.683658488" observedRunningTime="2026-05-29 00:49:37.272610449 +0000 UTC m=+139.167821931" watchObservedRunningTime="2026-05-29 00:49:37.273207562 +0000 UTC m=+139.168419033" May 29 00:49:38.250370 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:38.250335 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-24bzb" event={"ID":"98cd5fde-554b-4e4b-aec6-c2f178ddec4e","Type":"ContainerStarted","Data":"4fced71beb86b444b956ae941ce8fe93a59dd48cff29966c7bf2c08b117dbdb1"} May 29 00:49:38.250370 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:38.250377 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-24bzb" event={"ID":"98cd5fde-554b-4e4b-aec6-c2f178ddec4e","Type":"ContainerStarted","Data":"f31ac24bde601b69921dc55f3dc0b02815e597470f511b377c9006316e094e81"} May 29 00:49:38.251703 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:38.251680 2563 generic.go:358] "Generic (PLEG): container finished" podID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerID="f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128" exitCode=0 May 29 00:49:38.251835 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:38.251758 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerDied","Data":"f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128"} May 29 00:49:38.270588 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:38.270538 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-24bzb" podStartSLOduration=2.909095266 podStartE2EDuration="4.270524048s" podCreationTimestamp="2026-05-29 00:49:34 +0000 UTC" firstStartedPulling="2026-05-29 00:49:35.429914074 +0000 UTC m=+137.325125523" lastFinishedPulling="2026-05-29 00:49:36.791342859 +0000 UTC m=+138.686554305" observedRunningTime="2026-05-29 00:49:38.26891185 +0000 UTC m=+140.164123318" watchObservedRunningTime="2026-05-29 00:49:38.270524048 +0000 UTC m=+140.165735516" May 29 00:49:39.245575 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.245538 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-txmgm"] May 29 00:49:39.248876 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.248859 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" May 29 00:49:39.251495 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.251473 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 29 00:49:39.251807 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.251513 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-5kr8r\"" May 29 00:49:39.255529 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.255502 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-txmgm"] May 29 00:49:39.337946 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.337917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8acae0d-1f6c-41df-af34-0a4e75cba1f5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-txmgm\" (UID: \"c8acae0d-1f6c-41df-af34-0a4e75cba1f5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" May 29 00:49:39.439025 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.438990 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8acae0d-1f6c-41df-af34-0a4e75cba1f5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-txmgm\" (UID: \"c8acae0d-1f6c-41df-af34-0a4e75cba1f5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" May 29 00:49:39.439198 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:39.439148 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 29 00:49:39.439272 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:39.439226 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8acae0d-1f6c-41df-af34-0a4e75cba1f5-monitoring-plugin-cert podName:c8acae0d-1f6c-41df-af34-0a4e75cba1f5 nodeName:}" failed. No retries permitted until 2026-05-29 00:49:39.939203549 +0000 UTC m=+141.834415000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c8acae0d-1f6c-41df-af34-0a4e75cba1f5-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-txmgm" (UID: "c8acae0d-1f6c-41df-af34-0a4e75cba1f5") : secret "monitoring-plugin-cert" not found May 29 00:49:39.944456 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.944192 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8acae0d-1f6c-41df-af34-0a4e75cba1f5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-txmgm\" (UID: \"c8acae0d-1f6c-41df-af34-0a4e75cba1f5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" May 29 00:49:39.956198 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:39.956144 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8acae0d-1f6c-41df-af34-0a4e75cba1f5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-txmgm\" (UID: \"c8acae0d-1f6c-41df-af34-0a4e75cba1f5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" May 29 00:49:40.160166 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.160139 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" May 29 00:49:40.262795 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.262738 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerStarted","Data":"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00"} May 29 00:49:40.300283 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.300261 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-txmgm"] May 29 00:49:40.302518 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:40.302497 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8acae0d_1f6c_41df_af34_0a4e75cba1f5.slice/crio-67c65a67ee18d737e27a2623e30f0906bb104f18de08d92fa170ff0bee2ce53c WatchSource:0}: Error finding container 67c65a67ee18d737e27a2623e30f0906bb104f18de08d92fa170ff0bee2ce53c: Status 404 returned error can't find the container with id 67c65a67ee18d737e27a2623e30f0906bb104f18de08d92fa170ff0bee2ce53c May 29 00:49:40.678585 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.678529 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:49:40.685599 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.685572 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.688637 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.688604 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 00:49:40.688637 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.688604 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 00:49:40.688637 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.688604 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 00:49:40.688966 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.688604 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 00:49:40.688966 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.688604 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 00:49:40.688966 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.688628 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 00:49:40.689109 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.689070 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ztwfq\"" May 29 00:49:40.689275 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.689259 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 00:49:40.689363 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.689273 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 00:49:40.689664 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.689646 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 00:49:40.690223 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.690189 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 00:49:40.690223 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.690217 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 00:49:40.690399 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.690198 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6bpsug9hm9ler\"" May 29 00:49:40.690399 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.690333 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 00:49:40.691417 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.691347 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 00:49:40.694172 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.694154 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:49:40.753344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753344 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-web-config\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-config\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-config-out\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.753671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.754226 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrqbq\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-kube-api-access-nrqbq\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.754226 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.754226 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.753789 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854446 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854414 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854446 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854456 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-config\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854651 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854479 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-config-out\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854651 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854553 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854651 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854593 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrqbq\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-kube-api-access-nrqbq\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854651 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854632 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854874 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854673 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854874 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854714 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854874 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854756 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854874 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854791 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854874 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854814 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.854874 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854865 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.855145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854888 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.855145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.854917 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.855818 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.855416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.855818 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.855517 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.855818 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.855662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.855818 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.855675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.857688 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.857659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.857806 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.857710 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-web-config\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.857806 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.857772 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.857919 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.857825 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.857919 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.857873 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.858652 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.858580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-config\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.858652 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.858628 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.859107 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.859075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.859189 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.859113 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.859872 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.859681 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-config-out\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.859966 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.859943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.860643 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.860586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-web-config\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.860782 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.860675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.861534 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.861435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.862029 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.861807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.862029 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.862000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.862637 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.862613 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.863579 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.863557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrqbq\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-kube-api-access-nrqbq\") pod \"prometheus-k8s-0\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:40.996560 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:40.996519 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:41.188358 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.188294 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:49:41.191542 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:49:41.191510 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b5011a_6623_44f8_9e8d_a5798827d42b.slice/crio-8ace7f11818c6153215c86c702807f10e30dbf05e7ddb6cf6af11d6958883808 WatchSource:0}: Error finding container 8ace7f11818c6153215c86c702807f10e30dbf05e7ddb6cf6af11d6958883808: Status 404 returned error can't find the container with id 8ace7f11818c6153215c86c702807f10e30dbf05e7ddb6cf6af11d6958883808 May 29 00:49:41.268870 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.268835 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerStarted","Data":"bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc"} May 29 00:49:41.268870 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.268880 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerStarted","Data":"8ace7f11818c6153215c86c702807f10e30dbf05e7ddb6cf6af11d6958883808"} May 29 00:49:41.270348 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.270312 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" event={"ID":"c8acae0d-1f6c-41df-af34-0a4e75cba1f5","Type":"ContainerStarted","Data":"67c65a67ee18d737e27a2623e30f0906bb104f18de08d92fa170ff0bee2ce53c"} May 29 00:49:41.275440 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.275405 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerStarted","Data":"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc"} May 29 00:49:41.275562 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.275450 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerStarted","Data":"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7"} May 29 00:49:41.275562 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.275467 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerStarted","Data":"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636"} May 29 00:49:41.275562 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.275480 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerStarted","Data":"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a"} May 29 00:49:41.275562 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.275493 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerStarted","Data":"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3"} May 29 00:49:41.321357 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:41.321257 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.180753863 podStartE2EDuration="6.321240955s" podCreationTimestamp="2026-05-29 00:49:35 +0000 UTC" firstStartedPulling="2026-05-29 00:49:36.946018332 +0000 UTC m=+138.841229788" lastFinishedPulling="2026-05-29 00:49:41.08650542 +0000 UTC m=+142.981716880" observedRunningTime="2026-05-29 00:49:41.320260185 +0000 UTC m=+143.215471675" watchObservedRunningTime="2026-05-29 00:49:41.321240955 +0000 UTC m=+143.216452423" May 29 00:49:42.280930 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:42.280890 2563 generic.go:358] "Generic (PLEG): container finished" podID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerID="bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc" exitCode=0 May 29 00:49:42.281358 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:42.280994 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerDied","Data":"bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc"} May 29 00:49:43.286107 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:43.286067 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" event={"ID":"c8acae0d-1f6c-41df-af34-0a4e75cba1f5","Type":"ContainerStarted","Data":"706122134c6186e3cce57ce5366d4975f5103bd233749988908819b0613e0f7d"} May 29 00:49:43.286569 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:43.286267 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" May 29 00:49:43.291115 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:43.291085 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" May 29 00:49:43.300885 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:43.300817 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-txmgm" podStartSLOduration=2.122049347 podStartE2EDuration="4.300801349s" podCreationTimestamp="2026-05-29 00:49:39 +0000 UTC" firstStartedPulling="2026-05-29 00:49:40.304649791 +0000 UTC m=+142.199861236" lastFinishedPulling="2026-05-29 00:49:42.483401789 +0000 UTC m=+144.378613238" observedRunningTime="2026-05-29 00:49:43.300608515 +0000 UTC m=+145.195819983" watchObservedRunningTime="2026-05-29 00:49:43.300801349 +0000 UTC m=+145.196012818" May 29 00:49:45.299142 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:45.299053 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerStarted","Data":"c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2"} May 29 00:49:45.299142 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:45.299101 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerStarted","Data":"6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166"} May 29 00:49:47.308804 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:47.308691 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerStarted","Data":"38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef"} May 29 00:49:47.308804 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:47.308758 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerStarted","Data":"dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2"} May 29 00:49:47.308804 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:47.308771 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerStarted","Data":"47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921"} May 29 00:49:47.308804 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:47.308780 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerStarted","Data":"2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b"} May 29 00:49:47.338097 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:47.338034 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.979241285 podStartE2EDuration="7.338016938s" podCreationTimestamp="2026-05-29 00:49:40 +0000 UTC" firstStartedPulling="2026-05-29 00:49:42.28251808 +0000 UTC m=+144.177729527" lastFinishedPulling="2026-05-29 00:49:46.641293732 +0000 UTC m=+148.536505180" observedRunningTime="2026-05-29 00:49:47.334813519 +0000 UTC m=+149.230024986" watchObservedRunningTime="2026-05-29 00:49:47.338016938 +0000 UTC m=+149.233228406" May 29 00:49:50.997544 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:50.997503 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:49:55.452782 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:55.452713 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-88d576cfc-264k9" podUID="eed0547e-57d1-4902-8664-08a4e8d00e72" May 29 00:49:55.465909 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:55.465874 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-frppt" podUID="94f75f66-3473-4bd4-947b-bda5c8a3f20a" May 29 00:49:55.488035 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:49:55.488003 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-nxvd8" podUID="9d070427-f9ce-42e0-a897-35562ec8045f" May 29 00:49:56.335760 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:56.335660 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:49:56.335760 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:56.335672 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:49:56.335760 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:49:56.335672 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frppt" May 29 00:50:00.357678 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.357633 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:50:00.358400 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.357760 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:50:00.358400 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.357786 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:50:00.360337 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.360311 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94f75f66-3473-4bd4-947b-bda5c8a3f20a-metrics-tls\") pod \"dns-default-frppt\" (UID: \"94f75f66-3473-4bd4-947b-bda5c8a3f20a\") " pod="openshift-dns/dns-default-frppt" May 29 00:50:00.360450 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.360320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"image-registry-88d576cfc-264k9\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:50:00.360450 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.360359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d070427-f9ce-42e0-a897-35562ec8045f-cert\") pod \"ingress-canary-nxvd8\" (UID: \"9d070427-f9ce-42e0-a897-35562ec8045f\") " pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:50:00.540518 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.540474 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fnqb5\"" May 29 00:50:00.540694 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.540519 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nghjs\"" May 29 00:50:00.540694 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.540518 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7vx5w\"" May 29 00:50:00.546875 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.546857 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frppt" May 29 00:50:00.546944 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.546930 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxvd8" May 29 00:50:00.546985 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.546957 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:50:00.705442 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.705414 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88d576cfc-264k9"] May 29 00:50:00.710569 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:50:00.710537 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed0547e_57d1_4902_8664_08a4e8d00e72.slice/crio-5974351e0c147fac5ad5cca955c854f7f4c7efad45d55106965aa1ba7e014817 WatchSource:0}: Error finding container 5974351e0c147fac5ad5cca955c854f7f4c7efad45d55106965aa1ba7e014817: Status 404 returned error can't find the container with id 5974351e0c147fac5ad5cca955c854f7f4c7efad45d55106965aa1ba7e014817 May 29 00:50:00.718461 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.718439 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nxvd8"] May 29 00:50:00.720778 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:50:00.720753 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d070427_f9ce_42e0_a897_35562ec8045f.slice/crio-2d3810a2099f1292bd3ae5f0d5a115854c02d21adaf0d77cbb382d227af71fb0 WatchSource:0}: Error finding container 2d3810a2099f1292bd3ae5f0d5a115854c02d21adaf0d77cbb382d227af71fb0: Status 404 returned error can't find the container with id 2d3810a2099f1292bd3ae5f0d5a115854c02d21adaf0d77cbb382d227af71fb0 May 29 00:50:00.743633 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:00.743610 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frppt"] May 29 00:50:00.755937 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:50:00.755904 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f75f66_3473_4bd4_947b_bda5c8a3f20a.slice/crio-3e4476a29bce3513ab5317302c7e0a6048363323bd8e6df03ac665b2aee04af3 WatchSource:0}: Error finding container 3e4476a29bce3513ab5317302c7e0a6048363323bd8e6df03ac665b2aee04af3: Status 404 returned error can't find the container with id 3e4476a29bce3513ab5317302c7e0a6048363323bd8e6df03ac665b2aee04af3 May 29 00:50:01.352508 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:01.352407 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88d576cfc-264k9" event={"ID":"eed0547e-57d1-4902-8664-08a4e8d00e72","Type":"ContainerStarted","Data":"56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59"} May 29 00:50:01.352508 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:01.352455 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88d576cfc-264k9" event={"ID":"eed0547e-57d1-4902-8664-08a4e8d00e72","Type":"ContainerStarted","Data":"5974351e0c147fac5ad5cca955c854f7f4c7efad45d55106965aa1ba7e014817"} May 29 00:50:01.352822 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:01.352787 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:50:01.354050 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:01.354018 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frppt" event={"ID":"94f75f66-3473-4bd4-947b-bda5c8a3f20a","Type":"ContainerStarted","Data":"3e4476a29bce3513ab5317302c7e0a6048363323bd8e6df03ac665b2aee04af3"} May 29 00:50:01.355263 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:01.355226 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nxvd8" event={"ID":"9d070427-f9ce-42e0-a897-35562ec8045f","Type":"ContainerStarted","Data":"2d3810a2099f1292bd3ae5f0d5a115854c02d21adaf0d77cbb382d227af71fb0"} May 29 00:50:01.374371 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:01.374140 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-88d576cfc-264k9" podStartSLOduration=165.37411969 podStartE2EDuration="2m45.37411969s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:50:01.371621903 +0000 UTC m=+163.266833381" watchObservedRunningTime="2026-05-29 00:50:01.37411969 +0000 UTC m=+163.269331175" May 29 00:50:03.363022 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:03.362984 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frppt" event={"ID":"94f75f66-3473-4bd4-947b-bda5c8a3f20a","Type":"ContainerStarted","Data":"358c13f0a9430746b0611e3f66373ee2e66ecc8832bb32fc17a0aefc0a6dd884"} May 29 00:50:03.363022 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:03.363023 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frppt" event={"ID":"94f75f66-3473-4bd4-947b-bda5c8a3f20a","Type":"ContainerStarted","Data":"6b4e9ae00fa1d9d353c697471e0bee909eca134a53ec7aa4f2cbca60c2ea4b8d"} May 29 00:50:03.363510 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:03.363127 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-frppt" May 29 00:50:03.364238 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:03.364214 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nxvd8" event={"ID":"9d070427-f9ce-42e0-a897-35562ec8045f","Type":"ContainerStarted","Data":"7b2cdb951e5a6701e5a44f4eb5260ae6a1dceb805887c9c801bc82d8c1a62772"} May 29 00:50:03.380027 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:03.379977 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-frppt" podStartSLOduration=129.2860874 podStartE2EDuration="2m11.379962502s" podCreationTimestamp="2026-05-29 00:47:52 +0000 UTC" firstStartedPulling="2026-05-29 00:50:00.75787324 +0000 UTC m=+162.653084687" lastFinishedPulling="2026-05-29 00:50:02.851748343 +0000 UTC m=+164.746959789" observedRunningTime="2026-05-29 00:50:03.378383059 +0000 UTC m=+165.273594528" watchObservedRunningTime="2026-05-29 00:50:03.379962502 +0000 UTC m=+165.275173969" May 29 00:50:03.392667 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:03.392621 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nxvd8" podStartSLOduration=129.265781646 podStartE2EDuration="2m11.392607713s" podCreationTimestamp="2026-05-29 00:47:52 +0000 UTC" firstStartedPulling="2026-05-29 00:50:00.722630578 +0000 UTC m=+162.617842024" lastFinishedPulling="2026-05-29 00:50:02.849456645 +0000 UTC m=+164.744668091" observedRunningTime="2026-05-29 00:50:03.391419938 +0000 UTC m=+165.286631406" watchObservedRunningTime="2026-05-29 00:50:03.392607713 +0000 UTC m=+165.287819184" May 29 00:50:13.369674 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:13.369587 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-frppt" May 29 00:50:15.402514 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:15.402484 2563 generic.go:358] "Generic (PLEG): container finished" podID="2f079fca-9020-4571-8911-a9fa43f296f7" containerID="029be778ddf6be9ef3432dbf9019299fa4a840829e14acaf91d53c89ab9a2a4e" exitCode=0 May 29 00:50:15.402898 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:15.402533 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" event={"ID":"2f079fca-9020-4571-8911-a9fa43f296f7","Type":"ContainerDied","Data":"029be778ddf6be9ef3432dbf9019299fa4a840829e14acaf91d53c89ab9a2a4e"} May 29 00:50:15.402898 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:15.402851 2563 scope.go:117] "RemoveContainer" containerID="029be778ddf6be9ef3432dbf9019299fa4a840829e14acaf91d53c89ab9a2a4e" May 29 00:50:16.407681 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:16.407643 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2hv7g" event={"ID":"2f079fca-9020-4571-8911-a9fa43f296f7","Type":"ContainerStarted","Data":"03bb297c1f4a94e48ff7abfeb958f0e48881c375398af0a962cc93af8561cb32"} May 29 00:50:20.551741 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:20.551675 2563 patch_prober.go:28] interesting pod/image-registry-88d576cfc-264k9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 00:50:20.552154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:20.551759 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-88d576cfc-264k9" podUID="eed0547e-57d1-4902-8664-08a4e8d00e72" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:50:22.363661 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:22.363628 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:50:22.983912 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:22.983880 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88d576cfc-264k9"] May 29 00:50:23.431424 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:23.431387 2563 generic.go:358] "Generic (PLEG): container finished" podID="31c35fd7-f103-4f3b-b39c-b5557b7ebe92" containerID="f0d5a8c2615caad085436599e78d66803da882bd0e328a6c58d587f3f3dbf0ff" exitCode=0 May 29 00:50:23.431831 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:23.431435 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-66nzn" event={"ID":"31c35fd7-f103-4f3b-b39c-b5557b7ebe92","Type":"ContainerDied","Data":"f0d5a8c2615caad085436599e78d66803da882bd0e328a6c58d587f3f3dbf0ff"} May 29 00:50:23.431831 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:23.431796 2563 scope.go:117] "RemoveContainer" containerID="f0d5a8c2615caad085436599e78d66803da882bd0e328a6c58d587f3f3dbf0ff" May 29 00:50:24.435920 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:24.435882 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-66nzn" event={"ID":"31c35fd7-f103-4f3b-b39c-b5557b7ebe92","Type":"ContainerStarted","Data":"7fce8468c61d89983a221c63147ec3be21bc861c29f116b1aadbc29661785098"} May 29 00:50:28.449836 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:28.449801 2563 generic.go:358] "Generic (PLEG): container finished" podID="23591fcd-8159-497b-955d-6b65ec92d269" containerID="9126a17a9e1c7ee2be4044712c0eb4cb559ea8804720d211a404e159a0a4a666" exitCode=0 May 29 00:50:28.450201 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:28.449879 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" event={"ID":"23591fcd-8159-497b-955d-6b65ec92d269","Type":"ContainerDied","Data":"9126a17a9e1c7ee2be4044712c0eb4cb559ea8804720d211a404e159a0a4a666"} May 29 00:50:28.450243 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:28.450224 2563 scope.go:117] "RemoveContainer" containerID="9126a17a9e1c7ee2be4044712c0eb4cb559ea8804720d211a404e159a0a4a666" May 29 00:50:29.454340 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:29.454304 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mgpmp" event={"ID":"23591fcd-8159-497b-955d-6b65ec92d269","Type":"ContainerStarted","Data":"ddb64e53848ad8021350c4cf9c5c61ee5505c4108d4ae5de225a6d62eaf90c45"} May 29 00:50:40.996935 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:40.996899 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:50:41.017417 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:41.017387 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:50:41.520717 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:41.520669 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:50:48.003505 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.003460 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-88d576cfc-264k9" podUID="eed0547e-57d1-4902-8664-08a4e8d00e72" containerName="registry" containerID="cri-o://56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59" gracePeriod=30 May 29 00:50:48.256789 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.256709 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:50:48.384546 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.384505 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-installation-pull-secrets\") pod \"eed0547e-57d1-4902-8664-08a4e8d00e72\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " May 29 00:50:48.384759 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.384581 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t99td\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-kube-api-access-t99td\") pod \"eed0547e-57d1-4902-8664-08a4e8d00e72\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " May 29 00:50:48.384759 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.384611 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-certificates\") pod \"eed0547e-57d1-4902-8664-08a4e8d00e72\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " May 29 00:50:48.384759 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.384627 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eed0547e-57d1-4902-8664-08a4e8d00e72-ca-trust-extracted\") pod \"eed0547e-57d1-4902-8664-08a4e8d00e72\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " May 29 00:50:48.384759 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.384653 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-bound-sa-token\") pod \"eed0547e-57d1-4902-8664-08a4e8d00e72\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " May 29 00:50:48.384759 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.384697 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-image-registry-private-configuration\") pod \"eed0547e-57d1-4902-8664-08a4e8d00e72\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " May 29 00:50:48.385025 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.384771 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") pod \"eed0547e-57d1-4902-8664-08a4e8d00e72\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " May 29 00:50:48.385025 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.384813 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-trusted-ca\") pod \"eed0547e-57d1-4902-8664-08a4e8d00e72\" (UID: \"eed0547e-57d1-4902-8664-08a4e8d00e72\") " May 29 00:50:48.385190 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.385160 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eed0547e-57d1-4902-8664-08a4e8d00e72" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:50:48.385685 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.385644 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eed0547e-57d1-4902-8664-08a4e8d00e72" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:50:48.387360 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.387316 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eed0547e-57d1-4902-8664-08a4e8d00e72" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:50:48.387468 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.387383 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-kube-api-access-t99td" (OuterVolumeSpecName: "kube-api-access-t99td") pod "eed0547e-57d1-4902-8664-08a4e8d00e72" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72"). InnerVolumeSpecName "kube-api-access-t99td". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:50:48.387624 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.387599 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eed0547e-57d1-4902-8664-08a4e8d00e72" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:48.387836 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.387815 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eed0547e-57d1-4902-8664-08a4e8d00e72" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:50:48.387836 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.387826 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eed0547e-57d1-4902-8664-08a4e8d00e72" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:48.396238 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.396209 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed0547e-57d1-4902-8664-08a4e8d00e72-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eed0547e-57d1-4902-8664-08a4e8d00e72" (UID: "eed0547e-57d1-4902-8664-08a4e8d00e72"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:50:48.486274 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.486240 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-trusted-ca\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:48.486274 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.486272 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-installation-pull-secrets\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:48.486463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.486284 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t99td\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-kube-api-access-t99td\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:48.486463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.486295 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-certificates\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:48.486463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.486303 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eed0547e-57d1-4902-8664-08a4e8d00e72-ca-trust-extracted\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:48.486463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.486312 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-bound-sa-token\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:48.486463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.486321 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eed0547e-57d1-4902-8664-08a4e8d00e72-image-registry-private-configuration\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:48.486463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.486331 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eed0547e-57d1-4902-8664-08a4e8d00e72-registry-tls\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:48.524670 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.524576 2563 generic.go:358] "Generic (PLEG): container finished" podID="eed0547e-57d1-4902-8664-08a4e8d00e72" containerID="56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59" exitCode=0 May 29 00:50:48.524670 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.524627 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88d576cfc-264k9" event={"ID":"eed0547e-57d1-4902-8664-08a4e8d00e72","Type":"ContainerDied","Data":"56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59"} May 29 00:50:48.524892 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.524679 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88d576cfc-264k9" event={"ID":"eed0547e-57d1-4902-8664-08a4e8d00e72","Type":"ContainerDied","Data":"5974351e0c147fac5ad5cca955c854f7f4c7efad45d55106965aa1ba7e014817"} May 29 00:50:48.524892 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.524699 2563 scope.go:117] "RemoveContainer" containerID="56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59" May 29 00:50:48.524892 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.524641 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88d576cfc-264k9" May 29 00:50:48.533968 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.533951 2563 scope.go:117] "RemoveContainer" containerID="56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59" May 29 00:50:48.534231 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:50:48.534213 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59\": container with ID starting with 56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59 not found: ID does not exist" containerID="56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59" May 29 00:50:48.534282 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.534239 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59"} err="failed to get container status \"56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59\": rpc error: code = NotFound desc = could not find container \"56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59\": container with ID starting with 56e25f5d7cc22b85a131e63452067f4fd2ca7b1871b9879d6dcaf7a081fa1f59 not found: ID does not exist" May 29 00:50:48.546657 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.546632 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88d576cfc-264k9"] May 29 00:50:48.550226 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.550201 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-88d576cfc-264k9"] May 29 00:50:48.756677 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:48.756647 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed0547e-57d1-4902-8664-08a4e8d00e72" path="/var/lib/kubelet/pods/eed0547e-57d1-4902-8664-08a4e8d00e72/volumes" May 29 00:50:54.782498 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:54.782461 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:50:54.782982 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:54.782922 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="alertmanager" containerID="cri-o://a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00" gracePeriod=120 May 29 00:50:54.783134 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:54.782975 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy-metric" containerID="cri-o://9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7" gracePeriod=120 May 29 00:50:54.783134 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:54.783039 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy" containerID="cri-o://839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636" gracePeriod=120 May 29 00:50:54.783134 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:54.783079 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="prom-label-proxy" containerID="cri-o://c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc" gracePeriod=120 May 29 00:50:54.783134 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:54.783084 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="config-reloader" containerID="cri-o://64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3" gracePeriod=120 May 29 00:50:54.783462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:54.783262 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy-web" containerID="cri-o://96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a" gracePeriod=120 May 29 00:50:55.549978 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:55.549946 2563 generic.go:358] "Generic (PLEG): container finished" podID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerID="c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc" exitCode=0 May 29 00:50:55.549978 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:55.549971 2563 generic.go:358] "Generic (PLEG): container finished" podID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerID="839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636" exitCode=0 May 29 00:50:55.549978 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:55.549977 2563 generic.go:358] "Generic (PLEG): container finished" podID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerID="64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3" exitCode=0 May 29 00:50:55.549978 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:55.549983 2563 generic.go:358] "Generic (PLEG): container finished" podID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerID="a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00" exitCode=0 May 29 00:50:55.550256 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:55.550020 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerDied","Data":"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc"} May 29 00:50:55.550256 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:55.550060 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerDied","Data":"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636"} May 29 00:50:55.550256 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:55.550075 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerDied","Data":"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3"} May 29 00:50:55.550256 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:55.550088 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerDied","Data":"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00"} May 29 00:50:56.031336 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.030989 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.053039 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053007 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-main-db\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053039 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053045 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-web-config\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053268 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053073 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-metrics-client-ca\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053268 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053093 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-out\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053268 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053124 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053268 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053156 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-tls-assets\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053268 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053181 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb9dx\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-kube-api-access-mb9dx\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053268 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053213 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053268 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053255 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053619 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053294 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053619 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053323 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-cluster-tls-config\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053619 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053328 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:50:56.053619 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053354 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053619 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053393 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-volume\") pod \"dbaf2e92-c94a-40c2-b27b-485126a622e8\" (UID: \"dbaf2e92-c94a-40c2-b27b-485126a622e8\") " May 29 00:50:56.053619 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053417 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:50:56.053980 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053661 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-main-db\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.053980 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053682 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-metrics-client-ca\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.053980 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.053712 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:50:56.056501 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.056169 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:56.057684 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.057259 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-out" (OuterVolumeSpecName: "config-out") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:50:56.057684 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.057276 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-kube-api-access-mb9dx" (OuterVolumeSpecName: "kube-api-access-mb9dx") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "kube-api-access-mb9dx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:50:56.057684 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.057286 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-volume" (OuterVolumeSpecName: "config-volume") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:56.057684 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.057495 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:56.057684 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.057581 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:50:56.057990 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.057893 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:56.058249 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.058232 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:56.061886 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.061850 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:56.072648 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.072610 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-web-config" (OuterVolumeSpecName: "web-config") pod "dbaf2e92-c94a-40c2-b27b-485126a622e8" (UID: "dbaf2e92-c94a-40c2-b27b-485126a622e8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:50:56.154371 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154333 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-tls-assets\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154371 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154369 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb9dx\" (UniqueName: \"kubernetes.io/projected/dbaf2e92-c94a-40c2-b27b-485126a622e8-kube-api-access-mb9dx\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154371 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154380 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf2e92-c94a-40c2-b27b-485126a622e8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154390 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-main-tls\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154401 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154412 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-cluster-tls-config\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154422 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154431 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-volume\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154439 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-web-config\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154447 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbaf2e92-c94a-40c2-b27b-485126a622e8-config-out\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.154617 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.154456 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbaf2e92-c94a-40c2-b27b-485126a622e8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:50:56.555480 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.555389 2563 generic.go:358] "Generic (PLEG): container finished" podID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerID="9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7" exitCode=0 May 29 00:50:56.555480 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.555419 2563 generic.go:358] "Generic (PLEG): container finished" podID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerID="96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a" exitCode=0 May 29 00:50:56.555710 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.555472 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerDied","Data":"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7"} May 29 00:50:56.555710 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.555520 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerDied","Data":"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a"} May 29 00:50:56.555710 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.555523 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.555710 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.555535 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbaf2e92-c94a-40c2-b27b-485126a622e8","Type":"ContainerDied","Data":"23252631d9ce7ff5220cdd1f821b25b285d39722a259cb4f03cdb559f4b90c9e"} May 29 00:50:56.555710 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.555555 2563 scope.go:117] "RemoveContainer" containerID="c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc" May 29 00:50:56.563805 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.563783 2563 scope.go:117] "RemoveContainer" containerID="9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7" May 29 00:50:56.570891 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.570873 2563 scope.go:117] "RemoveContainer" containerID="839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636" May 29 00:50:56.578388 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.578365 2563 scope.go:117] "RemoveContainer" containerID="96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a" May 29 00:50:56.579271 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.579250 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:50:56.584025 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.584001 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:50:56.586124 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.586105 2563 scope.go:117] "RemoveContainer" containerID="64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3" May 29 00:50:56.592834 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.592819 2563 scope.go:117] "RemoveContainer" containerID="a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00" May 29 00:50:56.600070 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.600054 2563 scope.go:117] "RemoveContainer" containerID="f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128" May 29 00:50:56.605533 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.605505 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:50:56.605955 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.605938 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="config-reloader" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.605957 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="config-reloader" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.605978 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="init-config-reloader" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.605986 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="init-config-reloader" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.605997 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy-metric" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606005 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy-metric" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606017 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed0547e-57d1-4902-8664-08a4e8d00e72" containerName="registry" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606026 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed0547e-57d1-4902-8664-08a4e8d00e72" containerName="registry" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606042 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy" May 29 00:50:56.606049 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606050 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606060 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy-web" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606068 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy-web" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606079 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="alertmanager" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606087 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="alertmanager" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606095 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="prom-label-proxy" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606104 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="prom-label-proxy" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606188 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="alertmanager" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606204 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy-metric" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606215 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606226 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="kube-rbac-proxy-web" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606235 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="eed0547e-57d1-4902-8664-08a4e8d00e72" containerName="registry" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606244 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="prom-label-proxy" May 29 00:50:56.606452 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.606256 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" containerName="config-reloader" May 29 00:50:56.607251 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.607229 2563 scope.go:117] "RemoveContainer" containerID="c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc" May 29 00:50:56.607523 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:50:56.607504 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc\": container with ID starting with c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc not found: ID does not exist" containerID="c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc" May 29 00:50:56.607577 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.607533 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc"} err="failed to get container status \"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc\": rpc error: code = NotFound desc = could not find container \"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc\": container with ID starting with c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc not found: ID does not exist" May 29 00:50:56.607577 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.607554 2563 scope.go:117] "RemoveContainer" containerID="9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7" May 29 00:50:56.607814 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:50:56.607798 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7\": container with ID starting with 9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7 not found: ID does not exist" containerID="9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7" May 29 00:50:56.607866 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.607818 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7"} err="failed to get container status \"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7\": rpc error: code = NotFound desc = could not find container \"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7\": container with ID starting with 9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7 not found: ID does not exist" May 29 00:50:56.607866 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.607832 2563 scope.go:117] "RemoveContainer" containerID="839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636" May 29 00:50:56.608092 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:50:56.608075 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636\": container with ID starting with 839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636 not found: ID does not exist" containerID="839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636" May 29 00:50:56.608141 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.608098 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636"} err="failed to get container status \"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636\": rpc error: code = NotFound desc = could not find container \"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636\": container with ID starting with 839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636 not found: ID does not exist" May 29 00:50:56.608141 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.608116 2563 scope.go:117] "RemoveContainer" containerID="96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a" May 29 00:50:56.608296 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:50:56.608280 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a\": container with ID starting with 96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a not found: ID does not exist" containerID="96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a" May 29 00:50:56.608330 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.608302 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a"} err="failed to get container status \"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a\": rpc error: code = NotFound desc = could not find container \"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a\": container with ID starting with 96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a not found: ID does not exist" May 29 00:50:56.608330 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.608322 2563 scope.go:117] "RemoveContainer" containerID="64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3" May 29 00:50:56.608568 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:50:56.608552 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3\": container with ID starting with 64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3 not found: ID does not exist" containerID="64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3" May 29 00:50:56.608611 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.608571 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3"} err="failed to get container status \"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3\": rpc error: code = NotFound desc = could not find container \"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3\": container with ID starting with 64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3 not found: ID does not exist" May 29 00:50:56.608611 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.608585 2563 scope.go:117] "RemoveContainer" containerID="a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00" May 29 00:50:56.608874 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:50:56.608837 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00\": container with ID starting with a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00 not found: ID does not exist" containerID="a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00" May 29 00:50:56.608937 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.608881 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00"} err="failed to get container status \"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00\": rpc error: code = NotFound desc = could not find container \"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00\": container with ID starting with a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00 not found: ID does not exist" May 29 00:50:56.608937 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.608903 2563 scope.go:117] "RemoveContainer" containerID="f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128" May 29 00:50:56.609164 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:50:56.609146 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128\": container with ID starting with f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128 not found: ID does not exist" containerID="f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128" May 29 00:50:56.609223 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.609171 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128"} err="failed to get container status \"f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128\": rpc error: code = NotFound desc = could not find container \"f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128\": container with ID starting with f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128 not found: ID does not exist" May 29 00:50:56.609223 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.609192 2563 scope.go:117] "RemoveContainer" containerID="c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc" May 29 00:50:56.609464 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.609445 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc"} err="failed to get container status \"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc\": rpc error: code = NotFound desc = could not find container \"c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc\": container with ID starting with c30d4ed9aecd3fab68f89ccbdc5454d90078184b1c99fe2f048bf62173cf50cc not found: ID does not exist" May 29 00:50:56.609516 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.609465 2563 scope.go:117] "RemoveContainer" containerID="9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7" May 29 00:50:56.609673 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.609654 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7"} err="failed to get container status \"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7\": rpc error: code = NotFound desc = could not find container \"9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7\": container with ID starting with 9ba5240f0c50f0db348a620de9a5edc97c7dc83dfddc6104186e276abd5cf6a7 not found: ID does not exist" May 29 00:50:56.609758 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.609674 2563 scope.go:117] "RemoveContainer" containerID="839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636" May 29 00:50:56.609889 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.609874 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636"} err="failed to get container status \"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636\": rpc error: code = NotFound desc = could not find container \"839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636\": container with ID starting with 839681d96a8ed072895733caf11f52a84debcdfb2068ac6e9afb4a370c388636 not found: ID does not exist" May 29 00:50:56.609934 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.609889 2563 scope.go:117] "RemoveContainer" containerID="96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a" May 29 00:50:56.610083 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.610069 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a"} err="failed to get container status \"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a\": rpc error: code = NotFound desc = could not find container \"96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a\": container with ID starting with 96354274a0f12f1d5df64051bbcc18c31581ddb22ceef3f3e1ed110ba4a5543a not found: ID does not exist" May 29 00:50:56.610083 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.610082 2563 scope.go:117] "RemoveContainer" containerID="64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3" May 29 00:50:56.610282 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.610267 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3"} err="failed to get container status \"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3\": rpc error: code = NotFound desc = could not find container \"64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3\": container with ID starting with 64ec1b0a6765317e7af7c445c9c74e8e67f36ce74ff813e9e40f32eea08b9cb3 not found: ID does not exist" May 29 00:50:56.610282 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.610280 2563 scope.go:117] "RemoveContainer" containerID="a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00" May 29 00:50:56.610392 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.610377 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.610576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.610427 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00"} err="failed to get container status \"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00\": rpc error: code = NotFound desc = could not find container \"a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00\": container with ID starting with a190d9bb172c03981e987b87bf5dea425d76d6388d2bc1d82affd5a984b80f00 not found: ID does not exist" May 29 00:50:56.610576 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.610439 2563 scope.go:117] "RemoveContainer" containerID="f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128" May 29 00:50:56.610687 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.610626 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128"} err="failed to get container status \"f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128\": rpc error: code = NotFound desc = could not find container \"f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128\": container with ID starting with f5f4f66af55c6850e8efed92e36e20da6ca95ab7a412ca1958293b2dfe546128 not found: ID does not exist" May 29 00:50:56.613018 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.613001 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 29 00:50:56.613139 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.613122 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-crcg4\"" May 29 00:50:56.613196 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.613158 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 29 00:50:56.613352 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.613338 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 29 00:50:56.613440 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.613370 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 29 00:50:56.613818 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.613799 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 29 00:50:56.613913 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.613826 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 29 00:50:56.613913 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.613857 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 29 00:50:56.614297 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.614280 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 29 00:50:56.619226 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.619184 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 29 00:50:56.621217 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.621193 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:50:56.659017 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.658988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-web-config\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659184 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659184 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbnx5\" (UniqueName: \"kubernetes.io/projected/7c09964d-609e-4b18-93da-513e0fa5ace2-kube-api-access-dbnx5\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659184 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c09964d-609e-4b18-93da-513e0fa5ace2-config-out\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659184 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659308 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c09964d-609e-4b18-93da-513e0fa5ace2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659308 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659308 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c09964d-609e-4b18-93da-513e0fa5ace2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659308 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c09964d-609e-4b18-93da-513e0fa5ace2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659308 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659449 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659449 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.659449 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.659399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c09964d-609e-4b18-93da-513e0fa5ace2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.757569 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.757530 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbaf2e92-c94a-40c2-b27b-485126a622e8" path="/var/lib/kubelet/pods/dbaf2e92-c94a-40c2-b27b-485126a622e8/volumes" May 29 00:50:56.760086 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760066 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c09964d-609e-4b18-93da-513e0fa5ace2-config-out\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760167 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760099 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760167 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760132 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c09964d-609e-4b18-93da-513e0fa5ace2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760167 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760149 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760298 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760168 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c09964d-609e-4b18-93da-513e0fa5ace2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760298 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760254 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c09964d-609e-4b18-93da-513e0fa5ace2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760298 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760293 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760427 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760323 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760427 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760353 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760427 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760386 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c09964d-609e-4b18-93da-513e0fa5ace2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760426 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-web-config\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760482 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760506 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbnx5\" (UniqueName: \"kubernetes.io/projected/7c09964d-609e-4b18-93da-513e0fa5ace2-kube-api-access-dbnx5\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.760571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c09964d-609e-4b18-93da-513e0fa5ace2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.761363 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.760987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c09964d-609e-4b18-93da-513e0fa5ace2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.761895 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.761716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c09964d-609e-4b18-93da-513e0fa5ace2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.763707 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.763661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c09964d-609e-4b18-93da-513e0fa5ace2-config-out\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.763845 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.763707 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.763845 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.763766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.763944 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.763882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.764022 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.763998 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c09964d-609e-4b18-93da-513e0fa5ace2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.764139 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.764116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.764351 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.764336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.764608 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.764588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-web-config\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.765703 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.765681 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c09964d-609e-4b18-93da-513e0fa5ace2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.768798 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.768779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbnx5\" (UniqueName: \"kubernetes.io/projected/7c09964d-609e-4b18-93da-513e0fa5ace2-kube-api-access-dbnx5\") pod \"alertmanager-main-0\" (UID: \"7c09964d-609e-4b18-93da-513e0fa5ace2\") " pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:56.920831 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:56.920796 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 00:50:57.058114 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:57.057967 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 00:50:57.060899 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:50:57.060871 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c09964d_609e_4b18_93da_513e0fa5ace2.slice/crio-f5e97eaac7ed7f3c1ad5846d1c7c3d8cdc4dfa9ec053b0a8ae58a6798a8b7c43 WatchSource:0}: Error finding container f5e97eaac7ed7f3c1ad5846d1c7c3d8cdc4dfa9ec053b0a8ae58a6798a8b7c43: Status 404 returned error can't find the container with id f5e97eaac7ed7f3c1ad5846d1c7c3d8cdc4dfa9ec053b0a8ae58a6798a8b7c43 May 29 00:50:57.561166 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:57.561086 2563 generic.go:358] "Generic (PLEG): container finished" podID="7c09964d-609e-4b18-93da-513e0fa5ace2" containerID="f49cebf828ed17aee16da1d04219b2a6752f17f9c04f93c317c0e988b2d1e04b" exitCode=0 May 29 00:50:57.561313 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:57.561169 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c09964d-609e-4b18-93da-513e0fa5ace2","Type":"ContainerDied","Data":"f49cebf828ed17aee16da1d04219b2a6752f17f9c04f93c317c0e988b2d1e04b"} May 29 00:50:57.561313 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:57.561208 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c09964d-609e-4b18-93da-513e0fa5ace2","Type":"ContainerStarted","Data":"f5e97eaac7ed7f3c1ad5846d1c7c3d8cdc4dfa9ec053b0a8ae58a6798a8b7c43"} May 29 00:50:58.567286 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:58.567246 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c09964d-609e-4b18-93da-513e0fa5ace2","Type":"ContainerStarted","Data":"e9270fecfa76aba339e4d1297cea395f62ff9f1ffa89c811ce4ed174479deb42"} May 29 00:50:58.567286 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:58.567286 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c09964d-609e-4b18-93da-513e0fa5ace2","Type":"ContainerStarted","Data":"314794c2e7f49b116cb983b2e3485937cecb1d05d6491cda98a6eaa8ca55198c"} May 29 00:50:58.567887 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:58.567296 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c09964d-609e-4b18-93da-513e0fa5ace2","Type":"ContainerStarted","Data":"0b54142ff6e8c3a5a2bff16c95bc98374e82df7f02f62bd563730255e9dde15e"} May 29 00:50:58.567887 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:58.567305 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c09964d-609e-4b18-93da-513e0fa5ace2","Type":"ContainerStarted","Data":"31e038827b39bd68563ddb17586736d5e4c9cb849627c88fc30df2f1b60f209f"} May 29 00:50:58.567887 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:58.567313 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c09964d-609e-4b18-93da-513e0fa5ace2","Type":"ContainerStarted","Data":"6518f589e2d7e8dccd5e48e64db4eafa10f8f6bc9d46b3b7dd721b1ea2ae7d0f"} May 29 00:50:58.567887 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:58.567320 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c09964d-609e-4b18-93da-513e0fa5ace2","Type":"ContainerStarted","Data":"0b9c9077b6db6934be2254bc527809317f733791ad5fd4496cb18fb881550caa"} May 29 00:50:58.593468 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:58.593420 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5934031810000002 podStartE2EDuration="2.593403181s" podCreationTimestamp="2026-05-29 00:50:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:50:58.591608581 +0000 UTC m=+220.486820049" watchObservedRunningTime="2026-05-29 00:50:58.593403181 +0000 UTC m=+220.488614649" May 29 00:50:59.023436 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.023399 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:50:59.024053 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.023875 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="prometheus" containerID="cri-o://6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166" gracePeriod=600 May 29 00:50:59.024053 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.023898 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy" containerID="cri-o://dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2" gracePeriod=600 May 29 00:50:59.024053 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.023935 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="thanos-sidecar" containerID="cri-o://2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b" gracePeriod=600 May 29 00:50:59.024053 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.023938 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef" gracePeriod=600 May 29 00:50:59.024053 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.023957 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="config-reloader" containerID="cri-o://c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2" gracePeriod=600 May 29 00:50:59.024053 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.023938 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy-web" containerID="cri-o://47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921" gracePeriod=600 May 29 00:50:59.573702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573662 2563 generic.go:358] "Generic (PLEG): container finished" podID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerID="38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef" exitCode=0 May 29 00:50:59.573702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573686 2563 generic.go:358] "Generic (PLEG): container finished" podID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerID="dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2" exitCode=0 May 29 00:50:59.573702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573692 2563 generic.go:358] "Generic (PLEG): container finished" podID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerID="2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b" exitCode=0 May 29 00:50:59.573702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573709 2563 generic.go:358] "Generic (PLEG): container finished" podID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerID="c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2" exitCode=0 May 29 00:50:59.574180 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573718 2563 generic.go:358] "Generic (PLEG): container finished" podID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerID="6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166" exitCode=0 May 29 00:50:59.574180 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573751 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerDied","Data":"38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef"} May 29 00:50:59.574180 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573784 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerDied","Data":"dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2"} May 29 00:50:59.574180 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573798 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerDied","Data":"2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b"} May 29 00:50:59.574180 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573811 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerDied","Data":"c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2"} May 29 00:50:59.574180 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:50:59.573822 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerDied","Data":"6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166"} May 29 00:51:00.272260 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.272236 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.391050 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391021 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-metrics-client-certs\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391227 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391059 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-tls\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391227 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391076 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391227 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391108 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-rulefiles-0\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391227 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391132 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-thanos-prometheus-http-client-file\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391227 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391159 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-trusted-ca-bundle\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391227 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391187 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-serving-certs-ca-bundle\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391227 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391212 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrqbq\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-kube-api-access-nrqbq\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391248 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-config\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391276 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-grpc-tls\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391304 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-web-config\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391331 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-config-out\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391357 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-metrics-client-ca\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391386 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-tls-assets\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391412 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-kube-rbac-proxy\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391448 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-kubelet-serving-ca-bundle\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391504 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.391584 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391582 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-db\") pod \"54b5011a-6623-44f8-9e8d-a5798827d42b\" (UID: \"54b5011a-6623-44f8-9e8d-a5798827d42b\") " May 29 00:51:00.392252 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391638 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:51:00.392252 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391814 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:51:00.392252 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.391982 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.392252 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.392003 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.392853 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.392822 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:51:00.393313 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.393174 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:51:00.393313 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.393275 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:51:00.393681 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.393397 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:51:00.394182 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.394153 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.395422 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.395378 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.395607 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.395572 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.395925 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.395903 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.396012 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.395930 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.396143 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.396121 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-config" (OuterVolumeSpecName: "config") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.396533 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.396511 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.396954 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.396929 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:51:00.397070 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.397021 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-config-out" (OuterVolumeSpecName: "config-out") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:51:00.397138 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.397059 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.397574 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.397553 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-kube-api-access-nrqbq" (OuterVolumeSpecName: "kube-api-access-nrqbq") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "kube-api-access-nrqbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:51:00.407846 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.407823 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-web-config" (OuterVolumeSpecName: "web-config") pod "54b5011a-6623-44f8-9e8d-a5798827d42b" (UID: "54b5011a-6623-44f8-9e8d-a5798827d42b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:51:00.492996 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.492965 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-db\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.492996 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.492995 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-metrics-client-certs\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493006 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493017 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493026 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493036 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493045 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrqbq\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-kube-api-access-nrqbq\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493053 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-config\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493063 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-grpc-tls\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493071 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-web-config\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493078 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54b5011a-6623-44f8-9e8d-a5798827d42b-config-out\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493086 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-metrics-client-ca\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493095 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54b5011a-6623-44f8-9e8d-a5798827d42b-tls-assets\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493105 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-kube-rbac-proxy\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493114 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b5011a-6623-44f8-9e8d-a5798827d42b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.493154 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.493122 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54b5011a-6623-44f8-9e8d-a5798827d42b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:51:00.581037 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.580999 2563 generic.go:358] "Generic (PLEG): container finished" podID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerID="47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921" exitCode=0 May 29 00:51:00.581395 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.581044 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerDied","Data":"47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921"} May 29 00:51:00.581395 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.581077 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54b5011a-6623-44f8-9e8d-a5798827d42b","Type":"ContainerDied","Data":"8ace7f11818c6153215c86c702807f10e30dbf05e7ddb6cf6af11d6958883808"} May 29 00:51:00.581395 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.581115 2563 scope.go:117] "RemoveContainer" containerID="38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef" May 29 00:51:00.581395 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.581129 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.591739 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.591701 2563 scope.go:117] "RemoveContainer" containerID="dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2" May 29 00:51:00.602470 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.602447 2563 scope.go:117] "RemoveContainer" containerID="47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921" May 29 00:51:00.608758 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.608714 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:51:00.610999 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.610973 2563 scope.go:117] "RemoveContainer" containerID="2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b" May 29 00:51:00.612492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.612468 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:51:00.618500 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.618461 2563 scope.go:117] "RemoveContainer" containerID="c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2" May 29 00:51:00.625166 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.625145 2563 scope.go:117] "RemoveContainer" containerID="6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166" May 29 00:51:00.632513 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.632493 2563 scope.go:117] "RemoveContainer" containerID="bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc" May 29 00:51:00.635019 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.634996 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:51:00.635350 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635335 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="init-config-reloader" May 29 00:51:00.635350 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635350 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="init-config-reloader" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635366 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="prometheus" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635372 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="prometheus" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635380 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635385 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635392 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy-thanos" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635397 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy-thanos" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635403 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="config-reloader" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635408 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="config-reloader" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635414 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy-web" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635419 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy-web" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635431 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="thanos-sidecar" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635435 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="thanos-sidecar" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635480 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="prometheus" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635488 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635494 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy-web" May 29 00:51:00.635492 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635501 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="config-reloader" May 29 00:51:00.636254 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635507 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="thanos-sidecar" May 29 00:51:00.636254 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.635516 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" containerName="kube-rbac-proxy-thanos" May 29 00:51:00.639187 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.639170 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.640187 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.640168 2563 scope.go:117] "RemoveContainer" containerID="38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef" May 29 00:51:00.640501 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:51:00.640475 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef\": container with ID starting with 38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef not found: ID does not exist" containerID="38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef" May 29 00:51:00.640565 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.640514 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef"} err="failed to get container status \"38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef\": rpc error: code = NotFound desc = could not find container \"38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef\": container with ID starting with 38b26828880dea49784734158dc9f01cd56f00d71250c87547230fea7c87e5ef not found: ID does not exist" May 29 00:51:00.640565 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.640543 2563 scope.go:117] "RemoveContainer" containerID="dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2" May 29 00:51:00.640829 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:51:00.640809 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2\": container with ID starting with dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2 not found: ID does not exist" containerID="dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2" May 29 00:51:00.640898 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.640837 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2"} err="failed to get container status \"dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2\": rpc error: code = NotFound desc = could not find container \"dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2\": container with ID starting with dd029ae03f23104cbd940737673933b8ed8b94dd627bd65ab8e31c0221b6f1c2 not found: ID does not exist" May 29 00:51:00.640898 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.640861 2563 scope.go:117] "RemoveContainer" containerID="47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921" May 29 00:51:00.641175 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:51:00.641134 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921\": container with ID starting with 47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921 not found: ID does not exist" containerID="47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921" May 29 00:51:00.641175 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.641157 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921"} err="failed to get container status \"47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921\": rpc error: code = NotFound desc = could not find container \"47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921\": container with ID starting with 47572b3f26122d68ce3b8a49ed82748554e019a1f5defcc88952b5910c51a921 not found: ID does not exist" May 29 00:51:00.641280 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.641179 2563 scope.go:117] "RemoveContainer" containerID="2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b" May 29 00:51:00.641409 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:51:00.641394 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b\": container with ID starting with 2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b not found: ID does not exist" containerID="2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b" May 29 00:51:00.641463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.641415 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b"} err="failed to get container status \"2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b\": rpc error: code = NotFound desc = could not find container \"2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b\": container with ID starting with 2241e8bbfcccf391fe6052073da24c3d234eb3ae737d05e2220cf3f4e818b63b not found: ID does not exist" May 29 00:51:00.641463 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.641434 2563 scope.go:117] "RemoveContainer" containerID="c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2" May 29 00:51:00.641654 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:51:00.641633 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2\": container with ID starting with c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2 not found: ID does not exist" containerID="c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2" May 29 00:51:00.641706 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.641662 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2"} err="failed to get container status \"c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2\": rpc error: code = NotFound desc = could not find container \"c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2\": container with ID starting with c3f6a730f63f143166fc8618c94a50792c79da9e2c4931f98d70850bc8fd9ca2 not found: ID does not exist" May 29 00:51:00.641706 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.641684 2563 scope.go:117] "RemoveContainer" containerID="6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166" May 29 00:51:00.642076 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:51:00.642053 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166\": container with ID starting with 6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166 not found: ID does not exist" containerID="6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166" May 29 00:51:00.642157 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642084 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166"} err="failed to get container status \"6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166\": rpc error: code = NotFound desc = could not find container \"6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166\": container with ID starting with 6a70fb9bf6996329a47f8e95a3b418b2c3db81d49ef13241b2d0c6a8c0b57166 not found: ID does not exist" May 29 00:51:00.642157 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642100 2563 scope.go:117] "RemoveContainer" containerID="bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc" May 29 00:51:00.642157 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642112 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6bpsug9hm9ler\"" May 29 00:51:00.642157 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642128 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 00:51:00.642384 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642221 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 00:51:00.642384 ip-10-0-131-222 kubenswrapper[2563]: E0529 00:51:00.642333 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc\": container with ID starting with bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc not found: ID does not exist" containerID="bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc" May 29 00:51:00.642384 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642363 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc"} err="failed to get container status \"bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc\": rpc error: code = NotFound desc = could not find container \"bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc\": container with ID starting with bd4f3f9d1388a3ee76aaaf55edb1d677822abe6d4ed856da039dd00b7f8abebc not found: ID does not exist" May 29 00:51:00.642531 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642444 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ztwfq\"" May 29 00:51:00.642531 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642468 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 00:51:00.642531 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642505 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 00:51:00.642665 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642529 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 00:51:00.642665 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642537 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 00:51:00.642665 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642556 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 00:51:00.642665 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642567 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 00:51:00.642863 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642698 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 00:51:00.642863 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.642833 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 00:51:00.643254 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.643236 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 00:51:00.644562 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.644542 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 00:51:00.647505 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.647487 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 00:51:00.651606 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.651583 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:51:00.695179 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695343 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695343 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-config\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695343 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695343 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695509 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695509 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695509 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695509 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695509 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695509 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695788 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695788 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695788 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695788 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695788 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695788 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v59wg\" (UniqueName: \"kubernetes.io/projected/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-kube-api-access-v59wg\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.695788 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.695782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.757545 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.757517 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54b5011a-6623-44f8-9e8d-a5798827d42b" path="/var/lib/kubelet/pods/54b5011a-6623-44f8-9e8d-a5798827d42b/volumes" May 29 00:51:00.797177 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797150 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797286 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797184 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797286 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797216 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-config\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797286 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797239 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797286 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797257 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797286 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797280 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797310 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797337 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797362 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797392 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797420 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797449 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797496 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797555 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797533 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797972 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797565 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797972 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797590 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797972 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797616 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v59wg\" (UniqueName: \"kubernetes.io/projected/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-kube-api-access-v59wg\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.797972 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.797663 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.798334 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.798021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.798334 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.798242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.798651 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.798610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.799903 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.799243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.800476 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.800428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.800757 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.800689 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.801261 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.801053 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.801261 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.801147 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.801563 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.801540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-config\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.801801 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.801779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.801886 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.801788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.801944 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.801882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.802959 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.802934 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.803039 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.802933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.803141 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.803119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.803618 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.803596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.803789 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.803773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.806679 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.806663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v59wg\" (UniqueName: \"kubernetes.io/projected/d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8-kube-api-access-v59wg\") pod \"prometheus-k8s-0\" (UID: \"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:00.950174 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:00.950074 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:51:01.083096 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:01.083070 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 00:51:01.084946 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:51:01.084920 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd880eaf1_516f_408c_ab5a_6f1e1cdbf6b8.slice/crio-6c6aeebb34ff7291aa6b72dd9721b053ba55465cbf109e066fe90ade1b244f94 WatchSource:0}: Error finding container 6c6aeebb34ff7291aa6b72dd9721b053ba55465cbf109e066fe90ade1b244f94: Status 404 returned error can't find the container with id 6c6aeebb34ff7291aa6b72dd9721b053ba55465cbf109e066fe90ade1b244f94 May 29 00:51:01.585559 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:01.585520 2563 generic.go:358] "Generic (PLEG): container finished" podID="d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8" containerID="8a7c141ddfc70ac43f3d457bf3e4efc35bd0029172eaefe73d08fe1d5ecce381" exitCode=0 May 29 00:51:01.585967 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:01.585606 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8","Type":"ContainerDied","Data":"8a7c141ddfc70ac43f3d457bf3e4efc35bd0029172eaefe73d08fe1d5ecce381"} May 29 00:51:01.585967 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:01.585638 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8","Type":"ContainerStarted","Data":"6c6aeebb34ff7291aa6b72dd9721b053ba55465cbf109e066fe90ade1b244f94"} May 29 00:51:02.591746 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:02.591694 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8","Type":"ContainerStarted","Data":"349f5e080c10ebc3e3bcd431f1e35296dcb5de6bd3890c5443f6759ce054496c"} May 29 00:51:02.591746 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:02.591750 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8","Type":"ContainerStarted","Data":"cf06b88cfd5bd64f1c13d758b719963466812e0ce441eb0ba4da31b5ba458850"} May 29 00:51:02.592252 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:02.591762 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8","Type":"ContainerStarted","Data":"6acea71e021ce99325bdd95b55f68094b7f862181477325eeba5374ee7ef4107"} May 29 00:51:02.592252 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:02.591773 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8","Type":"ContainerStarted","Data":"322fc193218892c89f33ec760fc2f502dfebf44e78f70b9b15b14d9a946295b5"} May 29 00:51:02.592252 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:02.591780 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8","Type":"ContainerStarted","Data":"88617329c8e1107cf015465e3d18b53b7cc63eb62dbb381d541428a77f6a91cf"} May 29 00:51:02.592252 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:02.591788 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8","Type":"ContainerStarted","Data":"040cbef01fda2384855de790e4bc9d6234fa3c5b491587b14bb92e5622f8d82d"} May 29 00:51:02.618571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:02.618510 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.61849264 podStartE2EDuration="2.61849264s" podCreationTimestamp="2026-05-29 00:51:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:51:02.616794761 +0000 UTC m=+224.512006229" watchObservedRunningTime="2026-05-29 00:51:02.61849264 +0000 UTC m=+224.513704117" May 29 00:51:05.950606 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:51:05.950554 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:52:00.950570 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:00.950529 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:52:00.967316 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:00.967286 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:52:01.787855 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:01.787822 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 00:52:18.642649 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:18.642615 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:52:18.643148 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:18.643043 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:52:18.645600 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:18.645584 2563 kubelet.go:1628] "Image garbage collection succeeded" May 29 00:52:22.575219 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.575152 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s"] May 29 00:52:22.579133 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.579112 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" May 29 00:52:22.581900 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.581878 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 29 00:52:22.582023 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.581924 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 29 00:52:22.583715 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.583689 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vxbmv\"" May 29 00:52:22.586320 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.586293 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s"] May 29 00:52:22.623529 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.623491 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5dmxc"] May 29 00:52:22.627111 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.627091 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5dmxc" May 29 00:52:22.629766 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.629737 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 29 00:52:22.629897 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.629872 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nm4lr\"" May 29 00:52:22.630097 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.630080 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 29 00:52:22.634153 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.634125 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5dmxc"] May 29 00:52:22.692805 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.692718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97a9a329-b605-4369-8922-8cc8689912db-tmp\") pod \"openshift-lws-operator-bfc7f696d-wr48s\" (UID: \"97a9a329-b605-4369-8922-8cc8689912db\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" May 29 00:52:22.692991 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.692875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65tn9\" (UniqueName: \"kubernetes.io/projected/97a9a329-b605-4369-8922-8cc8689912db-kube-api-access-65tn9\") pod \"openshift-lws-operator-bfc7f696d-wr48s\" (UID: \"97a9a329-b605-4369-8922-8cc8689912db\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" May 29 00:52:22.793740 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.793688 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97a9a329-b605-4369-8922-8cc8689912db-tmp\") pod \"openshift-lws-operator-bfc7f696d-wr48s\" (UID: \"97a9a329-b605-4369-8922-8cc8689912db\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" May 29 00:52:22.793941 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.793818 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65tn9\" (UniqueName: \"kubernetes.io/projected/97a9a329-b605-4369-8922-8cc8689912db-kube-api-access-65tn9\") pod \"openshift-lws-operator-bfc7f696d-wr48s\" (UID: \"97a9a329-b605-4369-8922-8cc8689912db\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" May 29 00:52:22.793941 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.793875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48e1d719-c9d4-4ab9-aba5-da33b8317bbd-bound-sa-token\") pod \"cert-manager-79c8d999ff-5dmxc\" (UID: \"48e1d719-c9d4-4ab9-aba5-da33b8317bbd\") " pod="cert-manager/cert-manager-79c8d999ff-5dmxc" May 29 00:52:22.793941 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.793909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79qsf\" (UniqueName: \"kubernetes.io/projected/48e1d719-c9d4-4ab9-aba5-da33b8317bbd-kube-api-access-79qsf\") pod \"cert-manager-79c8d999ff-5dmxc\" (UID: \"48e1d719-c9d4-4ab9-aba5-da33b8317bbd\") " pod="cert-manager/cert-manager-79c8d999ff-5dmxc" May 29 00:52:22.794146 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.794122 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97a9a329-b605-4369-8922-8cc8689912db-tmp\") pod \"openshift-lws-operator-bfc7f696d-wr48s\" (UID: \"97a9a329-b605-4369-8922-8cc8689912db\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" May 29 00:52:22.803038 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.803006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65tn9\" (UniqueName: \"kubernetes.io/projected/97a9a329-b605-4369-8922-8cc8689912db-kube-api-access-65tn9\") pod \"openshift-lws-operator-bfc7f696d-wr48s\" (UID: \"97a9a329-b605-4369-8922-8cc8689912db\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" May 29 00:52:22.895209 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.895177 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48e1d719-c9d4-4ab9-aba5-da33b8317bbd-bound-sa-token\") pod \"cert-manager-79c8d999ff-5dmxc\" (UID: \"48e1d719-c9d4-4ab9-aba5-da33b8317bbd\") " pod="cert-manager/cert-manager-79c8d999ff-5dmxc" May 29 00:52:22.895209 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.895216 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79qsf\" (UniqueName: \"kubernetes.io/projected/48e1d719-c9d4-4ab9-aba5-da33b8317bbd-kube-api-access-79qsf\") pod \"cert-manager-79c8d999ff-5dmxc\" (UID: \"48e1d719-c9d4-4ab9-aba5-da33b8317bbd\") " pod="cert-manager/cert-manager-79c8d999ff-5dmxc" May 29 00:52:22.903849 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.903821 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79qsf\" (UniqueName: \"kubernetes.io/projected/48e1d719-c9d4-4ab9-aba5-da33b8317bbd-kube-api-access-79qsf\") pod \"cert-manager-79c8d999ff-5dmxc\" (UID: \"48e1d719-c9d4-4ab9-aba5-da33b8317bbd\") " pod="cert-manager/cert-manager-79c8d999ff-5dmxc" May 29 00:52:22.903983 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.903834 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48e1d719-c9d4-4ab9-aba5-da33b8317bbd-bound-sa-token\") pod \"cert-manager-79c8d999ff-5dmxc\" (UID: \"48e1d719-c9d4-4ab9-aba5-da33b8317bbd\") " pod="cert-manager/cert-manager-79c8d999ff-5dmxc" May 29 00:52:22.903983 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.903900 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" May 29 00:52:22.937454 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:22.937415 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5dmxc" May 29 00:52:23.049312 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:23.049176 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s"] May 29 00:52:23.052605 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:52:23.052543 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97a9a329_b605_4369_8922_8cc8689912db.slice/crio-6c48ab8c018336c5f1135b05daf066c19663fbb3f56dd71694d707f77f600fb2 WatchSource:0}: Error finding container 6c48ab8c018336c5f1135b05daf066c19663fbb3f56dd71694d707f77f600fb2: Status 404 returned error can't find the container with id 6c48ab8c018336c5f1135b05daf066c19663fbb3f56dd71694d707f77f600fb2 May 29 00:52:23.056177 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:23.056153 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 00:52:23.078757 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:23.078706 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5dmxc"] May 29 00:52:23.081359 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:52:23.081318 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48e1d719_c9d4_4ab9_aba5_da33b8317bbd.slice/crio-7d07fb14a2aa052f72b48d43eda0861eaeed4ee5d50e6c4d1e5e994f27242114 WatchSource:0}: Error finding container 7d07fb14a2aa052f72b48d43eda0861eaeed4ee5d50e6c4d1e5e994f27242114: Status 404 returned error can't find the container with id 7d07fb14a2aa052f72b48d43eda0861eaeed4ee5d50e6c4d1e5e994f27242114 May 29 00:52:23.852444 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:23.852400 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" event={"ID":"97a9a329-b605-4369-8922-8cc8689912db","Type":"ContainerStarted","Data":"6c48ab8c018336c5f1135b05daf066c19663fbb3f56dd71694d707f77f600fb2"} May 29 00:52:23.853668 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:23.853638 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5dmxc" event={"ID":"48e1d719-c9d4-4ab9-aba5-da33b8317bbd","Type":"ContainerStarted","Data":"7d07fb14a2aa052f72b48d43eda0861eaeed4ee5d50e6c4d1e5e994f27242114"} May 29 00:52:27.872017 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:27.871981 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" event={"ID":"97a9a329-b605-4369-8922-8cc8689912db","Type":"ContainerStarted","Data":"49187c6233a2ac4535dd1109c778693410b982197bb89e652ec88268babcd5fd"} May 29 00:52:27.873419 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:27.873397 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5dmxc" event={"ID":"48e1d719-c9d4-4ab9-aba5-da33b8317bbd","Type":"ContainerStarted","Data":"fdac672b192852b20fb0734401095a49f6ac94fed1e77f97c99c84aff12e66de"} May 29 00:52:27.888157 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:27.888107 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wr48s" podStartSLOduration=1.503330265 podStartE2EDuration="5.888091491s" podCreationTimestamp="2026-05-29 00:52:22 +0000 UTC" firstStartedPulling="2026-05-29 00:52:23.05634901 +0000 UTC m=+304.951560458" lastFinishedPulling="2026-05-29 00:52:27.441110235 +0000 UTC m=+309.336321684" observedRunningTime="2026-05-29 00:52:27.886742178 +0000 UTC m=+309.781953645" watchObservedRunningTime="2026-05-29 00:52:27.888091491 +0000 UTC m=+309.783302960" May 29 00:52:27.903776 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:27.903697 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-5dmxc" podStartSLOduration=1.595651944 podStartE2EDuration="5.903683501s" podCreationTimestamp="2026-05-29 00:52:22 +0000 UTC" firstStartedPulling="2026-05-29 00:52:23.083219506 +0000 UTC m=+304.978430956" lastFinishedPulling="2026-05-29 00:52:27.391251067 +0000 UTC m=+309.286462513" observedRunningTime="2026-05-29 00:52:27.901873936 +0000 UTC m=+309.797085403" watchObservedRunningTime="2026-05-29 00:52:27.903683501 +0000 UTC m=+309.798894969" May 29 00:52:47.215162 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.215129 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6"] May 29 00:52:47.218504 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.218483 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.221575 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.221552 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 29 00:52:47.221893 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.221875 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-km7r4\"" May 29 00:52:47.222005 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.221930 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 29 00:52:47.222119 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.222097 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 29 00:52:47.222350 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.222333 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 29 00:52:47.230957 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.230930 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6"] May 29 00:52:47.298908 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.298867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t2fn\" (UniqueName: \"kubernetes.io/projected/d12f8789-0d79-4ddb-87a6-7120e7a41c38-kube-api-access-4t2fn\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.299085 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.298919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d12f8789-0d79-4ddb-87a6-7120e7a41c38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.299085 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.298995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d12f8789-0d79-4ddb-87a6-7120e7a41c38-webhook-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.400506 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.400464 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4t2fn\" (UniqueName: \"kubernetes.io/projected/d12f8789-0d79-4ddb-87a6-7120e7a41c38-kube-api-access-4t2fn\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.400696 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.400521 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d12f8789-0d79-4ddb-87a6-7120e7a41c38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.400696 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.400558 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d12f8789-0d79-4ddb-87a6-7120e7a41c38-webhook-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.403204 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.403179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d12f8789-0d79-4ddb-87a6-7120e7a41c38-webhook-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.403204 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.403202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d12f8789-0d79-4ddb-87a6-7120e7a41c38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.411267 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.411245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t2fn\" (UniqueName: \"kubernetes.io/projected/d12f8789-0d79-4ddb-87a6-7120e7a41c38-kube-api-access-4t2fn\") pod \"opendatahub-operator-controller-manager-d9b8687fd-9rth6\" (UID: \"d12f8789-0d79-4ddb-87a6-7120e7a41c38\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.529965 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.529873 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:47.666992 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.666966 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6"] May 29 00:52:47.669135 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:52:47.669105 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12f8789_0d79_4ddb_87a6_7120e7a41c38.slice/crio-e1e3d21aebba2619805a8136f2fae21614ea53a739e25968c633757745339840 WatchSource:0}: Error finding container e1e3d21aebba2619805a8136f2fae21614ea53a739e25968c633757745339840: Status 404 returned error can't find the container with id e1e3d21aebba2619805a8136f2fae21614ea53a739e25968c633757745339840 May 29 00:52:47.933474 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:47.933432 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" event={"ID":"d12f8789-0d79-4ddb-87a6-7120e7a41c38","Type":"ContainerStarted","Data":"e1e3d21aebba2619805a8136f2fae21614ea53a739e25968c633757745339840"} May 29 00:52:50.945464 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:50.945427 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" event={"ID":"d12f8789-0d79-4ddb-87a6-7120e7a41c38","Type":"ContainerStarted","Data":"c802ad67f66976dea8309d022579b7708d159c36835e15862616bf1487f22978"} May 29 00:52:50.945942 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:50.945549 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:52:50.967289 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:50.967237 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" podStartSLOduration=1.191731861 podStartE2EDuration="3.967220341s" podCreationTimestamp="2026-05-29 00:52:47 +0000 UTC" firstStartedPulling="2026-05-29 00:52:47.670947578 +0000 UTC m=+329.566159026" lastFinishedPulling="2026-05-29 00:52:50.446436047 +0000 UTC m=+332.341647506" observedRunningTime="2026-05-29 00:52:50.966105617 +0000 UTC m=+332.861317086" watchObservedRunningTime="2026-05-29 00:52:50.967220341 +0000 UTC m=+332.862431811" May 29 00:52:54.977081 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:54.977036 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v"] May 29 00:52:54.981403 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:54.981377 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:54.986175 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:54.986150 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 29 00:52:54.986372 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:54.986150 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nlh75\"" May 29 00:52:54.986471 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:54.986209 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 29 00:52:54.986532 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:54.986261 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 29 00:52:54.996971 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:54.996945 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v"] May 29 00:52:55.075428 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.075392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-manager-config\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.075608 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.075458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-cert\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.075608 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.075481 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-metrics-cert\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.075608 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.075509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsxp2\" (UniqueName: \"kubernetes.io/projected/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-kube-api-access-bsxp2\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.176544 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.176507 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-cert\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.176544 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.176542 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-metrics-cert\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.176827 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.176570 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsxp2\" (UniqueName: \"kubernetes.io/projected/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-kube-api-access-bsxp2\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.176827 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.176622 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-manager-config\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.177298 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.177278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-manager-config\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.179142 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.179124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-cert\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.179242 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.179158 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-metrics-cert\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.192696 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.192664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsxp2\" (UniqueName: \"kubernetes.io/projected/0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2-kube-api-access-bsxp2\") pod \"lws-controller-manager-55ddb96654-fpc9v\" (UID: \"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.294621 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.294530 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:55.427121 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.427094 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v"] May 29 00:52:55.428981 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:52:55.428951 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8a3477_4bce_4db6_a1ac_9b5f9efef6c2.slice/crio-4284067fbb05cce02e6982e65cbf1e41e99f4d35e51649da73fc49473ed0fe21 WatchSource:0}: Error finding container 4284067fbb05cce02e6982e65cbf1e41e99f4d35e51649da73fc49473ed0fe21: Status 404 returned error can't find the container with id 4284067fbb05cce02e6982e65cbf1e41e99f4d35e51649da73fc49473ed0fe21 May 29 00:52:55.963334 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:55.963295 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" event={"ID":"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2","Type":"ContainerStarted","Data":"4284067fbb05cce02e6982e65cbf1e41e99f4d35e51649da73fc49473ed0fe21"} May 29 00:52:57.971145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:57.971107 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" event={"ID":"0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2","Type":"ContainerStarted","Data":"679e8e5a215d07de21a38caab6a69ee4a18458a41e7bd4e5e11830f93dd1bbce"} May 29 00:52:57.971533 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:57.971332 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:52:57.987256 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:52:57.987195 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" podStartSLOduration=2.219014237 podStartE2EDuration="3.987178254s" podCreationTimestamp="2026-05-29 00:52:54 +0000 UTC" firstStartedPulling="2026-05-29 00:52:55.430862641 +0000 UTC m=+337.326074087" lastFinishedPulling="2026-05-29 00:52:57.199026651 +0000 UTC m=+339.094238104" observedRunningTime="2026-05-29 00:52:57.986159881 +0000 UTC m=+339.881371344" watchObservedRunningTime="2026-05-29 00:52:57.987178254 +0000 UTC m=+339.882389722" May 29 00:53:01.950910 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:01.950884 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-9rth6" May 29 00:53:05.393951 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.393899 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm"] May 29 00:53:05.400533 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.400511 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.403162 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.403129 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 29 00:53:05.404863 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.404416 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 29 00:53:05.404863 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.404672 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5pkd6\"" May 29 00:53:05.405255 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.405239 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 29 00:53:05.405410 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.405365 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 29 00:53:05.406494 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.406476 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm"] May 29 00:53:05.466469 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.466436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16af304-b4d1-437e-89eb-6d2cb978f0ef-tmp\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.466655 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.466487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16af304-b4d1-437e-89eb-6d2cb978f0ef-tls-certs\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.466655 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.466577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h748\" (UniqueName: \"kubernetes.io/projected/d16af304-b4d1-437e-89eb-6d2cb978f0ef-kube-api-access-5h748\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.567786 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.567706 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16af304-b4d1-437e-89eb-6d2cb978f0ef-tmp\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.567994 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.567806 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16af304-b4d1-437e-89eb-6d2cb978f0ef-tls-certs\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.567994 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.567842 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h748\" (UniqueName: \"kubernetes.io/projected/d16af304-b4d1-437e-89eb-6d2cb978f0ef-kube-api-access-5h748\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.570127 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.570103 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16af304-b4d1-437e-89eb-6d2cb978f0ef-tmp\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.570403 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.570383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16af304-b4d1-437e-89eb-6d2cb978f0ef-tls-certs\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.576375 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.576348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h748\" (UniqueName: \"kubernetes.io/projected/d16af304-b4d1-437e-89eb-6d2cb978f0ef-kube-api-access-5h748\") pod \"kube-auth-proxy-7959ccfcc5-xbgjm\" (UID: \"d16af304-b4d1-437e-89eb-6d2cb978f0ef\") " pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.711811 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.711660 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" May 29 00:53:05.841394 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:05.841368 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm"] May 29 00:53:05.843527 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:53:05.843493 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16af304_b4d1_437e_89eb_6d2cb978f0ef.slice/crio-81c0b97d46af2e98a5e141842ae9a1d8e55349ee074339ee570f5170d51dd35f WatchSource:0}: Error finding container 81c0b97d46af2e98a5e141842ae9a1d8e55349ee074339ee570f5170d51dd35f: Status 404 returned error can't find the container with id 81c0b97d46af2e98a5e141842ae9a1d8e55349ee074339ee570f5170d51dd35f May 29 00:53:06.005818 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:06.005700 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" event={"ID":"d16af304-b4d1-437e-89eb-6d2cb978f0ef","Type":"ContainerStarted","Data":"81c0b97d46af2e98a5e141842ae9a1d8e55349ee074339ee570f5170d51dd35f"} May 29 00:53:08.977425 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:08.977381 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-fpc9v" May 29 00:53:10.023177 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:10.023134 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" event={"ID":"d16af304-b4d1-437e-89eb-6d2cb978f0ef","Type":"ContainerStarted","Data":"64f973e7995b49a9532dafad3be688e2ab39ef241411ac5782a7616af8aa649e"} May 29 00:53:10.041909 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:53:10.041847 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7959ccfcc5-xbgjm" podStartSLOduration=1.6148892689999998 podStartE2EDuration="5.041828544s" podCreationTimestamp="2026-05-29 00:53:05 +0000 UTC" firstStartedPulling="2026-05-29 00:53:05.845683318 +0000 UTC m=+347.740894764" lastFinishedPulling="2026-05-29 00:53:09.272622578 +0000 UTC m=+351.167834039" observedRunningTime="2026-05-29 00:53:10.039046504 +0000 UTC m=+351.934257970" watchObservedRunningTime="2026-05-29 00:53:10.041828544 +0000 UTC m=+351.937040014" May 29 00:55:47.455064 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.455023 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:55:47.458811 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.458791 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:47.461484 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.461456 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 29 00:55:47.461484 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.461467 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zhbdl\"" May 29 00:55:47.462774 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.462756 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 29 00:55:47.462876 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.462759 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 29 00:55:47.467602 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.467576 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:55:47.479856 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.479828 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:55:47.650532 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.650488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kflcf\" (UniqueName: \"kubernetes.io/projected/d97f6d4a-2b3f-4019-a2bd-1dae35290fac-kube-api-access-kflcf\") pod \"limitador-limitador-78c99df468-q6xdf\" (UID: \"d97f6d4a-2b3f-4019-a2bd-1dae35290fac\") " pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:47.650709 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.650560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d97f6d4a-2b3f-4019-a2bd-1dae35290fac-config-file\") pod \"limitador-limitador-78c99df468-q6xdf\" (UID: \"d97f6d4a-2b3f-4019-a2bd-1dae35290fac\") " pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:47.752031 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.751953 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kflcf\" (UniqueName: \"kubernetes.io/projected/d97f6d4a-2b3f-4019-a2bd-1dae35290fac-kube-api-access-kflcf\") pod \"limitador-limitador-78c99df468-q6xdf\" (UID: \"d97f6d4a-2b3f-4019-a2bd-1dae35290fac\") " pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:47.752031 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.752007 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d97f6d4a-2b3f-4019-a2bd-1dae35290fac-config-file\") pod \"limitador-limitador-78c99df468-q6xdf\" (UID: \"d97f6d4a-2b3f-4019-a2bd-1dae35290fac\") " pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:47.752616 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.752588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d97f6d4a-2b3f-4019-a2bd-1dae35290fac-config-file\") pod \"limitador-limitador-78c99df468-q6xdf\" (UID: \"d97f6d4a-2b3f-4019-a2bd-1dae35290fac\") " pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:47.759934 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.759910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kflcf\" (UniqueName: \"kubernetes.io/projected/d97f6d4a-2b3f-4019-a2bd-1dae35290fac-kube-api-access-kflcf\") pod \"limitador-limitador-78c99df468-q6xdf\" (UID: \"d97f6d4a-2b3f-4019-a2bd-1dae35290fac\") " pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:47.769761 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.769713 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:47.907300 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:47.907274 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:55:47.909586 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:55:47.909554 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97f6d4a_2b3f_4019_a2bd_1dae35290fac.slice/crio-57250f48355537bde15d937ac7589de6fd4a5cc663cb9e260a1c793a12495436 WatchSource:0}: Error finding container 57250f48355537bde15d937ac7589de6fd4a5cc663cb9e260a1c793a12495436: Status 404 returned error can't find the container with id 57250f48355537bde15d937ac7589de6fd4a5cc663cb9e260a1c793a12495436 May 29 00:55:48.572120 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:48.572076 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" event={"ID":"d97f6d4a-2b3f-4019-a2bd-1dae35290fac","Type":"ContainerStarted","Data":"57250f48355537bde15d937ac7589de6fd4a5cc663cb9e260a1c793a12495436"} May 29 00:55:50.581441 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:50.581400 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" event={"ID":"d97f6d4a-2b3f-4019-a2bd-1dae35290fac","Type":"ContainerStarted","Data":"c923966ecbe49a95ed42f698cee9f29561f2581bf42f309f7982a8806a6bed9e"} May 29 00:55:50.581915 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:50.581523 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:55:50.597847 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:55:50.597796 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" podStartSLOduration=1.108389557 podStartE2EDuration="3.597782779s" podCreationTimestamp="2026-05-29 00:55:47 +0000 UTC" firstStartedPulling="2026-05-29 00:55:47.911385013 +0000 UTC m=+509.806596460" lastFinishedPulling="2026-05-29 00:55:50.400778236 +0000 UTC m=+512.295989682" observedRunningTime="2026-05-29 00:55:50.595811501 +0000 UTC m=+512.491022970" watchObservedRunningTime="2026-05-29 00:55:50.597782779 +0000 UTC m=+512.492994248" May 29 00:56:01.586824 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:01.586792 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-q6xdf" May 29 00:56:39.009005 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.008920 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:56:39.012611 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.012591 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 00:56:39.015347 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.015323 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 29 00:56:39.015471 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.015375 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-5b6vm\"" May 29 00:56:39.015471 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.015375 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 29 00:56:39.016772 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.016749 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 29 00:56:39.022381 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.022358 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:56:39.128462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.128418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq565\" (UniqueName: \"kubernetes.io/projected/66e28016-992a-4115-aa77-26acc46b289a-kube-api-access-jq565\") pod \"maas-keycloak-0\" (UID: \"66e28016-992a-4115-aa77-26acc46b289a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:56:39.229598 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.229549 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq565\" (UniqueName: \"kubernetes.io/projected/66e28016-992a-4115-aa77-26acc46b289a-kube-api-access-jq565\") pod \"maas-keycloak-0\" (UID: \"66e28016-992a-4115-aa77-26acc46b289a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:56:39.238233 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.238200 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq565\" (UniqueName: \"kubernetes.io/projected/66e28016-992a-4115-aa77-26acc46b289a-kube-api-access-jq565\") pod \"maas-keycloak-0\" (UID: \"66e28016-992a-4115-aa77-26acc46b289a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:56:39.323378 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.323287 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 00:56:39.452862 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.452835 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:56:39.454351 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:56:39.454325 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e28016_992a_4115_aa77_26acc46b289a.slice/crio-6d4c8c670f1c49ffd10ba30a4026e5540e8ce27fb75bc1fdbc53cee3e5ab0a14 WatchSource:0}: Error finding container 6d4c8c670f1c49ffd10ba30a4026e5540e8ce27fb75bc1fdbc53cee3e5ab0a14: Status 404 returned error can't find the container with id 6d4c8c670f1c49ffd10ba30a4026e5540e8ce27fb75bc1fdbc53cee3e5ab0a14 May 29 00:56:39.753804 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:39.753770 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66e28016-992a-4115-aa77-26acc46b289a","Type":"ContainerStarted","Data":"6d4c8c670f1c49ffd10ba30a4026e5540e8ce27fb75bc1fdbc53cee3e5ab0a14"} May 29 00:56:44.777462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:44.777412 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66e28016-992a-4115-aa77-26acc46b289a","Type":"ContainerStarted","Data":"f9725e2fc9d3f101551eeabd7ebf481f199dd1e4f6114e5ab3ffc8e1d131ebd1"} May 29 00:56:44.795628 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:44.795553 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.225813794 podStartE2EDuration="6.795534732s" podCreationTimestamp="2026-05-29 00:56:38 +0000 UTC" firstStartedPulling="2026-05-29 00:56:39.455637586 +0000 UTC m=+561.350849032" lastFinishedPulling="2026-05-29 00:56:44.025358525 +0000 UTC m=+565.920569970" observedRunningTime="2026-05-29 00:56:44.79252222 +0000 UTC m=+566.687733686" watchObservedRunningTime="2026-05-29 00:56:44.795534732 +0000 UTC m=+566.690746200" May 29 00:56:45.324502 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:45.324447 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 29 00:56:45.326141 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:45.326092 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:46.323818 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:46.323762 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:47.324601 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:47.324542 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:48.324105 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:48.324058 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:49.323964 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:49.323917 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 29 00:56:49.324577 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:49.324267 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:50.324527 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:50.324463 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:51.324909 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:51.324862 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:52.324688 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:52.324633 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:53.324095 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:53.324033 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:54.324318 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:54.324257 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:55.324255 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:55.324199 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:56.324193 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:56.324094 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" May 29 00:56:57.438956 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:57.438911 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 29 00:56:57.457056 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:56:57.457005 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:57:07.444812 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:07.444776 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 29 00:57:18.670016 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:18.669978 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:57:18.671015 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:18.670997 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 00:57:47.881433 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:47.881392 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7lb9l"] May 29 00:57:47.884684 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:47.884668 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" May 29 00:57:47.887459 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:47.887432 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 29 00:57:47.887459 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:47.887432 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9z8dz\"" May 29 00:57:47.892239 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:47.891982 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7lb9l"] May 29 00:57:47.968611 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:47.968576 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:57:47.980422 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:47.980390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqfj2\" (UniqueName: \"kubernetes.io/projected/6cdafe57-1e05-49a5-b16e-5b58e2b68bb6-kube-api-access-zqfj2\") pod \"payload-processing-58b6c8fdc7-7lb9l\" (UID: \"6cdafe57-1e05-49a5-b16e-5b58e2b68bb6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" May 29 00:57:48.081454 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:48.081413 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfj2\" (UniqueName: \"kubernetes.io/projected/6cdafe57-1e05-49a5-b16e-5b58e2b68bb6-kube-api-access-zqfj2\") pod \"payload-processing-58b6c8fdc7-7lb9l\" (UID: \"6cdafe57-1e05-49a5-b16e-5b58e2b68bb6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" May 29 00:57:48.090571 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:48.090528 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqfj2\" (UniqueName: \"kubernetes.io/projected/6cdafe57-1e05-49a5-b16e-5b58e2b68bb6-kube-api-access-zqfj2\") pod \"payload-processing-58b6c8fdc7-7lb9l\" (UID: \"6cdafe57-1e05-49a5-b16e-5b58e2b68bb6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" May 29 00:57:48.195671 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:48.195580 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" May 29 00:57:48.326111 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:48.326086 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7lb9l"] May 29 00:57:48.328489 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:57:48.328465 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cdafe57_1e05_49a5_b16e_5b58e2b68bb6.slice/crio-ef8b4acc3b321c877f7894dadaa608eef5fcf0f6298f23856b8b0824af69621d WatchSource:0}: Error finding container ef8b4acc3b321c877f7894dadaa608eef5fcf0f6298f23856b8b0824af69621d: Status 404 returned error can't find the container with id ef8b4acc3b321c877f7894dadaa608eef5fcf0f6298f23856b8b0824af69621d May 29 00:57:48.330527 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:48.330510 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 00:57:49.018208 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:49.018172 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" event={"ID":"6cdafe57-1e05-49a5-b16e-5b58e2b68bb6","Type":"ContainerStarted","Data":"ef8b4acc3b321c877f7894dadaa608eef5fcf0f6298f23856b8b0824af69621d"} May 29 00:57:52.030658 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:52.030619 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" event={"ID":"6cdafe57-1e05-49a5-b16e-5b58e2b68bb6","Type":"ContainerStarted","Data":"b33b4f6a55c915536c1204d80d176fe53c41117e8806e944c481197fe482c648"} May 29 00:57:52.031114 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:52.030719 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" May 29 00:57:52.046898 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:52.046848 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" podStartSLOduration=2.070641068 podStartE2EDuration="5.046833183s" podCreationTimestamp="2026-05-29 00:57:47 +0000 UTC" firstStartedPulling="2026-05-29 00:57:48.330632739 +0000 UTC m=+630.225844184" lastFinishedPulling="2026-05-29 00:57:51.306824853 +0000 UTC m=+633.202036299" observedRunningTime="2026-05-29 00:57:52.045543345 +0000 UTC m=+633.940754813" watchObservedRunningTime="2026-05-29 00:57:52.046833183 +0000 UTC m=+633.942044650" May 29 00:57:59.081335 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:59.081293 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:57:59.081844 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:57:59.081586 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" containerID="cri-o://f9725e2fc9d3f101551eeabd7ebf481f199dd1e4f6114e5ab3ffc8e1d131ebd1" gracePeriod=30 May 29 00:58:01.064448 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:01.064419 2563 generic.go:358] "Generic (PLEG): container finished" podID="66e28016-992a-4115-aa77-26acc46b289a" containerID="f9725e2fc9d3f101551eeabd7ebf481f199dd1e4f6114e5ab3ffc8e1d131ebd1" exitCode=143 May 29 00:58:01.064827 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:01.064482 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66e28016-992a-4115-aa77-26acc46b289a","Type":"ContainerDied","Data":"f9725e2fc9d3f101551eeabd7ebf481f199dd1e4f6114e5ab3ffc8e1d131ebd1"} May 29 00:58:01.123081 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:01.123057 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 00:58:01.196877 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:01.196835 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq565\" (UniqueName: \"kubernetes.io/projected/66e28016-992a-4115-aa77-26acc46b289a-kube-api-access-jq565\") pod \"66e28016-992a-4115-aa77-26acc46b289a\" (UID: \"66e28016-992a-4115-aa77-26acc46b289a\") " May 29 00:58:01.199084 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:01.199063 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e28016-992a-4115-aa77-26acc46b289a-kube-api-access-jq565" (OuterVolumeSpecName: "kube-api-access-jq565") pod "66e28016-992a-4115-aa77-26acc46b289a" (UID: "66e28016-992a-4115-aa77-26acc46b289a"). InnerVolumeSpecName "kube-api-access-jq565". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:58:01.298580 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:01.298496 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq565\" (UniqueName: \"kubernetes.io/projected/66e28016-992a-4115-aa77-26acc46b289a-kube-api-access-jq565\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 00:58:02.069258 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.069222 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66e28016-992a-4115-aa77-26acc46b289a","Type":"ContainerDied","Data":"6d4c8c670f1c49ffd10ba30a4026e5540e8ce27fb75bc1fdbc53cee3e5ab0a14"} May 29 00:58:02.069685 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.069270 2563 scope.go:117] "RemoveContainer" containerID="f9725e2fc9d3f101551eeabd7ebf481f199dd1e4f6114e5ab3ffc8e1d131ebd1" May 29 00:58:02.069685 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.069230 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.092476 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.092440 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:58:02.095975 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.095948 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:58:02.114966 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.114912 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:58:02.115366 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.115350 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" May 29 00:58:02.115462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.115367 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" May 29 00:58:02.115462 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.115446 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="66e28016-992a-4115-aa77-26acc46b289a" containerName="keycloak" May 29 00:58:02.119934 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.119913 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.123208 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.123157 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 29 00:58:02.123579 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.123536 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" May 29 00:58:02.123790 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.123547 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 29 00:58:02.123958 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.123616 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 29 00:58:02.124189 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.123694 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-5b6vm\"" May 29 00:58:02.126165 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.126117 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:58:02.205456 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.205420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b25c5697-6909-423a-8895-45fd4602d58a-test-realms\") pod \"maas-keycloak-0\" (UID: \"b25c5697-6909-423a-8895-45fd4602d58a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.205456 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.205458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxkt2\" (UniqueName: \"kubernetes.io/projected/b25c5697-6909-423a-8895-45fd4602d58a-kube-api-access-bxkt2\") pod \"maas-keycloak-0\" (UID: \"b25c5697-6909-423a-8895-45fd4602d58a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.306792 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.306748 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b25c5697-6909-423a-8895-45fd4602d58a-test-realms\") pod \"maas-keycloak-0\" (UID: \"b25c5697-6909-423a-8895-45fd4602d58a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.306792 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.306795 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxkt2\" (UniqueName: \"kubernetes.io/projected/b25c5697-6909-423a-8895-45fd4602d58a-kube-api-access-bxkt2\") pod \"maas-keycloak-0\" (UID: \"b25c5697-6909-423a-8895-45fd4602d58a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.307441 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.307421 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b25c5697-6909-423a-8895-45fd4602d58a-test-realms\") pod \"maas-keycloak-0\" (UID: \"b25c5697-6909-423a-8895-45fd4602d58a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.315522 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.315497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxkt2\" (UniqueName: \"kubernetes.io/projected/b25c5697-6909-423a-8895-45fd4602d58a-kube-api-access-bxkt2\") pod \"maas-keycloak-0\" (UID: \"b25c5697-6909-423a-8895-45fd4602d58a\") " pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.432569 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.432539 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 00:58:02.567034 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.567006 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 00:58:02.569487 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:58:02.569462 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25c5697_6909_423a_8895_45fd4602d58a.slice/crio-fc25b5cc8ea3bf88c58b505d0ee2aa81f23740630916d5a8c8ac62eff09006ae WatchSource:0}: Error finding container fc25b5cc8ea3bf88c58b505d0ee2aa81f23740630916d5a8c8ac62eff09006ae: Status 404 returned error can't find the container with id fc25b5cc8ea3bf88c58b505d0ee2aa81f23740630916d5a8c8ac62eff09006ae May 29 00:58:02.757849 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:02.757763 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e28016-992a-4115-aa77-26acc46b289a" path="/var/lib/kubelet/pods/66e28016-992a-4115-aa77-26acc46b289a/volumes" May 29 00:58:03.037124 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:03.037048 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7lb9l" May 29 00:58:03.076195 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:03.076158 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b25c5697-6909-423a-8895-45fd4602d58a","Type":"ContainerStarted","Data":"9fa09dbb14afa5267d9559598dfa9b56fe669f7f781caa16b64d11f4cbf94919"} May 29 00:58:03.076560 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:03.076204 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b25c5697-6909-423a-8895-45fd4602d58a","Type":"ContainerStarted","Data":"fc25b5cc8ea3bf88c58b505d0ee2aa81f23740630916d5a8c8ac62eff09006ae"} May 29 00:58:03.099598 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:03.099544 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.755364392 podStartE2EDuration="1.099530161s" podCreationTimestamp="2026-05-29 00:58:02 +0000 UTC" firstStartedPulling="2026-05-29 00:58:02.570921732 +0000 UTC m=+644.466133182" lastFinishedPulling="2026-05-29 00:58:02.9150875 +0000 UTC m=+644.810298951" observedRunningTime="2026-05-29 00:58:03.097654422 +0000 UTC m=+644.992865892" watchObservedRunningTime="2026-05-29 00:58:03.099530161 +0000 UTC m=+644.994741629" May 29 00:58:03.433176 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:03.433133 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 29 00:58:03.434522 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:03.434484 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:04.433638 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:04.433579 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:05.433441 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:05.433394 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:06.433114 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:06.433059 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:07.433145 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:07.433089 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:08.433261 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:08.433208 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:09.434090 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:09.434036 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:10.443169 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:10.443097 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:11.433922 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:11.433860 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:12.432696 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:12.432652 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 29 00:58:12.433337 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:12.433293 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:13.433593 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:13.433542 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:14.433039 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:14.432989 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:15.433349 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:15.433290 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" May 29 00:58:16.560225 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:16.560174 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 29 00:58:16.580768 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:16.580677 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b25c5697-6909-423a-8895-45fd4602d58a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:58:26.566410 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:26.566375 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 29 00:58:51.309329 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:51.309289 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:58:55.868557 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:55.868517 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd"] May 29 00:58:55.871911 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:55.871886 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:55.875999 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:55.875969 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5q8n9\"" May 29 00:58:55.876135 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:55.875969 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 29 00:58:55.876135 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:55.876018 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 29 00:58:55.876135 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:55.876035 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 29 00:58:55.879950 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:55.879926 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd"] May 29 00:58:56.008124 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.008085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.008295 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.008149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.008295 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.008175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.008295 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.008224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.008295 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.008273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.008430 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.008299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crgx2\" (UniqueName: \"kubernetes.io/projected/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-kube-api-access-crgx2\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.109457 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.109410 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.109457 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.109461 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.109702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.109482 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crgx2\" (UniqueName: \"kubernetes.io/projected/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-kube-api-access-crgx2\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.109702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.109533 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.109702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.109562 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.109702 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.109577 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.110016 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.109980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.110016 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.110016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.110183 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.110056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.111931 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.111913 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.112098 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.112083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.117353 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.117332 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crgx2\" (UniqueName: \"kubernetes.io/projected/ada3137c-36e8-4bd7-a1cd-092a2be4b24f-kube-api-access-crgx2\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd\" (UID: \"ada3137c-36e8-4bd7-a1cd-092a2be4b24f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.183519 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.183429 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:58:56.320389 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.320361 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd"] May 29 00:58:56.323218 ip-10-0-131-222 kubenswrapper[2563]: W0529 00:58:56.323174 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada3137c_36e8_4bd7_a1cd_092a2be4b24f.slice/crio-a5194d2221f0ed0a6c78f54552ed17e501bdac14d4a5493061721946873f67c7 WatchSource:0}: Error finding container a5194d2221f0ed0a6c78f54552ed17e501bdac14d4a5493061721946873f67c7: Status 404 returned error can't find the container with id a5194d2221f0ed0a6c78f54552ed17e501bdac14d4a5493061721946873f67c7 May 29 00:58:56.880656 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:56.880615 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:58:57.300650 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:58:57.300573 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" event={"ID":"ada3137c-36e8-4bd7-a1cd-092a2be4b24f","Type":"ContainerStarted","Data":"a5194d2221f0ed0a6c78f54552ed17e501bdac14d4a5493061721946873f67c7"} May 29 00:59:00.989434 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:00.989396 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:59:02.325093 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:02.325049 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" event={"ID":"ada3137c-36e8-4bd7-a1cd-092a2be4b24f","Type":"ContainerStarted","Data":"061b09f586dd18b20c311eac0c6f65d6ed1bced50877feefcb812b14182aca76"} May 29 00:59:07.343893 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:07.343859 2563 generic.go:358] "Generic (PLEG): container finished" podID="ada3137c-36e8-4bd7-a1cd-092a2be4b24f" containerID="061b09f586dd18b20c311eac0c6f65d6ed1bced50877feefcb812b14182aca76" exitCode=0 May 29 00:59:07.344269 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:07.343931 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" event={"ID":"ada3137c-36e8-4bd7-a1cd-092a2be4b24f","Type":"ContainerDied","Data":"061b09f586dd18b20c311eac0c6f65d6ed1bced50877feefcb812b14182aca76"} May 29 00:59:09.353111 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:09.353073 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" event={"ID":"ada3137c-36e8-4bd7-a1cd-092a2be4b24f","Type":"ContainerStarted","Data":"d0fd95f0f45f0d2a8fd1722db9a9767570303d9070a706a60167784491976f55"} May 29 00:59:09.353620 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:09.353303 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:59:09.371597 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:09.371549 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" podStartSLOduration=2.331032528 podStartE2EDuration="14.371533341s" podCreationTimestamp="2026-05-29 00:58:55 +0000 UTC" firstStartedPulling="2026-05-29 00:58:56.325133126 +0000 UTC m=+698.220344573" lastFinishedPulling="2026-05-29 00:59:08.365633941 +0000 UTC m=+710.260845386" observedRunningTime="2026-05-29 00:59:09.370556518 +0000 UTC m=+711.265767985" watchObservedRunningTime="2026-05-29 00:59:09.371533341 +0000 UTC m=+711.266744809" May 29 00:59:10.081843 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:10.081808 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 00:59:20.369767 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:20.369707 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd" May 29 00:59:31.979296 ip-10-0-131-222 kubenswrapper[2563]: I0529 00:59:31.979260 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:00:00.139717 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.139676 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666940-zbcjn"] May 29 01:00:00.143273 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.143255 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" May 29 01:00:00.146806 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.146780 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pk82p\"" May 29 01:00:00.149277 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.149254 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666940-zbcjn"] May 29 01:00:00.294960 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.294921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfm8m\" (UniqueName: \"kubernetes.io/projected/cc06c917-e839-4aed-9083-13e4d22ea6da-kube-api-access-gfm8m\") pod \"maas-api-key-cleanup-29666940-zbcjn\" (UID: \"cc06c917-e839-4aed-9083-13e4d22ea6da\") " pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" May 29 01:00:00.396488 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.396382 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfm8m\" (UniqueName: \"kubernetes.io/projected/cc06c917-e839-4aed-9083-13e4d22ea6da-kube-api-access-gfm8m\") pod \"maas-api-key-cleanup-29666940-zbcjn\" (UID: \"cc06c917-e839-4aed-9083-13e4d22ea6da\") " pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" May 29 01:00:00.405278 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.405246 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfm8m\" (UniqueName: \"kubernetes.io/projected/cc06c917-e839-4aed-9083-13e4d22ea6da-kube-api-access-gfm8m\") pod \"maas-api-key-cleanup-29666940-zbcjn\" (UID: \"cc06c917-e839-4aed-9083-13e4d22ea6da\") " pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" May 29 01:00:00.455289 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.455259 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" May 29 01:00:00.587254 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:00.587226 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666940-zbcjn"] May 29 01:00:00.589065 ip-10-0-131-222 kubenswrapper[2563]: W0529 01:00:00.589032 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc06c917_e839_4aed_9083_13e4d22ea6da.slice/crio-249d739117f2edaeb670cb3f4c7b22c532be8736d33ecf6a825b73a14d642a2b WatchSource:0}: Error finding container 249d739117f2edaeb670cb3f4c7b22c532be8736d33ecf6a825b73a14d642a2b: Status 404 returned error can't find the container with id 249d739117f2edaeb670cb3f4c7b22c532be8736d33ecf6a825b73a14d642a2b May 29 01:00:01.533183 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:01.533144 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" event={"ID":"cc06c917-e839-4aed-9083-13e4d22ea6da","Type":"ContainerStarted","Data":"249d739117f2edaeb670cb3f4c7b22c532be8736d33ecf6a825b73a14d642a2b"} May 29 01:00:05.550128 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:05.550093 2563 generic.go:358] "Generic (PLEG): container finished" podID="cc06c917-e839-4aed-9083-13e4d22ea6da" containerID="d131a5bc4d6ce3c5806287723ac432140929b369d1ef4f595557bf6f64530701" exitCode=0 May 29 01:00:05.550572 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:05.550182 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" event={"ID":"cc06c917-e839-4aed-9083-13e4d22ea6da","Type":"ContainerDied","Data":"d131a5bc4d6ce3c5806287723ac432140929b369d1ef4f595557bf6f64530701"} May 29 01:00:06.693832 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:06.693803 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" May 29 01:00:06.861319 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:06.861286 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfm8m\" (UniqueName: \"kubernetes.io/projected/cc06c917-e839-4aed-9083-13e4d22ea6da-kube-api-access-gfm8m\") pod \"cc06c917-e839-4aed-9083-13e4d22ea6da\" (UID: \"cc06c917-e839-4aed-9083-13e4d22ea6da\") " May 29 01:00:06.863615 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:06.863587 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc06c917-e839-4aed-9083-13e4d22ea6da-kube-api-access-gfm8m" (OuterVolumeSpecName: "kube-api-access-gfm8m") pod "cc06c917-e839-4aed-9083-13e4d22ea6da" (UID: "cc06c917-e839-4aed-9083-13e4d22ea6da"). InnerVolumeSpecName "kube-api-access-gfm8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 01:00:06.962246 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:06.962193 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfm8m\" (UniqueName: \"kubernetes.io/projected/cc06c917-e839-4aed-9083-13e4d22ea6da-kube-api-access-gfm8m\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 01:00:07.558396 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:07.558368 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" May 29 01:00:07.558396 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:07.558386 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666940-zbcjn" event={"ID":"cc06c917-e839-4aed-9083-13e4d22ea6da","Type":"ContainerDied","Data":"249d739117f2edaeb670cb3f4c7b22c532be8736d33ecf6a825b73a14d642a2b"} May 29 01:00:07.558656 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:07.558418 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="249d739117f2edaeb670cb3f4c7b22c532be8736d33ecf6a825b73a14d642a2b" May 29 01:00:30.481023 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:30.480987 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:00:41.387450 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:41.387411 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:00:50.481047 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:00:50.481012 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:01:01.580399 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:01:01.580358 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:01:08.990340 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:01:08.990291 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:01:20.084367 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:01:20.084330 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:02:18.697823 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:02:18.697356 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:02:18.701959 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:02:18.701936 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:02:32.290072 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:02:32.290032 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:02:48.290040 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:02:48.290004 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:03:27.700552 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:03:27.700511 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:03:43.298459 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:03:43.298422 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:03:59.132849 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:03:59.132809 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:04:15.203657 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:04:15.203614 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:05:11.705891 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:05:11.705803 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:05:20.584022 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:05:20.583985 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:05:36.792145 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:05:36.792108 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:05:44.887459 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:05:44.887419 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:06:02.487636 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:06:02.487597 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:06:11.096872 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:06:11.096832 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:06:43.909134 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:06:43.909091 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:06:51.801619 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:06:51.801576 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:07:00.217276 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:07:00.217233 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:07:08.802959 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:07:08.802921 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:07:17.385690 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:07:17.385645 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:07:18.726141 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:07:18.726114 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:07:18.729027 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:07:18.729007 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:07:34.383579 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:07:34.383543 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:07:47.395296 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:07:47.395248 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:08:35.490865 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:08:35.490779 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:08:39.585526 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:08:39.585492 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:08:45.886617 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:08:45.886570 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:08:54.598170 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:08:54.598134 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:09:04.389104 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:09:04.389065 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:09:13.084582 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:09:13.084545 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:09:21.081313 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:09:21.081267 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:09:30.283956 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:09:30.283918 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:09:38.285805 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:09:38.285695 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:09:46.886733 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:09:46.886687 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:09:56.888280 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:09:56.888240 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:10:05.190532 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:10:05.190490 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:10:14.390555 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:10:14.390509 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:10:22.587367 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:10:22.587319 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:10:31.387618 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:10:31.387579 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:10:40.289668 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:10:40.289624 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:10:49.388841 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:10:49.388804 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:10:57.741076 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:10:57.741035 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:12:18.752654 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:12:18.752623 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:12:18.758775 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:12:18.758752 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:13:14.396104 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:13:14.396066 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:13:19.180614 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:13:19.180571 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:13:45.388736 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:13:45.388695 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:13:51.990697 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:13:51.990659 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:14:01.683648 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:14:01.683611 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:14:11.699394 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:14:11.699357 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:14:20.384956 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:14:20.384922 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:14:31.082952 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:14:31.082913 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:14:39.907944 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:14:39.907903 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:14:50.985066 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:14:50.985031 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:15:00.141344 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.141306 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666955-q2shj"] May 29 01:15:00.141866 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.141712 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc06c917-e839-4aed-9083-13e4d22ea6da" containerName="cleanup" May 29 01:15:00.141866 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.141741 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc06c917-e839-4aed-9083-13e4d22ea6da" containerName="cleanup" May 29 01:15:00.141866 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.141832 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc06c917-e839-4aed-9083-13e4d22ea6da" containerName="cleanup" May 29 01:15:00.144857 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.144841 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" May 29 01:15:00.147650 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.147625 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pk82p\"" May 29 01:15:00.159626 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.159596 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666955-q2shj"] May 29 01:15:00.194506 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.194474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q7hh\" (UniqueName: \"kubernetes.io/projected/97938b4d-013d-45be-8dca-20906ec48f7a-kube-api-access-2q7hh\") pod \"maas-api-key-cleanup-29666955-q2shj\" (UID: \"97938b4d-013d-45be-8dca-20906ec48f7a\") " pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" May 29 01:15:00.198737 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.198700 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:15:00.295122 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.295086 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q7hh\" (UniqueName: \"kubernetes.io/projected/97938b4d-013d-45be-8dca-20906ec48f7a-kube-api-access-2q7hh\") pod \"maas-api-key-cleanup-29666955-q2shj\" (UID: \"97938b4d-013d-45be-8dca-20906ec48f7a\") " pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" May 29 01:15:00.307061 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.307026 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q7hh\" (UniqueName: \"kubernetes.io/projected/97938b4d-013d-45be-8dca-20906ec48f7a-kube-api-access-2q7hh\") pod \"maas-api-key-cleanup-29666955-q2shj\" (UID: \"97938b4d-013d-45be-8dca-20906ec48f7a\") " pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" May 29 01:15:00.454826 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.454710 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" May 29 01:15:00.589992 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.589964 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666955-q2shj"] May 29 01:15:00.591990 ip-10-0-131-222 kubenswrapper[2563]: W0529 01:15:00.591950 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97938b4d_013d_45be_8dca_20906ec48f7a.slice/crio-d31c9bf0cf61a1785e38892566252a07a71ac81586db82fd48ff586575ad0e8d WatchSource:0}: Error finding container d31c9bf0cf61a1785e38892566252a07a71ac81586db82fd48ff586575ad0e8d: Status 404 returned error can't find the container with id d31c9bf0cf61a1785e38892566252a07a71ac81586db82fd48ff586575ad0e8d May 29 01:15:00.593801 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.593786 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 01:15:00.780974 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:00.780941 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" event={"ID":"97938b4d-013d-45be-8dca-20906ec48f7a","Type":"ContainerStarted","Data":"d31c9bf0cf61a1785e38892566252a07a71ac81586db82fd48ff586575ad0e8d"} May 29 01:15:01.791407 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:01.791317 2563 generic.go:358] "Generic (PLEG): container finished" podID="97938b4d-013d-45be-8dca-20906ec48f7a" containerID="f43c61577c1074f8749d4d09b4dbf5230e27cf84b011c3e841ac144a25392993" exitCode=0 May 29 01:15:01.791807 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:01.791407 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" event={"ID":"97938b4d-013d-45be-8dca-20906ec48f7a","Type":"ContainerDied","Data":"f43c61577c1074f8749d4d09b4dbf5230e27cf84b011c3e841ac144a25392993"} May 29 01:15:02.929671 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:02.929646 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" May 29 01:15:03.021052 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:03.021011 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q7hh\" (UniqueName: \"kubernetes.io/projected/97938b4d-013d-45be-8dca-20906ec48f7a-kube-api-access-2q7hh\") pod \"97938b4d-013d-45be-8dca-20906ec48f7a\" (UID: \"97938b4d-013d-45be-8dca-20906ec48f7a\") " May 29 01:15:03.023189 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:03.023159 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97938b4d-013d-45be-8dca-20906ec48f7a-kube-api-access-2q7hh" (OuterVolumeSpecName: "kube-api-access-2q7hh") pod "97938b4d-013d-45be-8dca-20906ec48f7a" (UID: "97938b4d-013d-45be-8dca-20906ec48f7a"). InnerVolumeSpecName "kube-api-access-2q7hh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 01:15:03.122692 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:03.122647 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q7hh\" (UniqueName: \"kubernetes.io/projected/97938b4d-013d-45be-8dca-20906ec48f7a-kube-api-access-2q7hh\") on node \"ip-10-0-131-222.ec2.internal\" DevicePath \"\"" May 29 01:15:03.799337 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:03.799301 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" event={"ID":"97938b4d-013d-45be-8dca-20906ec48f7a","Type":"ContainerDied","Data":"d31c9bf0cf61a1785e38892566252a07a71ac81586db82fd48ff586575ad0e8d"} May 29 01:15:03.799337 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:03.799339 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d31c9bf0cf61a1785e38892566252a07a71ac81586db82fd48ff586575ad0e8d" May 29 01:15:03.799553 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:03.799319 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666955-q2shj" May 29 01:15:09.491144 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:09.491105 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:15:19.589020 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:19.588984 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:15:53.993708 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:15:53.993670 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:16:36.691263 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:16:36.691226 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:16:44.886781 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:16:44.886741 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:16:53.895494 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:16:53.895457 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:17:02.464850 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:02.464812 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:17:11.300321 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:11.300236 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:17:18.780549 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:18.780523 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:17:18.786772 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:18.786750 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:17:23.879556 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:23.879525 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:17:31.792914 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:31.792876 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:17:36.887252 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:36.887215 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:17:42.789193 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:42.789153 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:17:49.311505 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:49.311464 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:17:57.589850 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:17:57.589806 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:18:06.193589 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:18:06.193550 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:18:16.482454 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:18:16.482383 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:18:35.388533 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:18:35.388494 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:18:43.385309 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:18:43.385263 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:18:51.092380 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:18:51.092345 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:18:58.994784 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:18:58.994742 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:19:17.102401 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:19:17.102361 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:19:25.483467 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:19:25.483429 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:19:35.293347 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:19:35.293303 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:19:43.090599 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:19:43.090561 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:19:51.195238 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:19:51.195199 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:19:59.686961 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:19:59.686923 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:20:08.689598 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:20:08.689515 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:20:19.900924 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:20:19.900888 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:20:28.688186 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:20:28.688146 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:20:40.181265 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:20:40.181218 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:20:48.887967 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:20:48.887924 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:20:55.790174 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:20:55.790135 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:21:06.788946 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:21:06.788904 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:21:12.483087 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:21:12.483046 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:21:29.782477 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:21:29.782440 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:21:39.504297 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:21:39.504213 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:21:47.791070 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:21:47.791036 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:21:55.693920 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:21:55.693881 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:22:18.808081 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:18.808050 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:22:18.814527 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:18.814508 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:22:19.981544 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:19.981504 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:22:32.691036 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:32.690994 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q6xdf"] May 29 01:22:42.846477 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:42.846441 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666940-zbcjn_cc06c917-e839-4aed-9083-13e4d22ea6da/cleanup/0.log" May 29 01:22:42.954554 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:42.954522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666955-q2shj_97938b4d-013d-45be-8dca-20906ec48f7a/cleanup/0.log" May 29 01:22:43.306597 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:43.306487 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d9b8687fd-9rth6_d12f8789-0d79-4ddb-87a6-7120e7a41c38/manager/0.log" May 29 01:22:45.598147 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:45.598110 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-q6xdf_d97f6d4a-2b3f-4019-a2bd-1dae35290fac/limitador/0.log" May 29 01:22:46.410608 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:46.410573 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7959ccfcc5-xbgjm_d16af304-b4d1-437e-89eb-6d2cb978f0ef/kube-auth-proxy/0.log" May 29 01:22:46.641265 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:46.641229 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7lb9l_6cdafe57-1e05-49a5-b16e-5b58e2b68bb6/payload-processing/0.log" May 29 01:22:47.564451 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:47.564424 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd_ada3137c-36e8-4bd7-a1cd-092a2be4b24f/storage-initializer/0.log" May 29 01:22:47.571527 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:47.571493 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-htdtd_ada3137c-36e8-4bd7-a1cd-092a2be4b24f/main/0.log" May 29 01:22:54.888760 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:54.888712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bkwvp_b815e754-e8e4-458a-94e9-140867f50cd9/global-pull-secret-syncer/0.log" May 29 01:22:54.999813 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:54.999784 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-chg5d_79137623-f01b-4338-91c4-807834d1d3fa/konnectivity-agent/0.log" May 29 01:22:55.046995 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:55.046964 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-222.ec2.internal_8ba471d749c4d61c36aa74f973a36c94/haproxy/0.log" May 29 01:22:59.607880 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:22:59.607852 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-q6xdf_d97f6d4a-2b3f-4019-a2bd-1dae35290fac/limitador/0.log" May 29 01:23:00.977298 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:00.977230 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c09964d-609e-4b18-93da-513e0fa5ace2/alertmanager/0.log" May 29 01:23:00.996433 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:00.996408 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c09964d-609e-4b18-93da-513e0fa5ace2/config-reloader/0.log" May 29 01:23:01.012226 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.012205 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c09964d-609e-4b18-93da-513e0fa5ace2/kube-rbac-proxy-web/0.log" May 29 01:23:01.029684 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.029655 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c09964d-609e-4b18-93da-513e0fa5ace2/kube-rbac-proxy/0.log" May 29 01:23:01.044757 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.044715 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c09964d-609e-4b18-93da-513e0fa5ace2/kube-rbac-proxy-metric/0.log" May 29 01:23:01.060661 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.060641 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c09964d-609e-4b18-93da-513e0fa5ace2/prom-label-proxy/0.log" May 29 01:23:01.081164 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.081142 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c09964d-609e-4b18-93da-513e0fa5ace2/init-config-reloader/0.log" May 29 01:23:01.111280 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.111255 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-zf7w4_5bedacc3-4921-41db-a6e4-1bc9d62f877e/cluster-monitoring-operator/0.log" May 29 01:23:01.133908 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.133885 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qfpcw_2c7c9acb-4791-477b-9eb7-a66693545de6/kube-state-metrics/0.log" May 29 01:23:01.149084 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.149062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qfpcw_2c7c9acb-4791-477b-9eb7-a66693545de6/kube-rbac-proxy-main/0.log" May 29 01:23:01.165795 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.165772 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qfpcw_2c7c9acb-4791-477b-9eb7-a66693545de6/kube-rbac-proxy-self/0.log" May 29 01:23:01.208645 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.208614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-txmgm_c8acae0d-1f6c-41df-af34-0a4e75cba1f5/monitoring-plugin/0.log" May 29 01:23:01.242152 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.242078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-24bzb_98cd5fde-554b-4e4b-aec6-c2f178ddec4e/node-exporter/0.log" May 29 01:23:01.264022 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.263992 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-24bzb_98cd5fde-554b-4e4b-aec6-c2f178ddec4e/kube-rbac-proxy/0.log" May 29 01:23:01.286746 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.286701 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-24bzb_98cd5fde-554b-4e4b-aec6-c2f178ddec4e/init-textfile/0.log" May 29 01:23:01.443347 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.443315 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bt4zf_6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111/kube-rbac-proxy-main/0.log" May 29 01:23:01.459889 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.459862 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bt4zf_6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111/kube-rbac-proxy-self/0.log" May 29 01:23:01.479789 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.479765 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bt4zf_6b2f365c-69f7-4eb1-a3c6-9ec84d8a5111/openshift-state-metrics/0.log" May 29 01:23:01.504637 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.504567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8/prometheus/0.log" May 29 01:23:01.521761 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.521714 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8/config-reloader/0.log" May 29 01:23:01.539839 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.539808 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8/thanos-sidecar/0.log" May 29 01:23:01.556275 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.556252 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8/kube-rbac-proxy-web/0.log" May 29 01:23:01.573063 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.573040 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8/kube-rbac-proxy/0.log" May 29 01:23:01.590058 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.590040 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8/kube-rbac-proxy-thanos/0.log" May 29 01:23:01.606709 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.606684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d880eaf1-516f-408c-ab5a-6f1e1cdbf6b8/init-config-reloader/0.log" May 29 01:23:01.661067 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:01.661040 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-gm9bl_e49e0ff4-a8bb-4cf0-bb4f-2c045e9ac64d/prometheus-operator-admission-webhook/0.log" May 29 01:23:02.938932 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:02.938901 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-6h5qd_bed9de2f-ebdf-4978-a45b-a7e82710a219/networking-console-plugin/0.log" May 29 01:23:03.440413 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.440375 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7"] May 29 01:23:03.440952 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.440927 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97938b4d-013d-45be-8dca-20906ec48f7a" containerName="cleanup" May 29 01:23:03.440952 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.440953 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="97938b4d-013d-45be-8dca-20906ec48f7a" containerName="cleanup" May 29 01:23:03.441132 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.441065 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="97938b4d-013d-45be-8dca-20906ec48f7a" containerName="cleanup" May 29 01:23:03.443264 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.443242 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.446181 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.446160 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-979vp\"/\"kube-root-ca.crt\"" May 29 01:23:03.447494 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.447471 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-979vp\"/\"openshift-service-ca.crt\"" May 29 01:23:03.447612 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.447539 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-979vp\"/\"default-dockercfg-pvr4b\"" May 29 01:23:03.452956 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.452932 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7"] May 29 01:23:03.596967 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.596926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-sys\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.596967 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.596973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-lib-modules\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.597190 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.597033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwxhs\" (UniqueName: \"kubernetes.io/projected/53e9caa0-ec23-441b-b953-98df466cfcc9-kube-api-access-dwxhs\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.597190 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.597070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-podres\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.597190 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.597093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-proc\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.697874 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.697753 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-sys\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.697874 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.697818 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-lib-modules\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.697874 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.697858 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwxhs\" (UniqueName: \"kubernetes.io/projected/53e9caa0-ec23-441b-b953-98df466cfcc9-kube-api-access-dwxhs\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.698124 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.697897 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-podres\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.698124 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.697902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-sys\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.698124 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.697928 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-proc\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.698124 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.698031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-lib-modules\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.698124 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.698041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-proc\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.698124 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.698034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53e9caa0-ec23-441b-b953-98df466cfcc9-podres\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.707787 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.707756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwxhs\" (UniqueName: \"kubernetes.io/projected/53e9caa0-ec23-441b-b953-98df466cfcc9-kube-api-access-dwxhs\") pod \"perf-node-gather-daemonset-d55d7\" (UID: \"53e9caa0-ec23-441b-b953-98df466cfcc9\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.754236 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.754207 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:03.888205 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.888167 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7"] May 29 01:23:03.890691 ip-10-0-131-222 kubenswrapper[2563]: W0529 01:23:03.890659 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod53e9caa0_ec23_441b_b953_98df466cfcc9.slice/crio-ff7f0ffd792295caea85157f248416fa775adb399effe6824379b606e5962c20 WatchSource:0}: Error finding container ff7f0ffd792295caea85157f248416fa775adb399effe6824379b606e5962c20: Status 404 returned error can't find the container with id ff7f0ffd792295caea85157f248416fa775adb399effe6824379b606e5962c20 May 29 01:23:03.892395 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:03.892378 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 01:23:04.510883 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:04.510849 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" event={"ID":"53e9caa0-ec23-441b-b953-98df466cfcc9","Type":"ContainerStarted","Data":"f41fe97e1b1116a5c8f0d1ed23f8f2274015009a0ea965143d8703ae96668ef9"} May 29 01:23:04.510883 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:04.510886 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" event={"ID":"53e9caa0-ec23-441b-b953-98df466cfcc9","Type":"ContainerStarted","Data":"ff7f0ffd792295caea85157f248416fa775adb399effe6824379b606e5962c20"} May 29 01:23:04.511300 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:04.510988 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:04.529769 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:04.529686 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" podStartSLOduration=1.529669025 podStartE2EDuration="1.529669025s" podCreationTimestamp="2026-05-29 01:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 01:23:04.529404842 +0000 UTC m=+2146.424616311" watchObservedRunningTime="2026-05-29 01:23:04.529669025 +0000 UTC m=+2146.424880493" May 29 01:23:05.256666 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:05.256637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frppt_94f75f66-3473-4bd4-947b-bda5c8a3f20a/dns/0.log" May 29 01:23:05.273110 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:05.273084 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frppt_94f75f66-3473-4bd4-947b-bda5c8a3f20a/kube-rbac-proxy/0.log" May 29 01:23:05.356212 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:05.356180 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n9v8g_cf0454e9-24a1-4a3f-8ccd-335b81975306/dns-node-resolver/0.log" May 29 01:23:05.911411 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:05.911331 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mdrgh_9ceed120-d7b0-4e23-a600-545bd7c79900/node-ca/0.log" May 29 01:23:06.851616 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:06.851583 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7959ccfcc5-xbgjm_d16af304-b4d1-437e-89eb-6d2cb978f0ef/kube-auth-proxy/0.log" May 29 01:23:06.990638 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:06.990594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7lb9l_6cdafe57-1e05-49a5-b16e-5b58e2b68bb6/payload-processing/0.log" May 29 01:23:07.557015 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:07.556979 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nxvd8_9d070427-f9ce-42e0-a897-35562ec8045f/serve-healthcheck-canary/0.log" May 29 01:23:07.977404 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:07.977365 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-66nzn_31c35fd7-f103-4f3b-b39c-b5557b7ebe92/insights-operator/0.log" May 29 01:23:07.977574 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:07.977524 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-66nzn_31c35fd7-f103-4f3b-b39c-b5557b7ebe92/insights-operator/1.log" May 29 01:23:07.995324 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:07.995298 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gnqf_c71853f0-9092-44c9-b0dd-d2e0419fe3dc/kube-rbac-proxy/0.log" May 29 01:23:08.012291 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:08.012265 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gnqf_c71853f0-9092-44c9-b0dd-d2e0419fe3dc/exporter/0.log" May 29 01:23:08.029331 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:08.029302 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gnqf_c71853f0-9092-44c9-b0dd-d2e0419fe3dc/extractor/0.log" May 29 01:23:10.043636 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:10.043605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666940-zbcjn_cc06c917-e839-4aed-9083-13e4d22ea6da/cleanup/0.log" May 29 01:23:10.067048 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:10.067020 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666955-q2shj_97938b4d-013d-45be-8dca-20906ec48f7a/cleanup/0.log" May 29 01:23:10.233996 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:10.233966 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d9b8687fd-9rth6_d12f8789-0d79-4ddb-87a6-7120e7a41c38/manager/0.log" May 29 01:23:10.526061 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:10.526034 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-d55d7" May 29 01:23:11.477297 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:11.477270 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55ddb96654-fpc9v_0b8a3477-4bce-4db6-a1ac-9b5f9efef6c2/manager/0.log" May 29 01:23:11.519009 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:11.518983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-wr48s_97a9a329-b605-4369-8922-8cc8689912db/openshift-lws-operator/0.log" May 29 01:23:16.054527 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:16.054494 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-mgpmp_23591fcd-8159-497b-955d-6b65ec92d269/kube-storage-version-migrator-operator/1.log" May 29 01:23:16.055157 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:16.055137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-mgpmp_23591fcd-8159-497b-955d-6b65ec92d269/kube-storage-version-migrator-operator/0.log" May 29 01:23:17.058250 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.058222 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7drtj_d3612180-cb43-4b20-b9c2-aaa11191ee34/kube-multus/0.log" May 29 01:23:17.271194 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.271167 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6wbkg_8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed/kube-multus-additional-cni-plugins/0.log" May 29 01:23:17.290050 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.290023 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6wbkg_8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed/egress-router-binary-copy/0.log" May 29 01:23:17.310491 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.310427 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6wbkg_8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed/cni-plugins/0.log" May 29 01:23:17.329102 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.329076 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6wbkg_8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed/bond-cni-plugin/0.log" May 29 01:23:17.348862 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.348834 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6wbkg_8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed/routeoverride-cni/0.log" May 29 01:23:17.364852 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.364826 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6wbkg_8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed/whereabouts-cni-bincopy/0.log" May 29 01:23:17.381587 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.381563 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6wbkg_8e09b6d3-1d79-4384-a0cf-f5ef2dc3e7ed/whereabouts-cni/0.log" May 29 01:23:17.600333 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.600272 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5zjvq_d6804979-c10d-4438-b86d-a07db1614952/network-metrics-daemon/0.log" May 29 01:23:17.618368 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:17.618331 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5zjvq_d6804979-c10d-4438-b86d-a07db1614952/kube-rbac-proxy/0.log" May 29 01:23:18.464902 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.464876 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-controller/0.log" May 29 01:23:18.478861 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.478836 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/0.log" May 29 01:23:18.488246 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.488222 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovn-acl-logging/1.log" May 29 01:23:18.502353 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.502328 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/kube-rbac-proxy-node/0.log" May 29 01:23:18.529326 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.529299 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/kube-rbac-proxy-ovn-metrics/0.log" May 29 01:23:18.561495 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.561461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/northd/0.log" May 29 01:23:18.578077 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.578040 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/nbdb/0.log" May 29 01:23:18.595426 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.595405 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/sbdb/0.log" May 29 01:23:18.701384 ip-10-0-131-222 kubenswrapper[2563]: I0529 01:23:18.701357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ftcp_a822de23-8992-414d-be69-f204e3496364/ovnkube-controller/0.log"