May 21 15:38:09.121287 ip-10-0-129-52 systemd[1]: Starting Kubernetes Kubelet... May 21 15:38:09.612907 ip-10-0-129-52 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 15:38:09.612907 ip-10-0-129-52 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 15:38:09.612907 ip-10-0-129-52 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 15:38:09.612907 ip-10-0-129-52 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 15:38:09.612907 ip-10-0-129-52 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 15:38:09.615148 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.615059 2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 15:38:09.619222 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619201 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:38:09.619222 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619222 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:38:09.619222 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619226 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:38:09.619222 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619229 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:38:09.619222 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619232 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619235 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619238 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619242 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619245 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619247 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619250 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619253 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619256 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619259 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619262 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619265 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619268 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619270 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619273 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619275 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619278 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619281 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619285 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:38:09.619356 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619289 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619292 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619295 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619298 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619301 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619304 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619307 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619310 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619312 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619315 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619317 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619320 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619322 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619325 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619328 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619331 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619334 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619337 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619339 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619342 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:38:09.619842 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619344 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619346 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619349 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619351 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619354 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619356 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619359 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619362 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619364 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619367 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619370 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619372 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619375 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619377 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619380 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619383 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619385 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619388 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619390 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619394 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:38:09.620352 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619398 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619401 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619404 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619413 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619416 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619419 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619422 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619425 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619428 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619430 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619433 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619435 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619438 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619441 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619443 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619446 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619448 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619451 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619453 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619456 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:38:09.620835 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619458 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619461 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619463 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619873 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619878 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619880 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619883 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619885 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619888 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619890 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619893 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619896 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619898 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619901 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619903 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619906 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619909 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619911 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619927 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619931 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:38:09.621328 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619934 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619937 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619939 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619942 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619944 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619947 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619949 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619952 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619954 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619957 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619959 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619963 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619967 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619970 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619972 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619975 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619977 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619980 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619982 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619985 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:38:09.621826 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619988 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619990 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619993 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619996 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.619998 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620001 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620003 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620005 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620008 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620011 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620014 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620018 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620020 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620023 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620026 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620028 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620031 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620034 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620036 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620039 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:38:09.622376 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620041 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620044 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620048 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620052 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620055 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620058 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620061 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620064 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620066 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620069 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620073 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620075 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620078 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620080 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620082 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620085 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620088 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620090 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620093 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:38:09.622859 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620095 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620098 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620101 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620103 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620106 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620108 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620111 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620114 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620116 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.620118 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620809 2556 flags.go:64] FLAG: --address="0.0.0.0" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620818 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620824 2556 flags.go:64] FLAG: --anonymous-auth="true" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620828 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620832 2556 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620836 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620840 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620845 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620848 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620851 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620855 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 15:38:09.623360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620858 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620861 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620864 2556 flags.go:64] FLAG: --cgroup-root="" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620867 2556 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620869 2556 flags.go:64] FLAG: --client-ca-file="" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620872 2556 flags.go:64] FLAG: --cloud-config="" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620875 2556 flags.go:64] FLAG: --cloud-provider="external" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620878 2556 flags.go:64] FLAG: --cluster-dns="[]" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620883 2556 flags.go:64] FLAG: --cluster-domain="" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620885 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620888 2556 flags.go:64] FLAG: --config-dir="" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620891 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620895 2556 flags.go:64] FLAG: --container-log-max-files="5" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620899 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620903 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620906 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620909 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620925 2556 flags.go:64] FLAG: --contention-profiling="false" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620928 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620931 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620934 2556 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620937 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620941 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620944 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620947 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 15:38:09.623882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620950 2556 flags.go:64] FLAG: --enable-load-reader="false" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620953 2556 flags.go:64] FLAG: --enable-server="true" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620956 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620961 2556 flags.go:64] FLAG: --event-burst="100" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620964 2556 flags.go:64] FLAG: --event-qps="50" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620966 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620970 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620972 2556 flags.go:64] FLAG: --eviction-hard="" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620976 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620979 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620981 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620984 2556 flags.go:64] FLAG: --eviction-soft="" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620987 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620990 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620993 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620996 2556 flags.go:64] FLAG: --experimental-mounter-path="" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.620999 2556 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621001 2556 flags.go:64] FLAG: --fail-swap-on="true" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621004 2556 flags.go:64] FLAG: --feature-gates="" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621008 2556 flags.go:64] FLAG: --file-check-frequency="20s" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621011 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621014 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621018 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621021 2556 flags.go:64] FLAG: --healthz-port="10248" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621024 2556 flags.go:64] FLAG: --help="false" May 21 15:38:09.624500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621026 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-129-52.ec2.internal" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621029 2556 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621032 2556 flags.go:64] FLAG: --http-check-frequency="20s" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621035 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621038 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621041 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621044 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621048 2556 flags.go:64] FLAG: --image-service-endpoint="" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621051 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621054 2556 flags.go:64] FLAG: --kube-api-burst="100" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621057 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621060 2556 flags.go:64] FLAG: --kube-api-qps="50" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621062 2556 flags.go:64] FLAG: --kube-reserved="" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621065 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621068 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621071 2556 flags.go:64] FLAG: --kubelet-cgroups="" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621074 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621077 2556 flags.go:64] FLAG: --lock-file="" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621079 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621082 2556 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621085 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621090 2556 flags.go:64] FLAG: --log-json-split-stream="false" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621093 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621098 2556 flags.go:64] FLAG: --log-text-split-stream="false" May 21 15:38:09.625121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621101 2556 flags.go:64] FLAG: --logging-format="text" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621104 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621107 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621110 2556 flags.go:64] FLAG: --manifest-url="" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621113 2556 flags.go:64] FLAG: --manifest-url-header="" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621117 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621120 2556 flags.go:64] FLAG: --max-open-files="1000000" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621125 2556 flags.go:64] FLAG: --max-pods="110" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621128 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621131 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621134 2556 flags.go:64] FLAG: --memory-manager-policy="None" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621137 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621140 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621143 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621146 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621153 2556 flags.go:64] FLAG: --node-status-max-images="50" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621156 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621158 2556 flags.go:64] FLAG: --oom-score-adj="-999" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621161 2556 flags.go:64] FLAG: --pod-cidr="" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621164 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621170 2556 flags.go:64] FLAG: --pod-manifest-path="" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621173 2556 flags.go:64] FLAG: --pod-max-pids="-1" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621176 2556 flags.go:64] FLAG: --pods-per-core="0" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621179 2556 flags.go:64] FLAG: --port="10250" May 21 15:38:09.625694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621182 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621185 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bedf19fd358e1797" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621188 2556 flags.go:64] FLAG: --qos-reserved="" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621191 2556 flags.go:64] FLAG: --read-only-port="10255" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621194 2556 flags.go:64] FLAG: --register-node="true" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621197 2556 flags.go:64] FLAG: --register-schedulable="true" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621200 2556 flags.go:64] FLAG: --register-with-taints="" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621203 2556 flags.go:64] FLAG: --registry-burst="10" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621209 2556 flags.go:64] FLAG: --registry-qps="5" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621212 2556 flags.go:64] FLAG: --reserved-cpus="" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621215 2556 flags.go:64] FLAG: --reserved-memory="" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621219 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621221 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621225 2556 flags.go:64] FLAG: --rotate-certificates="false" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621227 2556 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621231 2556 flags.go:64] FLAG: --runonce="false" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621234 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621237 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621240 2556 flags.go:64] FLAG: --seccomp-default="false" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621243 2556 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621245 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621248 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621251 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621254 2556 flags.go:64] FLAG: --storage-driver-password="root" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621257 2556 flags.go:64] FLAG: --storage-driver-secure="false" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621260 2556 flags.go:64] FLAG: --storage-driver-table="stats" May 21 15:38:09.626318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621263 2556 flags.go:64] FLAG: --storage-driver-user="root" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621266 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621269 2556 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621272 2556 flags.go:64] FLAG: --system-cgroups="" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621274 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621283 2556 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621286 2556 flags.go:64] FLAG: --tls-cert-file="" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621289 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621293 2556 flags.go:64] FLAG: --tls-min-version="" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621296 2556 flags.go:64] FLAG: --tls-private-key-file="" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621299 2556 flags.go:64] FLAG: --topology-manager-policy="none" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621301 2556 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621304 2556 flags.go:64] FLAG: --topology-manager-scope="container" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621307 2556 flags.go:64] FLAG: --v="2" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621312 2556 flags.go:64] FLAG: --version="false" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621316 2556 flags.go:64] FLAG: --vmodule="" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621321 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.621324 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621443 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621447 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621450 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621453 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621457 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621460 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:38:09.626968 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621462 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621465 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621467 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621470 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621472 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621475 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621478 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621480 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621483 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621485 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621488 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621491 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621493 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621496 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621498 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621502 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621505 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621508 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621511 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:38:09.627552 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621514 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621517 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621520 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621523 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621526 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621529 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621532 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621534 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621539 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621542 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621545 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621548 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621551 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621554 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621556 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621559 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621561 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621564 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621566 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621569 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:38:09.628111 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621572 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621574 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621577 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621579 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621582 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621585 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621587 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621590 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621592 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621594 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621597 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621601 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621604 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621607 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621610 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621613 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621616 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621618 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621621 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:38:09.628599 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621624 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621626 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621629 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621636 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621638 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621641 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621644 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621647 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621650 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621652 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621655 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621657 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621660 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621662 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621665 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621668 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621670 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621673 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621675 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:38:09.629078 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621678 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621680 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.621683 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.622841 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.629237 2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.629344 2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629392 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629398 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629401 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629406 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629410 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629414 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629418 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629421 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629424 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:38:09.629542 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629427 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629430 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629432 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629435 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629439 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629443 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629447 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629450 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629453 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629456 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629459 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629462 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629464 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629467 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629470 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629479 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629482 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629485 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629487 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629490 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:38:09.629911 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629492 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629495 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629498 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629501 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629503 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629506 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629509 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629512 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629514 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629517 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629519 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629522 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629525 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629527 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629530 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629532 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629535 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629543 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629546 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:38:09.630396 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629549 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629552 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629555 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629557 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629560 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629563 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629565 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629568 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629570 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629573 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629575 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629578 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629581 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629583 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629585 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629588 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629591 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629594 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629596 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629599 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:38:09.630866 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629601 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629604 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629606 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629609 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629611 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629614 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629616 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629619 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629621 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629624 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629626 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629635 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629638 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629640 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629643 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629645 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629648 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:38:09.631411 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629650 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.629655 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629776 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629781 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629784 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629787 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629790 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629793 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629795 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629798 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629802 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629804 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629807 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629809 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629812 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629815 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:38:09.631886 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629817 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629820 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629822 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629824 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629827 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629829 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629832 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629834 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629837 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629839 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629842 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629845 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629847 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629850 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629852 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629855 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629858 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629860 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629863 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:38:09.632293 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629865 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629868 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629870 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629873 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629875 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629878 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629880 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629883 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629885 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629887 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629890 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629893 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629895 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629898 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629900 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629904 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629907 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629910 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629930 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:38:09.632764 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629934 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629939 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629942 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629944 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629947 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629949 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629953 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629955 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629958 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629960 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629962 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629965 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629968 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629970 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629973 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629976 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629978 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629981 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629983 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629986 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:38:09.633276 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629989 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629991 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629994 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629996 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.629999 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630001 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630004 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630006 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630009 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630011 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630014 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630016 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630020 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:09.630022 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.630027 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 15:38:09.633750 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.630675 2556 server.go:962] "Client rotation is on, will bootstrap in background" May 21 15:38:09.634252 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.632666 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 15:38:09.634252 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.633711 2556 server.go:1019] "Starting client certificate rotation" May 21 15:38:09.634252 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.633834 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 15:38:09.634252 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.633887 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 15:38:09.661592 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.661572 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 15:38:09.664282 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.664263 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 15:38:09.680322 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.680303 2556 log.go:25] "Validated CRI v1 runtime API" May 21 15:38:09.686358 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.686342 2556 log.go:25] "Validated CRI v1 image API" May 21 15:38:09.688692 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.688676 2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 15:38:09.692169 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.692152 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 15:38:09.693382 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.693365 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 894d4a2e-db70-4c56-895d-1e495c9480cf:/dev/nvme0n1p4 ffd8dddf-e7cc-4310-bce9-b3d4617fe459:/dev/nvme0n1p3] May 21 15:38:09.693430 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.693382 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 15:38:09.697572 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.697464 2556 manager.go:217] Machine: {Timestamp:2026-05-21 15:38:09.697006427 +0000 UTC m=+0.441679625 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100761 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28b6bc76fe6a339b283dcdb443b9ae SystemUUID:ec28b6bc-76fe-6a33-9b28-3dcdb443b9ae BootID:d79878b7-afd1-41f0-b49b-33c465466d7e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:9f:d0:8c:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:9f:d0:8c:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:fe:7e:2d:c5:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 15:38:09.699101 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.699090 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 15:38:09.699203 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.699190 2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 15:38:09.701112 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.701091 2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 15:38:09.701271 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.701114 2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 15:38:09.701316 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.701280 2556 topology_manager.go:138] "Creating topology manager with none policy" May 21 15:38:09.701316 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.701289 2556 container_manager_linux.go:306] "Creating device plugin manager" May 21 15:38:09.701316 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.701297 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 15:38:09.702040 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.702030 2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 15:38:09.703358 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.703349 2556 state_mem.go:36] "Initialized new in-memory state store" May 21 15:38:09.703464 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.703455 2556 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 15:38:09.706173 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.706164 2556 kubelet.go:491] "Attempting to sync node with API server" May 21 15:38:09.706210 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.706181 2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 15:38:09.706210 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.706194 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 15:38:09.706210 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.706202 2556 kubelet.go:397] "Adding apiserver pod source" May 21 15:38:09.706210 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.706210 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 15:38:09.707355 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.707344 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 15:38:09.707407 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.707362 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 15:38:09.710882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.710866 2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 15:38:09.712708 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.712696 2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 15:38:09.713639 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713627 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 15:38:09.713679 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713648 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 15:38:09.713679 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713655 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 15:38:09.713679 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713661 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 15:38:09.713679 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713669 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 15:38:09.713679 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713674 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 15:38:09.713679 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713679 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 15:38:09.713839 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713684 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 15:38:09.713839 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713701 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 15:38:09.713839 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713710 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 15:38:09.713839 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.713720 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 15:38:09.714233 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.714224 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 15:38:09.715166 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.715155 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 15:38:09.715203 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.715168 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 15:38:09.718038 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.718013 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nsllc" May 21 15:38:09.718182 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.718171 2556 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 15:38:09.718227 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.718208 2556 server.go:1295] "Started kubelet" May 21 15:38:09.718320 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.718276 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 15:38:09.718442 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.718278 2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 15:38:09.718549 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.718531 2556 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 15:38:09.718993 ip-10-0-129-52 systemd[1]: Started Kubernetes Kubelet. May 21 15:38:09.722500 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.722477 2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 15:38:09.725588 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.725572 2556 server.go:317] "Adding debug handlers to kubelet server" May 21 15:38:09.725981 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.725965 2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 15:38:09.726168 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.726136 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 15:38:09.727306 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.727285 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nsllc" May 21 15:38:09.732548 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.732526 2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 15:38:09.732974 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.732948 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 15:38:09.733404 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.733385 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 15:38:09.733480 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.733459 2556 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 15:38:09.733480 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.733475 2556 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 15:38:09.733680 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.733665 2556 reconstruct.go:97] "Volume reconstruction finished" May 21 15:38:09.733680 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.733681 2556 reconciler.go:26] "Reconciler: start to sync state" May 21 15:38:09.733771 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.733702 2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 15:38:09.734508 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.734311 2556 factory.go:55] Registering systemd factory May 21 15:38:09.734508 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.734326 2556 factory.go:223] Registration of the systemd container factory successfully May 21 15:38:09.734626 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.734538 2556 factory.go:153] Registering CRI-O factory May 21 15:38:09.734626 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.734556 2556 factory.go:223] Registration of the crio container factory successfully May 21 15:38:09.734626 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.734603 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 15:38:09.734626 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.734621 2556 factory.go:103] Registering Raw factory May 21 15:38:09.734865 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.734638 2556 manager.go:1196] Started watching for new ooms in manager May 21 15:38:09.735070 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.735041 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:09.735144 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.735105 2556 manager.go:319] Starting recovery of all containers May 21 15:38:09.739421 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.739397 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:38:09.744856 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.744838 2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:38:09.746198 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.746185 2556 manager.go:324] Recovery completed May 21 15:38:09.747092 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.747072 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-52.ec2.internal\" not found" node="ip-10-0-129-52.ec2.internal" May 21 15:38:09.751315 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.751301 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:38:09.753670 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.753656 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientMemory" May 21 15:38:09.753752 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.753686 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:38:09.753752 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.753701 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientPID" May 21 15:38:09.754181 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.754165 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 15:38:09.754181 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.754178 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 15:38:09.754289 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.754194 2556 state_mem.go:36] "Initialized new in-memory state store" May 21 15:38:09.756617 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.756605 2556 policy_none.go:49] "None policy: Start" May 21 15:38:09.756663 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.756621 2556 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 15:38:09.756663 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.756632 2556 state_mem.go:35] "Initializing new in-memory state store" May 21 15:38:09.799446 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.799430 2556 manager.go:341] "Starting Device Plugin manager" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.799483 2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.799496 2556 server.go:85] "Starting device plugin registration server" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.799690 2556 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.799704 2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.799805 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.799898 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.799908 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.800573 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 15:38:09.808126 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.800600 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:09.866209 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.866158 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 15:38:09.867315 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.867293 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 15:38:09.867394 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.867321 2556 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 15:38:09.867394 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.867341 2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 15:38:09.867394 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.867349 2556 kubelet.go:2451] "Starting kubelet main sync loop" May 21 15:38:09.867542 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.867420 2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 15:38:09.870598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.870577 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:38:09.900511 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.900493 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:38:09.901380 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.901367 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientMemory" May 21 15:38:09.901435 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.901396 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:38:09.901435 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.901407 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientPID" May 21 15:38:09.901435 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.901428 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-52.ec2.internal" May 21 15:38:09.913161 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.913148 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-52.ec2.internal" May 21 15:38:09.913201 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.913169 2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-52.ec2.internal\": node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:09.944029 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.944009 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:09.967892 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.967873 2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal"] May 21 15:38:09.967953 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.967942 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:38:09.969341 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.969319 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientMemory" May 21 15:38:09.969439 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.969350 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:38:09.969439 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.969365 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientPID" May 21 15:38:09.970967 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.970952 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:38:09.971070 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.971054 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:09.971130 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.971084 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:38:09.971667 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.971643 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientMemory" May 21 15:38:09.971667 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.971668 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:38:09.971774 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.971677 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientPID" May 21 15:38:09.971774 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.971691 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientMemory" May 21 15:38:09.971774 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.971715 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:38:09.971774 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.971728 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientPID" May 21 15:38:09.973131 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.973115 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" May 21 15:38:09.973213 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.973143 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:38:09.973758 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.973743 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientMemory" May 21 15:38:09.973843 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.973775 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:38:09.973843 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:09.973790 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeHasSufficientPID" May 21 15:38:09.996435 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:09.996414 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-52.ec2.internal\" not found" node="ip-10-0-129-52.ec2.internal" May 21 15:38:10.000754 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.000741 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-52.ec2.internal\" not found" node="ip-10-0-129-52.ec2.internal" May 21 15:38:10.035502 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.035465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08296e384a3c9a48ca5f1a078ded2555-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal\" (UID: \"08296e384a3c9a48ca5f1a078ded2555\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:10.044073 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.044058 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.136276 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.136216 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08296e384a3c9a48ca5f1a078ded2555-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal\" (UID: \"08296e384a3c9a48ca5f1a078ded2555\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:10.136276 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.136233 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08296e384a3c9a48ca5f1a078ded2555-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal\" (UID: \"08296e384a3c9a48ca5f1a078ded2555\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:10.136276 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.136272 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08296e384a3c9a48ca5f1a078ded2555-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal\" (UID: \"08296e384a3c9a48ca5f1a078ded2555\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:10.136424 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.136303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6570d05f87a90cb80699b013db438d94-config\") pod \"kube-apiserver-proxy-ip-10-0-129-52.ec2.internal\" (UID: \"6570d05f87a90cb80699b013db438d94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" May 21 15:38:10.144280 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.144255 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.236643 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.236622 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08296e384a3c9a48ca5f1a078ded2555-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal\" (UID: \"08296e384a3c9a48ca5f1a078ded2555\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:10.236689 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.236644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08296e384a3c9a48ca5f1a078ded2555-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal\" (UID: \"08296e384a3c9a48ca5f1a078ded2555\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:10.236689 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.236671 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6570d05f87a90cb80699b013db438d94-config\") pod \"kube-apiserver-proxy-ip-10-0-129-52.ec2.internal\" (UID: \"6570d05f87a90cb80699b013db438d94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" May 21 15:38:10.236755 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.236709 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6570d05f87a90cb80699b013db438d94-config\") pod \"kube-apiserver-proxy-ip-10-0-129-52.ec2.internal\" (UID: \"6570d05f87a90cb80699b013db438d94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" May 21 15:38:10.244759 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.244727 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.299889 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.299871 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:10.303627 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.303606 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" May 21 15:38:10.345611 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.345591 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.446101 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.446058 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.546521 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.546502 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.633735 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.633714 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 15:38:10.634338 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.633849 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 15:38:10.634338 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.633853 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 15:38:10.634338 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.633853 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 15:38:10.647018 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.646999 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.730565 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.730530 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 15:33:09 +0000 UTC" deadline="2027-11-27 10:50:59.975269184 +0000 UTC" May 21 15:38:10.730565 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.730553 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13315h12m49.244718871s" May 21 15:38:10.733727 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.733701 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 15:38:10.747353 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.747333 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.754007 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.753991 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 15:38:10.800254 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.800232 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h98tp" May 21 15:38:10.806203 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:10.806180 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08296e384a3c9a48ca5f1a078ded2555.slice/crio-a122b391e607aeffd190b04598ed76a9db6b6000bc9009e110006ad74a7908fe WatchSource:0}: Error finding container a122b391e607aeffd190b04598ed76a9db6b6000bc9009e110006ad74a7908fe: Status 404 returned error can't find the container with id a122b391e607aeffd190b04598ed76a9db6b6000bc9009e110006ad74a7908fe May 21 15:38:10.806406 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:10.806385 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6570d05f87a90cb80699b013db438d94.slice/crio-41cb4d0f9185a78514e4e149416b59a5e0ef43ce2bf8094cd02b46220586c953 WatchSource:0}: Error finding container 41cb4d0f9185a78514e4e149416b59a5e0ef43ce2bf8094cd02b46220586c953: Status 404 returned error can't find the container with id 41cb4d0f9185a78514e4e149416b59a5e0ef43ce2bf8094cd02b46220586c953 May 21 15:38:10.810387 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.810373 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:38:10.814291 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.814274 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h98tp" May 21 15:38:10.848201 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.848068 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.869709 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.869665 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" event={"ID":"6570d05f87a90cb80699b013db438d94","Type":"ContainerStarted","Data":"41cb4d0f9185a78514e4e149416b59a5e0ef43ce2bf8094cd02b46220586c953"} May 21 15:38:10.870482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.870466 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" event={"ID":"08296e384a3c9a48ca5f1a078ded2555","Type":"ContainerStarted","Data":"a122b391e607aeffd190b04598ed76a9db6b6000bc9009e110006ad74a7908fe"} May 21 15:38:10.948900 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:10.948880 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-52.ec2.internal\" not found" May 21 15:38:10.998359 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:10.998314 2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:38:11.034580 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.034561 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" May 21 15:38:11.047787 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.047769 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 15:38:11.047865 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.047855 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" May 21 15:38:11.061662 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.061645 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 15:38:11.708174 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.708134 2556 apiserver.go:52] "Watching apiserver" May 21 15:38:11.719218 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.719198 2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 15:38:11.720465 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.720438 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg","openshift-cluster-node-tuning-operator/tuned-6sl9b","openshift-dns/node-resolver-x976d","openshift-image-registry/node-ca-dj9r4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal","openshift-multus/network-metrics-daemon-k8ngt","openshift-network-operator/iptables-alerter-r2wqq","kube-system/konnectivity-agent-45jk6","kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal","openshift-multus/multus-9gn9g","openshift-multus/multus-additional-cni-plugins-xmlvx","openshift-network-diagnostics/network-check-target-5bm4d","openshift-ovn-kubernetes/ovnkube-node-v9w2m"] May 21 15:38:11.721899 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.721879 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:11.722005 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:11.721986 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:11.723897 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.723875 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.724010 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.723976 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9gn9g" May 21 15:38:11.725009 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.724988 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.726144 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.726098 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 15:38:11.726144 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.726102 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 15:38:11.726286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.726151 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 15:38:11.726286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.726194 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9n7m7\"" May 21 15:38:11.726286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.726268 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 15:38:11.726498 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.726477 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:11.727029 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.727011 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n7456\"" May 21 15:38:11.727121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.727018 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 15:38:11.727267 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.727245 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 15:38:11.727354 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.727267 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 15:38:11.727412 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.727354 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 15:38:11.727540 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.727517 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 15:38:11.727625 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.727587 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-44lkn\"" May 21 15:38:11.727782 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.727760 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.728876 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.728761 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rb94h\"" May 21 15:38:11.728876 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.728802 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 15:38:11.729043 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.729000 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 15:38:11.729340 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.729324 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.730418 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.730401 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 15:38:11.730563 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.730546 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 15:38:11.730622 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.730564 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.730680 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.730672 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 15:38:11.730757 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.730738 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j6vc9\"" May 21 15:38:11.731168 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.731149 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 15:38:11.731330 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.731156 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 15:38:11.731600 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.731581 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 15:38:11.731691 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.731651 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4255d\"" May 21 15:38:11.732976 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.732591 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 15:38:11.732976 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.732808 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 15:38:11.732976 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.732851 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9b2fj\"" May 21 15:38:11.733153 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.733076 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.734623 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.734607 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:11.734703 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:11.734676 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:11.734748 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.734725 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.735542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.735348 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-856hp\"" May 21 15:38:11.735542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.735414 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 15:38:11.735776 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.735758 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 15:38:11.738213 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.738194 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 15:38:11.738299 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.738249 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 15:38:11.738358 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.738302 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 15:38:11.738402 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.738194 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 15:38:11.738970 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.738947 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q4zct\"" May 21 15:38:11.739223 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.739196 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 15:38:11.739285 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.739243 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 15:38:11.744059 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5t7\" (UniqueName: \"kubernetes.io/projected/3762df41-6506-4248-a95a-369c904c6404-kube-api-access-fh5t7\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:11.744142 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysconfig\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.744142 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-system-cni-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.744248 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-kubelet\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.744248 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744199 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-ovn\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.744248 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744224 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb9dt\" (UniqueName: \"kubernetes.io/projected/89a09080-dfa9-4903-8dbe-3c1ff4646437-kube-api-access-sb9dt\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.744248 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-var-lib-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.744432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-env-overrides\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.744432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-cni-bin\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.744432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-conf-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.744432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744329 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-multus-certs\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.744432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-registration-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.744432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744374 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89a09080-dfa9-4903-8dbe-3c1ff4646437-host-slash\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.744432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744401 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9dw6\" (UniqueName: \"kubernetes.io/projected/4315fe49-5816-45ab-b892-55c089d2f273-kube-api-access-k9dw6\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744489 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysctl-d\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-var-lib-kubelet\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-systemd\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkdw2\" (UniqueName: \"kubernetes.io/projected/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-kube-api-access-mkdw2\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744634 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-cnibin\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4315fe49-5816-45ab-b892-55c089d2f273-ovn-node-metrics-cert\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.744731 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744726 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-modprobe-d\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744754 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysctl-conf\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-log-socket\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744799 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-systemd\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-ovnkube-config\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-tuned\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744910 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d20b143-e9dd-4091-b94c-eab9f4b3795e-konnectivity-ca\") pod \"konnectivity-agent-45jk6\" (UID: \"1d20b143-e9dd-4091-b94c-eab9f4b3795e\") " pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744947 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-node-log\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.744984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-cni-bin\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-tmp\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-etc-kubernetes\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-cni-netd\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745125 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-kubernetes\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.745159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-k8s-cni-cncf-io\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqztt\" (UniqueName: \"kubernetes.io/projected/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-kube-api-access-zqztt\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745194 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89a09080-dfa9-4903-8dbe-3c1ff4646437-iptables-alerter-script\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-hostroot\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a925a804-0977-4537-af01-3193b0e87ac8-hosts-file\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-sys-fs\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745328 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-serviceca\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-system-cni-dir\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqq5\" (UniqueName: \"kubernetes.io/projected/f990b6d8-ab00-4194-93eb-1902e6f87a24-kube-api-access-qrqq5\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745428 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-host\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d20b143-e9dd-4091-b94c-eab9f4b3795e-agent-certs\") pod \"konnectivity-agent-45jk6\" (UID: \"1d20b143-e9dd-4091-b94c-eab9f4b3795e\") " pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a925a804-0977-4537-af01-3193b0e87ac8-tmp-dir\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-device-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745535 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-cni-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7257125a-9c7c-4337-a076-edad273a3907-multus-daemon-config\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.745833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745612 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-os-release\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-etc-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745680 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-ovnkube-script-lib\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-run\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7257125a-9c7c-4337-a076-edad273a3907-cni-binary-copy\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-os-release\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-slash\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-run-netns\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745930 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-cnibin\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-socket-dir-parent\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.745993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-netns\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746015 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-kubelet\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-systemd-units\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmkqp\" (UniqueName: \"kubernetes.io/projected/7257125a-9c7c-4337-a076-edad273a3907-kube-api-access-fmkqp\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.746473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrvwz\" (UniqueName: \"kubernetes.io/projected/a925a804-0977-4537-af01-3193b0e87ac8-kube-api-access-mrvwz\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-socket-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-host\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746186 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746205 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-sys\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-lib-modules\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlztj\" (UniqueName: \"kubernetes.io/projected/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-kube-api-access-jlztj\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.747121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.746344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-cni-multus\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.797515 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.797495 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:38:11.815282 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.815256 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:33:10 +0000 UTC" deadline="2028-01-15 23:23:45.208260259 +0000 UTC" May 21 15:38:11.815282 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.815279 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14503h45m33.392983118s" May 21 15:38:11.834909 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.834878 2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 15:38:11.847251 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847231 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-os-release\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.847346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847259 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.847346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847275 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-slash\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.847346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847291 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-run-netns\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.847346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847316 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-cnibin\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847347 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-socket-dir-parent\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847367 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-slash\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847384 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-run-netns\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847374 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-netns\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-netns\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847434 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-kubelet\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-socket-dir-parent\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847471 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-systemd-units\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847475 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-cnibin\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847512 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-kubelet\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.847587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847561 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-systemd-units\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.847988 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847688 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-os-release\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.847988 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847937 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.848076 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.847499 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmkqp\" (UniqueName: \"kubernetes.io/projected/7257125a-9c7c-4337-a076-edad273a3907-kube-api-access-fmkqp\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.848076 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848040 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrvwz\" (UniqueName: \"kubernetes.io/projected/a925a804-0977-4537-af01-3193b0e87ac8-kube-api-access-mrvwz\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.848076 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848058 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-socket-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.848186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848074 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-host\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.848186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848092 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:11.848186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848107 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.848186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848122 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.848186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848144 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-sys\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.848186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848167 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-lib-modules\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.848186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848181 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-host\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848191 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlztj\" (UniqueName: \"kubernetes.io/projected/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-kube-api-access-jlztj\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848195 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848186 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-socket-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848218 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848227 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-cni-multus\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848253 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-sys\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:11.848287 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848291 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-lib-modules\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848291 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5t7\" (UniqueName: \"kubernetes.io/projected/3762df41-6506-4248-a95a-369c904c6404-kube-api-access-fh5t7\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:11.848367 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs podName:3762df41-6506-4248-a95a-369c904c6404 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:12.348338542 +0000 UTC m=+3.093011727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs") pod "network-metrics-daemon-k8ngt" (UID: "3762df41-6506-4248-a95a-369c904c6404") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848399 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysconfig\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.848482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848410 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-cni-multus\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848493 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-system-cni-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848518 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysconfig\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848571 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-kubelet\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848593 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-kubelet\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848646 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-system-cni-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848668 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-ovn\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848710 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb9dt\" (UniqueName: \"kubernetes.io/projected/89a09080-dfa9-4903-8dbe-3c1ff4646437-kube-api-access-sb9dt\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848748 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-var-lib-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848760 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-ovn\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848767 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-env-overrides\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848799 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-cni-bin\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848829 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-conf-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848846 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-multus-certs\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848857 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-var-lib-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848862 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-registration-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848902 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-registration-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848906 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89a09080-dfa9-4903-8dbe-3c1ff4646437-host-slash\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.849004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848946 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-var-lib-cni-bin\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848956 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848978 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-conf-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.848985 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9dw6\" (UniqueName: \"kubernetes.io/projected/4315fe49-5816-45ab-b892-55c089d2f273-kube-api-access-k9dw6\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-multus-certs\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849009 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysctl-d\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849032 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-var-lib-kubelet\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849056 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-systemd\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849060 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89a09080-dfa9-4903-8dbe-3c1ff4646437-host-slash\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849081 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkdw2\" (UniqueName: \"kubernetes.io/projected/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-kube-api-access-mkdw2\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849098 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849108 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-cnibin\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849138 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849147 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-env-overrides\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849163 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4315fe49-5816-45ab-b892-55c089d2f273-ovn-node-metrics-cert\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849189 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-modprobe-d\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849195 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysctl-d\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.849815 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849213 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysctl-conf\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849239 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-log-socket\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849243 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-var-lib-kubelet\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849264 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-systemd\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849289 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-ovnkube-config\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849316 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-tuned\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849356 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d20b143-e9dd-4091-b94c-eab9f4b3795e-konnectivity-ca\") pod \"konnectivity-agent-45jk6\" (UID: \"1d20b143-e9dd-4091-b94c-eab9f4b3795e\") " pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-sysctl-conf\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849380 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-node-log\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849387 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-systemd\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849404 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-cni-bin\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849434 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849443 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-modprobe-d\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849451 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-log-socket\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849462 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-tmp\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849487 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-etc-kubernetes\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849494 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-run-systemd\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849490 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-cnibin\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.850610 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849513 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849529 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849549 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-node-log\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849557 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-cni-netd\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849582 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-kubernetes\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849608 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-k8s-cni-cncf-io\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849634 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqztt\" (UniqueName: \"kubernetes.io/projected/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-kube-api-access-zqztt\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849660 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89a09080-dfa9-4903-8dbe-3c1ff4646437-iptables-alerter-script\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849687 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849712 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-hostroot\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849736 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a925a804-0977-4537-af01-3193b0e87ac8-hosts-file\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849789 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-sys-fs\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849815 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-serviceca\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849854 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-etc-kubernetes\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849860 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849895 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-system-cni-dir\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849943 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqq5\" (UniqueName: \"kubernetes.io/projected/f990b6d8-ab00-4194-93eb-1902e6f87a24-kube-api-access-qrqq5\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.851486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849971 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-host\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849987 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-ovnkube-config\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849996 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d20b143-e9dd-4091-b94c-eab9f4b3795e-agent-certs\") pod \"konnectivity-agent-45jk6\" (UID: \"1d20b143-e9dd-4091-b94c-eab9f4b3795e\") " pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850021 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a925a804-0977-4537-af01-3193b0e87ac8-tmp-dir\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850047 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-device-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850057 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-system-cni-dir\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850076 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-cni-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850101 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7257125a-9c7c-4337-a076-edad273a3907-multus-daemon-config\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850126 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850151 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-os-release\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850180 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.849531 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-cni-bin\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850223 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-etc-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850262 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-ovnkube-script-lib\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850289 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-run\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850327 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850372 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d20b143-e9dd-4091-b94c-eab9f4b3795e-konnectivity-ca\") pod \"konnectivity-agent-45jk6\" (UID: \"1d20b143-e9dd-4091-b94c-eab9f4b3795e\") " pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:11.852286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850431 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-host\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850490 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-multus-cni-dir\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850557 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-serviceca\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850724 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850773 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-etc-openvswitch\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850784 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89a09080-dfa9-4903-8dbe-3c1ff4646437-iptables-alerter-script\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850791 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7257125a-9c7c-4337-a076-edad273a3907-cni-binary-copy\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850786 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-device-dir\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850829 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-kubernetes\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850728 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a925a804-0977-4537-af01-3193b0e87ac8-tmp-dir\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850854 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850934 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-run\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850942 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-hostroot\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850978 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-sys-fs\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.850974 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7257125a-9c7c-4337-a076-edad273a3907-host-run-k8s-cni-cncf-io\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.851064 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4315fe49-5816-45ab-b892-55c089d2f273-host-cni-netd\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.851129 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f990b6d8-ab00-4194-93eb-1902e6f87a24-os-release\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.853044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.851462 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f990b6d8-ab00-4194-93eb-1902e6f87a24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.853780 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.851475 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4315fe49-5816-45ab-b892-55c089d2f273-ovnkube-script-lib\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.853780 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.852979 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a925a804-0977-4537-af01-3193b0e87ac8-hosts-file\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.853780 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.853097 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7257125a-9c7c-4337-a076-edad273a3907-cni-binary-copy\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.853780 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.853200 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-tmp\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.853780 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.853266 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-etc-tuned\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.853780 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.853362 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7257125a-9c7c-4337-a076-edad273a3907-multus-daemon-config\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.853780 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.853562 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4315fe49-5816-45ab-b892-55c089d2f273-ovn-node-metrics-cert\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:11.857190 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.856720 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d20b143-e9dd-4091-b94c-eab9f4b3795e-agent-certs\") pod \"konnectivity-agent-45jk6\" (UID: \"1d20b143-e9dd-4091-b94c-eab9f4b3795e\") " pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:11.857190 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.856931 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmkqp\" (UniqueName: \"kubernetes.io/projected/7257125a-9c7c-4337-a076-edad273a3907-kube-api-access-fmkqp\") pod \"multus-9gn9g\" (UID: \"7257125a-9c7c-4337-a076-edad273a3907\") " pod="openshift-multus/multus-9gn9g" May 21 15:38:11.858251 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.858207 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5t7\" (UniqueName: \"kubernetes.io/projected/3762df41-6506-4248-a95a-369c904c6404-kube-api-access-fh5t7\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:11.858980 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.858901 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlztj\" (UniqueName: \"kubernetes.io/projected/2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8-kube-api-access-jlztj\") pod \"tuned-6sl9b\" (UID: \"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8\") " pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:11.859578 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.859560 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrvwz\" (UniqueName: \"kubernetes.io/projected/a925a804-0977-4537-af01-3193b0e87ac8-kube-api-access-mrvwz\") pod \"node-resolver-x976d\" (UID: \"a925a804-0977-4537-af01-3193b0e87ac8\") " pod="openshift-dns/node-resolver-x976d" May 21 15:38:11.859850 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:11.859834 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:38:11.859957 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:11.859854 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:38:11.859957 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:11.859866 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wdgbb for pod openshift-network-diagnostics/network-check-target-5bm4d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:11.859957 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:11.859935 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb podName:10c555ff-301c-4c19-9e26-919eca7c10e7 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:12.359905789 +0000 UTC m=+3.104578976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wdgbb" (UniqueName: "kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb") pod "network-check-target-5bm4d" (UID: "10c555ff-301c-4c19-9e26-919eca7c10e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:11.862525 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.862497 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb9dt\" (UniqueName: \"kubernetes.io/projected/89a09080-dfa9-4903-8dbe-3c1ff4646437-kube-api-access-sb9dt\") pod \"iptables-alerter-r2wqq\" (UID: \"89a09080-dfa9-4903-8dbe-3c1ff4646437\") " pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:11.862827 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.862803 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkdw2\" (UniqueName: \"kubernetes.io/projected/b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8-kube-api-access-mkdw2\") pod \"aws-ebs-csi-driver-node-z4kvg\" (UID: \"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:11.863236 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.863216 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqztt\" (UniqueName: \"kubernetes.io/projected/cc3131c6-aa28-4f44-89eb-6f1c6bf0918c-kube-api-access-zqztt\") pod \"node-ca-dj9r4\" (UID: \"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c\") " pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:11.863316 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.863224 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqq5\" (UniqueName: \"kubernetes.io/projected/f990b6d8-ab00-4194-93eb-1902e6f87a24-kube-api-access-qrqq5\") pod \"multus-additional-cni-plugins-xmlvx\" (UID: \"f990b6d8-ab00-4194-93eb-1902e6f87a24\") " pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:11.864475 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:11.864457 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9dw6\" (UniqueName: \"kubernetes.io/projected/4315fe49-5816-45ab-b892-55c089d2f273-kube-api-access-k9dw6\") pod \"ovnkube-node-v9w2m\" (UID: \"4315fe49-5816-45ab-b892-55c089d2f273\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:12.036577 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.036465 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" May 21 15:38:12.042312 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.042286 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9gn9g" May 21 15:38:12.050883 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.050851 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" May 21 15:38:12.055570 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.055543 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:12.062065 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.062044 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dj9r4" May 21 15:38:12.068377 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.068359 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r2wqq" May 21 15:38:12.074903 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.074880 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x976d" May 21 15:38:12.081480 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.081463 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" May 21 15:38:12.086071 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.086053 2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:38:12.086071 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.086063 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:12.088107 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.088088 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:38:12.354453 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.354384 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:12.354578 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:12.354497 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:12.354578 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:12.354553 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs podName:3762df41-6506-4248-a95a-369c904c6404 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:13.354539621 +0000 UTC m=+4.099212788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs") pod "network-metrics-daemon-k8ngt" (UID: "3762df41-6506-4248-a95a-369c904c6404") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:12.455724 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.455695 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:12.455863 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:12.455846 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:38:12.455907 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:12.455868 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:38:12.455907 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:12.455878 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wdgbb for pod openshift-network-diagnostics/network-check-target-5bm4d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:12.456004 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:12.455942 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb podName:10c555ff-301c-4c19-9e26-919eca7c10e7 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:13.455912404 +0000 UTC m=+4.200585570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdgbb" (UniqueName: "kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb") pod "network-check-target-5bm4d" (UID: "10c555ff-301c-4c19-9e26-919eca7c10e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:12.457857 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.457831 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7257125a_9c7c_4337_a076_edad273a3907.slice/crio-f03327e0ca4d4abef8ff8c244126c3cb8dffb045d07067f817d1b0fa919026e2 WatchSource:0}: Error finding container f03327e0ca4d4abef8ff8c244126c3cb8dffb045d07067f817d1b0fa919026e2: Status 404 returned error can't find the container with id f03327e0ca4d4abef8ff8c244126c3cb8dffb045d07067f817d1b0fa919026e2 May 21 15:38:12.459935 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.459894 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3131c6_aa28_4f44_89eb_6f1c6bf0918c.slice/crio-9673abeb1e7ced3603f9acd382b4d16a212cabee7e2f7d807da0df19f6d0e012 WatchSource:0}: Error finding container 9673abeb1e7ced3603f9acd382b4d16a212cabee7e2f7d807da0df19f6d0e012: Status 404 returned error can't find the container with id 9673abeb1e7ced3603f9acd382b4d16a212cabee7e2f7d807da0df19f6d0e012 May 21 15:38:12.462539 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.462517 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d20b143_e9dd_4091_b94c_eab9f4b3795e.slice/crio-0218811e9d4756c479598ad8525ab2fab155069da9a9df174d45d9fb7fd1e0dd WatchSource:0}: Error finding container 0218811e9d4756c479598ad8525ab2fab155069da9a9df174d45d9fb7fd1e0dd: Status 404 returned error can't find the container with id 0218811e9d4756c479598ad8525ab2fab155069da9a9df174d45d9fb7fd1e0dd May 21 15:38:12.463353 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.463329 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf990b6d8_ab00_4194_93eb_1902e6f87a24.slice/crio-9cda81afdd33a80abc6f367b95fef417a06d25c7432a456e0cd5ced0babc78ed WatchSource:0}: Error finding container 9cda81afdd33a80abc6f367b95fef417a06d25c7432a456e0cd5ced0babc78ed: Status 404 returned error can't find the container with id 9cda81afdd33a80abc6f367b95fef417a06d25c7432a456e0cd5ced0babc78ed May 21 15:38:12.464700 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.464641 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda925a804_0977_4537_af01_3193b0e87ac8.slice/crio-df5be5041b915d63108175f4c5a3ab1222746d35553262b44ab51362c776d0eb WatchSource:0}: Error finding container df5be5041b915d63108175f4c5a3ab1222746d35553262b44ab51362c776d0eb: Status 404 returned error can't find the container with id df5be5041b915d63108175f4c5a3ab1222746d35553262b44ab51362c776d0eb May 21 15:38:12.465327 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.465290 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a09080_dfa9_4903_8dbe_3c1ff4646437.slice/crio-9ae4d964161cf5dffd35a26f49fb6ff6fd5a04e12477a47487cabe688d296d4f WatchSource:0}: Error finding container 9ae4d964161cf5dffd35a26f49fb6ff6fd5a04e12477a47487cabe688d296d4f: Status 404 returned error can't find the container with id 9ae4d964161cf5dffd35a26f49fb6ff6fd5a04e12477a47487cabe688d296d4f May 21 15:38:12.467137 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.467105 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8d11a9_bde0_41a2_bc94_650fbc9fd0a8.slice/crio-4954030861d485849970f318907dbc555973d33e74fd979547504434445efdac WatchSource:0}: Error finding container 4954030861d485849970f318907dbc555973d33e74fd979547504434445efdac: Status 404 returned error can't find the container with id 4954030861d485849970f318907dbc555973d33e74fd979547504434445efdac May 21 15:38:12.469185 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.468600 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cd2105_3dc4_4cf2_98ff_29cc4c243ff8.slice/crio-c6600460d373ddd5ed1ae882430b14f0c522224e983dd9fe23e791044354906b WatchSource:0}: Error finding container c6600460d373ddd5ed1ae882430b14f0c522224e983dd9fe23e791044354906b: Status 404 returned error can't find the container with id c6600460d373ddd5ed1ae882430b14f0c522224e983dd9fe23e791044354906b May 21 15:38:12.469540 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:38:12.469496 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4315fe49_5816_45ab_b892_55c089d2f273.slice/crio-20311efca26b7f9e6a37df36da4a0ea30320b98205a0405892dbd11fa4cce6d3 WatchSource:0}: Error finding container 20311efca26b7f9e6a37df36da4a0ea30320b98205a0405892dbd11fa4cce6d3: Status 404 returned error can't find the container with id 20311efca26b7f9e6a37df36da4a0ea30320b98205a0405892dbd11fa4cce6d3 May 21 15:38:12.815409 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.815373 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:33:10 +0000 UTC" deadline="2027-12-29 00:30:45.815727447 +0000 UTC" May 21 15:38:12.815409 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.815401 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14072h52m33.000328808s" May 21 15:38:12.867902 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.867876 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:12.868051 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:12.868022 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:12.874286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.874251 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"20311efca26b7f9e6a37df36da4a0ea30320b98205a0405892dbd11fa4cce6d3"} May 21 15:38:12.875334 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.875306 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" event={"ID":"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8","Type":"ContainerStarted","Data":"4954030861d485849970f318907dbc555973d33e74fd979547504434445efdac"} May 21 15:38:12.876476 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.876446 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x976d" event={"ID":"a925a804-0977-4537-af01-3193b0e87ac8","Type":"ContainerStarted","Data":"df5be5041b915d63108175f4c5a3ab1222746d35553262b44ab51362c776d0eb"} May 21 15:38:12.877570 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.877546 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-45jk6" event={"ID":"1d20b143-e9dd-4091-b94c-eab9f4b3795e","Type":"ContainerStarted","Data":"0218811e9d4756c479598ad8525ab2fab155069da9a9df174d45d9fb7fd1e0dd"} May 21 15:38:12.879650 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.879623 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dj9r4" event={"ID":"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c","Type":"ContainerStarted","Data":"9673abeb1e7ced3603f9acd382b4d16a212cabee7e2f7d807da0df19f6d0e012"} May 21 15:38:12.880928 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.880889 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9gn9g" event={"ID":"7257125a-9c7c-4337-a076-edad273a3907","Type":"ContainerStarted","Data":"f03327e0ca4d4abef8ff8c244126c3cb8dffb045d07067f817d1b0fa919026e2"} May 21 15:38:12.883068 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.882631 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" event={"ID":"6570d05f87a90cb80699b013db438d94","Type":"ContainerStarted","Data":"cd9769a6078e4da62541f2bc767f3703d480ef612043761c8df56f3e23b54b75"} May 21 15:38:12.883956 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.883898 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" event={"ID":"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8","Type":"ContainerStarted","Data":"c6600460d373ddd5ed1ae882430b14f0c522224e983dd9fe23e791044354906b"} May 21 15:38:12.885927 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.885890 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r2wqq" event={"ID":"89a09080-dfa9-4903-8dbe-3c1ff4646437","Type":"ContainerStarted","Data":"9ae4d964161cf5dffd35a26f49fb6ff6fd5a04e12477a47487cabe688d296d4f"} May 21 15:38:12.890696 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.890671 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerStarted","Data":"9cda81afdd33a80abc6f367b95fef417a06d25c7432a456e0cd5ced0babc78ed"} May 21 15:38:12.895809 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.895152 2556 generic.go:358] "Generic (PLEG): container finished" podID="08296e384a3c9a48ca5f1a078ded2555" containerID="128c784efcf6e60d164eb731a7bc4e76d2a840b9c00c3346c9401c0d4fb7689e" exitCode=0 May 21 15:38:12.895809 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.895186 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" event={"ID":"08296e384a3c9a48ca5f1a078ded2555","Type":"ContainerDied","Data":"128c784efcf6e60d164eb731a7bc4e76d2a840b9c00c3346c9401c0d4fb7689e"} May 21 15:38:12.899275 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:12.898310 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-52.ec2.internal" podStartSLOduration=1.898297755 podStartE2EDuration="1.898297755s" podCreationTimestamp="2026-05-21 15:38:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:38:12.898083554 +0000 UTC m=+3.642756743" watchObservedRunningTime="2026-05-21 15:38:12.898297755 +0000 UTC m=+3.642970944" May 21 15:38:13.362291 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:13.362212 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:13.362449 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:13.362408 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:13.362510 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:13.362471 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs podName:3762df41-6506-4248-a95a-369c904c6404 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:15.362452 +0000 UTC m=+6.107125171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs") pod "network-metrics-daemon-k8ngt" (UID: "3762df41-6506-4248-a95a-369c904c6404") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:13.462968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:13.462931 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:13.463127 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:13.463101 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:38:13.463127 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:13.463118 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:38:13.463243 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:13.463129 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wdgbb for pod openshift-network-diagnostics/network-check-target-5bm4d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:13.463243 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:13.463184 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb podName:10c555ff-301c-4c19-9e26-919eca7c10e7 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:15.463166602 +0000 UTC m=+6.207839776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdgbb" (UniqueName: "kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb") pod "network-check-target-5bm4d" (UID: "10c555ff-301c-4c19-9e26-919eca7c10e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:13.870734 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:13.870273 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:13.870734 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:13.870388 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:13.925216 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:13.925173 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" event={"ID":"08296e384a3c9a48ca5f1a078ded2555","Type":"ContainerStarted","Data":"533b9a665b44d4359dde40c569eb1f80583bc215d546a61c341c484f8b93924a"} May 21 15:38:14.868027 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:14.867994 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:14.868208 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:14.868151 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:15.377231 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:15.377140 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:15.377657 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:15.377332 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:15.377657 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:15.377439 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs podName:3762df41-6506-4248-a95a-369c904c6404 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:19.377416496 +0000 UTC m=+10.122089683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs") pod "network-metrics-daemon-k8ngt" (UID: "3762df41-6506-4248-a95a-369c904c6404") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:15.478494 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:15.478450 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:15.478664 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:15.478626 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:38:15.478664 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:15.478650 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:38:15.478664 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:15.478662 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wdgbb for pod openshift-network-diagnostics/network-check-target-5bm4d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:15.478809 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:15.478728 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb podName:10c555ff-301c-4c19-9e26-919eca7c10e7 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:19.478708496 +0000 UTC m=+10.223381680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdgbb" (UniqueName: "kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb") pod "network-check-target-5bm4d" (UID: "10c555ff-301c-4c19-9e26-919eca7c10e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:15.867692 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:15.867610 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:15.867851 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:15.867741 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:16.868135 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:16.868101 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:16.868590 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:16.868242 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:17.867759 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:17.867732 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:17.867959 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:17.867854 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:18.868457 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:18.868423 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:18.868908 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:18.868559 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:19.410034 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:19.410006 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:19.410204 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:19.410143 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:19.410266 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:19.410257 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs podName:3762df41-6506-4248-a95a-369c904c6404 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:27.410201567 +0000 UTC m=+18.154874738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs") pod "network-metrics-daemon-k8ngt" (UID: "3762df41-6506-4248-a95a-369c904c6404") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:19.511379 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:19.511083 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:19.511379 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:19.511285 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:38:19.511379 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:19.511303 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:38:19.511379 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:19.511316 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wdgbb for pod openshift-network-diagnostics/network-check-target-5bm4d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:19.511750 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:19.511679 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb podName:10c555ff-301c-4c19-9e26-919eca7c10e7 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:27.511355299 +0000 UTC m=+18.256028485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdgbb" (UniqueName: "kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb") pod "network-check-target-5bm4d" (UID: "10c555ff-301c-4c19-9e26-919eca7c10e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:19.869645 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:19.869568 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:19.870084 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:19.869676 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:20.868162 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:20.868127 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:20.868342 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:20.868276 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:21.868377 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:21.868245 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:21.868377 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:21.868371 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:22.868453 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:22.868367 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:22.868858 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:22.868509 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:23.868629 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:23.868597 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:23.869069 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:23.868719 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:24.868007 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:24.867974 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:24.868142 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:24.868105 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:25.868322 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:25.868288 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:25.868764 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:25.868417 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:26.868338 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:26.868306 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:26.868756 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:26.868424 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:27.473668 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:27.473637 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:27.473835 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:27.473760 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:27.473835 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:27.473816 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs podName:3762df41-6506-4248-a95a-369c904c6404 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:43.473798854 +0000 UTC m=+34.218472022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs") pod "network-metrics-daemon-k8ngt" (UID: "3762df41-6506-4248-a95a-369c904c6404") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:27.574546 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:27.574509 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:27.574725 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:27.574703 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:38:27.574798 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:27.574733 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:38:27.574798 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:27.574748 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wdgbb for pod openshift-network-diagnostics/network-check-target-5bm4d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:27.574878 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:27.574813 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb podName:10c555ff-301c-4c19-9e26-919eca7c10e7 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:43.574794014 +0000 UTC m=+34.319467187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdgbb" (UniqueName: "kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb") pod "network-check-target-5bm4d" (UID: "10c555ff-301c-4c19-9e26-919eca7c10e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:27.868559 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:27.868485 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:27.868995 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:27.868602 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:28.868122 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:28.868095 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:28.868267 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:28.868215 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:29.868284 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:29.868247 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:29.868719 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:29.868347 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:30.867836 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.867812 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:30.867937 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:30.867905 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:30.950673 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.950391 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9gn9g" event={"ID":"7257125a-9c7c-4337-a076-edad273a3907","Type":"ContainerStarted","Data":"41201dea6c36d5c5d0920b85571b0be4c7c4bd04b1e8c75d5d10f128b11b82ba"} May 21 15:38:30.951949 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.951903 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" event={"ID":"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8","Type":"ContainerStarted","Data":"e0640bd1b3132fcbf6741cdfb9a423b6cf7e71e286d208f2c8911976a9eb704e"} May 21 15:38:30.953325 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.953292 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerStarted","Data":"bea1e7249674b547f30cb7925b74a6b52dfb1ef6fa09ea80df0d7dcaabba03de"} May 21 15:38:30.955604 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.955578 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"778f00b6760b9627671b54abdc65ebe33530da91676157e7a2de7bdf73434020"} May 21 15:38:30.955702 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.955613 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"cda8af8c252193c23696bdfc73fdb14a636c02de52dfa8516e9341e77e3d83ba"} May 21 15:38:30.957309 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.957281 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" event={"ID":"2a8d11a9-bde0-41a2-bc94-650fbc9fd0a8","Type":"ContainerStarted","Data":"3c1d1578a6e5b3235e0bca91cb6fcdc40105f19d09bc24c9c0afc0dee35468e5"} May 21 15:38:30.958675 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.958651 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x976d" event={"ID":"a925a804-0977-4537-af01-3193b0e87ac8","Type":"ContainerStarted","Data":"964cd474060e204757c2d973a2de4c59d66828c93e067d4c9211d6ab619066aa"} May 21 15:38:30.959857 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.959838 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-45jk6" event={"ID":"1d20b143-e9dd-4091-b94c-eab9f4b3795e","Type":"ContainerStarted","Data":"b9e676809c32cfe9bf4196f3a9b269be1790bd1ecb2098c3fff71106826e2412"} May 21 15:38:30.961753 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.961220 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dj9r4" event={"ID":"cc3131c6-aa28-4f44-89eb-6f1c6bf0918c","Type":"ContainerStarted","Data":"9bae51072a1570ef7084d540a1894efbaca363caf9739de50ebf3ce0416b8a72"} May 21 15:38:30.969171 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.969131 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-52.ec2.internal" podStartSLOduration=19.969121336 podStartE2EDuration="19.969121336s" podCreationTimestamp="2026-05-21 15:38:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:38:13.940505216 +0000 UTC m=+4.685178404" watchObservedRunningTime="2026-05-21 15:38:30.969121336 +0000 UTC m=+21.713794524" May 21 15:38:30.969318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.969298 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-9gn9g" podStartSLOduration=3.839182607 podStartE2EDuration="21.9692928s" podCreationTimestamp="2026-05-21 15:38:09 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.459847401 +0000 UTC m=+3.204520571" lastFinishedPulling="2026-05-21 15:38:30.589957595 +0000 UTC m=+21.334630764" observedRunningTime="2026-05-21 15:38:30.968895816 +0000 UTC m=+21.713569004" watchObservedRunningTime="2026-05-21 15:38:30.9692928 +0000 UTC m=+21.713965988" May 21 15:38:30.985232 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:30.985180 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-x976d" podStartSLOduration=2.902481909 podStartE2EDuration="20.985163206s" podCreationTimestamp="2026-05-21 15:38:10 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.46839807 +0000 UTC m=+3.213071245" lastFinishedPulling="2026-05-21 15:38:30.551079365 +0000 UTC m=+21.295752542" observedRunningTime="2026-05-21 15:38:30.984671051 +0000 UTC m=+21.729344239" watchObservedRunningTime="2026-05-21 15:38:30.985163206 +0000 UTC m=+21.729836397" May 21 15:38:31.038427 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.038385 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6sl9b" podStartSLOduration=3.960273296 podStartE2EDuration="22.038370954s" podCreationTimestamp="2026-05-21 15:38:09 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.471619793 +0000 UTC m=+3.216292968" lastFinishedPulling="2026-05-21 15:38:30.549717445 +0000 UTC m=+21.294390626" observedRunningTime="2026-05-21 15:38:31.038196393 +0000 UTC m=+21.782869583" watchObservedRunningTime="2026-05-21 15:38:31.038370954 +0000 UTC m=+21.783044142" May 21 15:38:31.063612 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.063567 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-45jk6" podStartSLOduration=4.001724852 podStartE2EDuration="22.063548019s" podCreationTimestamp="2026-05-21 15:38:09 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.464192217 +0000 UTC m=+3.208865400" lastFinishedPulling="2026-05-21 15:38:30.52601539 +0000 UTC m=+21.270688567" observedRunningTime="2026-05-21 15:38:31.062902012 +0000 UTC m=+21.807575186" watchObservedRunningTime="2026-05-21 15:38:31.063548019 +0000 UTC m=+21.808221208" May 21 15:38:31.086292 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.086254 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dj9r4" podStartSLOduration=3.469968257 podStartE2EDuration="21.086237626s" podCreationTimestamp="2026-05-21 15:38:10 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.461857607 +0000 UTC m=+3.206530787" lastFinishedPulling="2026-05-21 15:38:30.078126989 +0000 UTC m=+20.822800156" observedRunningTime="2026-05-21 15:38:31.086099929 +0000 UTC m=+21.830773117" watchObservedRunningTime="2026-05-21 15:38:31.086237626 +0000 UTC m=+21.830910813" May 21 15:38:31.867842 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.867702 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:31.867963 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:31.867931 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:31.938400 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.938379 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 15:38:31.964977 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.964957 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:38:31.965258 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.965223 2556 generic.go:358] "Generic (PLEG): container finished" podID="4315fe49-5816-45ab-b892-55c089d2f273" containerID="778f00b6760b9627671b54abdc65ebe33530da91676157e7a2de7bdf73434020" exitCode=1 May 21 15:38:31.965300 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.965282 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerDied","Data":"778f00b6760b9627671b54abdc65ebe33530da91676157e7a2de7bdf73434020"} May 21 15:38:31.965339 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.965318 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"4f21b27f6c9d609980cc54c59cae6c461a7a2f8cd9c0ff6b7ac9f0acc9a8d07d"} May 21 15:38:31.965339 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.965335 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"db0002e6e41b260854639c8a105f6ac291df33da34eca4267a28b8f6b8247dba"} May 21 15:38:31.965426 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.965346 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"23d813bee2e078e3d8be748b078e3c0ed82965172900b9bf3584b72d08256e4f"} May 21 15:38:31.965426 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.965358 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"255f8af65bdbfa618d720793318d3998e1262aa93976b9b4c6f911f266e8aac7"} May 21 15:38:31.967121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.967101 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" event={"ID":"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8","Type":"ContainerStarted","Data":"5b0827ec42ecafdb1bae77e80455ba4aab7ef14dbeec957a5c0391881fbdc90f"} May 21 15:38:31.968325 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.968308 2556 generic.go:358] "Generic (PLEG): container finished" podID="f990b6d8-ab00-4194-93eb-1902e6f87a24" containerID="bea1e7249674b547f30cb7925b74a6b52dfb1ef6fa09ea80df0d7dcaabba03de" exitCode=0 May 21 15:38:31.968433 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:31.968408 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerDied","Data":"bea1e7249674b547f30cb7925b74a6b52dfb1ef6fa09ea80df0d7dcaabba03de"} May 21 15:38:32.808037 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:32.807942 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T15:38:31.938395636Z","UUID":"a77cad24-0cd8-4175-8bfc-deb7096f6c56","Handler":null,"Name":"","Endpoint":""} May 21 15:38:32.809632 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:32.809578 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 15:38:32.809632 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:32.809611 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 15:38:32.868465 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:32.868440 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:32.868601 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:32.868575 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:32.971654 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:32.971610 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r2wqq" event={"ID":"89a09080-dfa9-4903-8dbe-3c1ff4646437","Type":"ContainerStarted","Data":"7c1e5ae7fe4aadb26e2a1f5cd04113fe93e63d90469db9ee1baefd25235e8752"} May 21 15:38:32.990962 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:32.990905 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r2wqq" podStartSLOduration=4.933668059 podStartE2EDuration="22.990885246s" podCreationTimestamp="2026-05-21 15:38:10 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.468796885 +0000 UTC m=+3.213470054" lastFinishedPulling="2026-05-21 15:38:30.526014075 +0000 UTC m=+21.270687241" observedRunningTime="2026-05-21 15:38:32.990474277 +0000 UTC m=+23.735147465" watchObservedRunningTime="2026-05-21 15:38:32.990885246 +0000 UTC m=+23.735558433" May 21 15:38:33.867748 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:33.867716 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:33.867910 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:33.867824 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:33.976001 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:33.975976 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:38:33.976747 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:33.976383 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"93d200c0d083a938b03b26e575fc6c3f2970c2db4979351e11252eeb5ebd77ea"} May 21 15:38:33.978287 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:33.978257 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" event={"ID":"b4cd2105-3dc4-4cf2-98ff-29cc4c243ff8","Type":"ContainerStarted","Data":"d0cdaa3a9015ccb13e58927e1b74f9bec157e046af7df0a8c4a6fb04e8c65e0a"} May 21 15:38:34.198820 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:34.198744 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:34.199450 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:34.199426 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:34.220468 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:34.220426 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4kvg" podStartSLOduration=4.612684832 podStartE2EDuration="25.22041451s" podCreationTimestamp="2026-05-21 15:38:09 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.471965858 +0000 UTC m=+3.216639024" lastFinishedPulling="2026-05-21 15:38:33.079695522 +0000 UTC m=+23.824368702" observedRunningTime="2026-05-21 15:38:34.004964626 +0000 UTC m=+24.749637815" watchObservedRunningTime="2026-05-21 15:38:34.22041451 +0000 UTC m=+24.965087697" May 21 15:38:34.867511 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:34.867479 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:34.867689 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:34.867597 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:34.980234 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:34.980206 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:34.981243 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:34.981208 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-45jk6" May 21 15:38:35.867973 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:35.867892 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:35.868119 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:35.868010 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:36.868768 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:36.868536 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:36.869320 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:36.868852 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:36.985031 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:36.984995 2556 generic.go:358] "Generic (PLEG): container finished" podID="f990b6d8-ab00-4194-93eb-1902e6f87a24" containerID="2cd78d40b999d9c263a3a757405e1ff6a057834ba5510b9aa1935b9a38e909bf" exitCode=0 May 21 15:38:36.985031 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:36.985025 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerDied","Data":"2cd78d40b999d9c263a3a757405e1ff6a057834ba5510b9aa1935b9a38e909bf"} May 21 15:38:36.988562 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:36.988542 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:38:36.988992 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:36.988963 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"09b8d21b35466002e972db8cd098bd632ec15b49adf8ed30cba847177718e4e1"} May 21 15:38:36.989380 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:36.989360 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:36.989455 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:36.989390 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:36.989544 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:36.989525 2556 scope.go:117] "RemoveContainer" containerID="778f00b6760b9627671b54abdc65ebe33530da91676157e7a2de7bdf73434020" May 21 15:38:37.006905 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:37.006876 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:37.007338 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:37.007323 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:37.152881 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:37.152832 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:38:37.868571 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:37.868311 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:37.868699 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:37.868625 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:37.993707 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:37.993684 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:38:37.994104 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:37.994081 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" event={"ID":"4315fe49-5816-45ab-b892-55c089d2f273","Type":"ContainerStarted","Data":"1164fdc025151dfc310b57c50da9e3a707dda47903b905c95af8e6fbfada04ab"} May 21 15:38:37.995910 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:37.995888 2556 generic.go:358] "Generic (PLEG): container finished" podID="f990b6d8-ab00-4194-93eb-1902e6f87a24" containerID="3de40b22f5babb540203e38ab05fba9c1cf99c97746444571bfc74be3b4aa08e" exitCode=0 May 21 15:38:37.996025 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:37.995930 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerDied","Data":"3de40b22f5babb540203e38ab05fba9c1cf99c97746444571bfc74be3b4aa08e"} May 21 15:38:38.050583 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:38.050539 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" podStartSLOduration=9.94974032 podStartE2EDuration="28.050524091s" podCreationTimestamp="2026-05-21 15:38:10 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.472045431 +0000 UTC m=+3.216718608" lastFinishedPulling="2026-05-21 15:38:30.572829207 +0000 UTC m=+21.317502379" observedRunningTime="2026-05-21 15:38:38.049314873 +0000 UTC m=+28.793988061" watchObservedRunningTime="2026-05-21 15:38:38.050524091 +0000 UTC m=+28.795197280" May 21 15:38:38.294242 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:38.294201 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5bm4d"] May 21 15:38:38.294446 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:38.294319 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:38.294446 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:38.294434 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:38.297103 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:38.297079 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k8ngt"] May 21 15:38:38.297420 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:38.297194 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:38.297420 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:38.297293 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:38.999416 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:38.999344 2556 generic.go:358] "Generic (PLEG): container finished" podID="f990b6d8-ab00-4194-93eb-1902e6f87a24" containerID="e17e1b75725678beade2bafe3215bb968170416031d311432f74953e694623a8" exitCode=0 May 21 15:38:38.999996 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:38.999434 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerDied","Data":"e17e1b75725678beade2bafe3215bb968170416031d311432f74953e694623a8"} May 21 15:38:39.868892 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:39.868811 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:39.869035 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:39.868954 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:39.869084 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:39.869026 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:39.869227 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:39.869192 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:41.868439 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:41.868361 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:41.868990 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:41.868489 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bm4d" podUID="10c555ff-301c-4c19-9e26-919eca7c10e7" May 21 15:38:41.868990 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:41.868578 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:41.868990 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:41.868715 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8ngt" podUID="3762df41-6506-4248-a95a-369c904c6404" May 21 15:38:43.500657 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.500358 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:43.500657 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.500516 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:43.501213 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.501075 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs podName:3762df41-6506-4248-a95a-369c904c6404 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:15.501047124 +0000 UTC m=+66.245720355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs") pod "network-metrics-daemon-k8ngt" (UID: "3762df41-6506-4248-a95a-369c904c6404") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:38:43.588892 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.588860 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-52.ec2.internal" event="NodeReady" May 21 15:38:43.589088 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.589030 2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 15:38:43.601781 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.601755 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:43.601893 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.601873 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:38:43.601893 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.601889 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:38:43.602005 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.601901 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wdgbb for pod openshift-network-diagnostics/network-check-target-5bm4d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:43.602005 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.601968 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb podName:10c555ff-301c-4c19-9e26-919eca7c10e7 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:15.601951909 +0000 UTC m=+66.346625079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdgbb" (UniqueName: "kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb") pod "network-check-target-5bm4d" (UID: "10c555ff-301c-4c19-9e26-919eca7c10e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:38:43.653236 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.653208 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s2xdp"] May 21 15:38:43.657724 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.657702 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:43.658632 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.658611 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j6cnb"] May 21 15:38:43.660543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.660518 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 15:38:43.660637 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.660573 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-47t49\"" May 21 15:38:43.661121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.661105 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 15:38:43.661220 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.661171 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 15:38:43.661833 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.661814 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.666308 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.666287 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 15:38:43.666308 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.666306 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 15:38:43.666706 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.666690 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n8nx8\"" May 21 15:38:43.675703 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.675684 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2xdp"] May 21 15:38:43.680038 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.680021 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j6cnb"] May 21 15:38:43.802723 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.802691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jthj\" (UniqueName: \"kubernetes.io/projected/a40b4ecc-e278-48c4-bbb4-69346bfde543-kube-api-access-9jthj\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.802935 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.802744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:43.802935 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.802800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pl6p\" (UniqueName: \"kubernetes.io/projected/8889c4ae-38a1-493a-9edb-afe43dce4b4c-kube-api-access-5pl6p\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:43.802935 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.802847 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a40b4ecc-e278-48c4-bbb4-69346bfde543-tmp-dir\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.802935 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.802878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.803156 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.802976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a40b4ecc-e278-48c4-bbb4-69346bfde543-config-volume\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.868193 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.868165 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:38:43.868390 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.868367 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:38:43.871968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.871949 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 15:38:43.872481 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.872462 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 15:38:43.872750 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.872730 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xrjpb\"" May 21 15:38:43.873635 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.873615 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zgm4t\"" May 21 15:38:43.873737 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.873718 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 15:38:43.904008 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.903982 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:43.904116 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.904020 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pl6p\" (UniqueName: \"kubernetes.io/projected/8889c4ae-38a1-493a-9edb-afe43dce4b4c-kube-api-access-5pl6p\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:43.904116 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.904054 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a40b4ecc-e278-48c4-bbb4-69346bfde543-tmp-dir\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.904116 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.904081 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.904116 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.904108 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:38:43.904312 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.904180 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert podName:8889c4ae-38a1-493a-9edb-afe43dce4b4c nodeName:}" failed. No retries permitted until 2026-05-21 15:38:44.404159458 +0000 UTC m=+35.148832643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert") pod "ingress-canary-s2xdp" (UID: "8889c4ae-38a1-493a-9edb-afe43dce4b4c") : secret "canary-serving-cert" not found May 21 15:38:43.904312 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.904202 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:38:43.904312 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:43.904252 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls podName:a40b4ecc-e278-48c4-bbb4-69346bfde543 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:44.404236258 +0000 UTC m=+35.148909437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls") pod "dns-default-j6cnb" (UID: "a40b4ecc-e278-48c4-bbb4-69346bfde543") : secret "dns-default-metrics-tls" not found May 21 15:38:43.904606 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.904311 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a40b4ecc-e278-48c4-bbb4-69346bfde543-config-volume\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.904606 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.904352 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jthj\" (UniqueName: \"kubernetes.io/projected/a40b4ecc-e278-48c4-bbb4-69346bfde543-kube-api-access-9jthj\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.904606 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.904411 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a40b4ecc-e278-48c4-bbb4-69346bfde543-tmp-dir\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.904775 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.904753 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a40b4ecc-e278-48c4-bbb4-69346bfde543-config-volume\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.927860 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.927838 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jthj\" (UniqueName: \"kubernetes.io/projected/a40b4ecc-e278-48c4-bbb4-69346bfde543-kube-api-access-9jthj\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:43.928744 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:43.928724 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pl6p\" (UniqueName: \"kubernetes.io/projected/8889c4ae-38a1-493a-9edb-afe43dce4b4c-kube-api-access-5pl6p\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:44.409526 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:44.409484 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:44.409714 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:44.409622 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:44.409714 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:44.409633 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:38:44.409714 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:44.409704 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert podName:8889c4ae-38a1-493a-9edb-afe43dce4b4c nodeName:}" failed. No retries permitted until 2026-05-21 15:38:45.40968375 +0000 UTC m=+36.154356955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert") pod "ingress-canary-s2xdp" (UID: "8889c4ae-38a1-493a-9edb-afe43dce4b4c") : secret "canary-serving-cert" not found May 21 15:38:44.409874 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:44.409760 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:38:44.409874 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:44.409833 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls podName:a40b4ecc-e278-48c4-bbb4-69346bfde543 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:45.409813872 +0000 UTC m=+36.154487041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls") pod "dns-default-j6cnb" (UID: "a40b4ecc-e278-48c4-bbb4-69346bfde543") : secret "dns-default-metrics-tls" not found May 21 15:38:45.417010 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:45.416976 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:45.417372 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:45.417021 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:45.417372 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:45.417114 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:38:45.417372 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:45.417125 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:38:45.417372 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:45.417177 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert podName:8889c4ae-38a1-493a-9edb-afe43dce4b4c nodeName:}" failed. No retries permitted until 2026-05-21 15:38:47.417160772 +0000 UTC m=+38.161833943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert") pod "ingress-canary-s2xdp" (UID: "8889c4ae-38a1-493a-9edb-afe43dce4b4c") : secret "canary-serving-cert" not found May 21 15:38:45.417372 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:45.417198 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls podName:a40b4ecc-e278-48c4-bbb4-69346bfde543 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:47.417192274 +0000 UTC m=+38.161865440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls") pod "dns-default-j6cnb" (UID: "a40b4ecc-e278-48c4-bbb4-69346bfde543") : secret "dns-default-metrics-tls" not found May 21 15:38:46.014141 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:46.014108 2556 generic.go:358] "Generic (PLEG): container finished" podID="f990b6d8-ab00-4194-93eb-1902e6f87a24" containerID="b508dd5f20ea679f8957a26ec3263a2582a2753aaf977536577565fdeb77ef2b" exitCode=0 May 21 15:38:46.014290 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:46.014168 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerDied","Data":"b508dd5f20ea679f8957a26ec3263a2582a2753aaf977536577565fdeb77ef2b"} May 21 15:38:47.018420 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:47.018390 2556 generic.go:358] "Generic (PLEG): container finished" podID="f990b6d8-ab00-4194-93eb-1902e6f87a24" containerID="cb9255f6b2b73f8bceb3c50d848bf2da6db9db9d688fe103e01798d43d1f2d9d" exitCode=0 May 21 15:38:47.018783 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:47.018431 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerDied","Data":"cb9255f6b2b73f8bceb3c50d848bf2da6db9db9d688fe103e01798d43d1f2d9d"} May 21 15:38:47.433217 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:47.433143 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:47.433217 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:47.433187 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:47.433378 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:47.433288 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:38:47.433378 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:47.433345 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls podName:a40b4ecc-e278-48c4-bbb4-69346bfde543 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:51.433331486 +0000 UTC m=+42.178004656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls") pod "dns-default-j6cnb" (UID: "a40b4ecc-e278-48c4-bbb4-69346bfde543") : secret "dns-default-metrics-tls" not found May 21 15:38:47.433449 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:47.433288 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:38:47.433449 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:47.433414 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert podName:8889c4ae-38a1-493a-9edb-afe43dce4b4c nodeName:}" failed. No retries permitted until 2026-05-21 15:38:51.43340354 +0000 UTC m=+42.178076723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert") pod "ingress-canary-s2xdp" (UID: "8889c4ae-38a1-493a-9edb-afe43dce4b4c") : secret "canary-serving-cert" not found May 21 15:38:48.022651 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:48.022619 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" event={"ID":"f990b6d8-ab00-4194-93eb-1902e6f87a24","Type":"ContainerStarted","Data":"4a2cb8c91dfbd0d730505728f064a6291d2f91beb5ec735e1ac3f636fffb8b9d"} May 21 15:38:51.460827 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:51.460791 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:51.460827 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:51.460834 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:51.461303 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:51.460940 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:38:51.461303 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:51.461001 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert podName:8889c4ae-38a1-493a-9edb-afe43dce4b4c nodeName:}" failed. No retries permitted until 2026-05-21 15:38:59.460985249 +0000 UTC m=+50.205658429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert") pod "ingress-canary-s2xdp" (UID: "8889c4ae-38a1-493a-9edb-afe43dce4b4c") : secret "canary-serving-cert" not found May 21 15:38:51.461303 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:51.460947 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:38:51.461303 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:51.461070 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls podName:a40b4ecc-e278-48c4-bbb4-69346bfde543 nodeName:}" failed. No retries permitted until 2026-05-21 15:38:59.461057344 +0000 UTC m=+50.205730515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls") pod "dns-default-j6cnb" (UID: "a40b4ecc-e278-48c4-bbb4-69346bfde543") : secret "dns-default-metrics-tls" not found May 21 15:38:59.513528 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:59.513490 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:38:59.513528 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:38:59.513536 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:38:59.514024 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:59.513635 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:38:59.514024 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:59.513640 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:38:59.514024 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:59.513698 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls podName:a40b4ecc-e278-48c4-bbb4-69346bfde543 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:15.513681942 +0000 UTC m=+66.258355114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls") pod "dns-default-j6cnb" (UID: "a40b4ecc-e278-48c4-bbb4-69346bfde543") : secret "dns-default-metrics-tls" not found May 21 15:38:59.514024 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:38:59.513714 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert podName:8889c4ae-38a1-493a-9edb-afe43dce4b4c nodeName:}" failed. No retries permitted until 2026-05-21 15:39:15.513706803 +0000 UTC m=+66.258379968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert") pod "ingress-canary-s2xdp" (UID: "8889c4ae-38a1-493a-9edb-afe43dce4b4c") : secret "canary-serving-cert" not found May 21 15:39:06.906628 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.906576 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xmlvx" podStartSLOduration=24.431512482 podStartE2EDuration="56.906562428s" podCreationTimestamp="2026-05-21 15:38:10 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.465243994 +0000 UTC m=+3.209917168" lastFinishedPulling="2026-05-21 15:38:44.940293929 +0000 UTC m=+35.684967114" observedRunningTime="2026-05-21 15:38:48.06750377 +0000 UTC m=+38.812176958" watchObservedRunningTime="2026-05-21 15:39:06.906562428 +0000 UTC m=+57.651235615" May 21 15:39:06.907028 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.906876 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l"] May 21 15:39:06.943562 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.943536 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-pwpzw"] May 21 15:39:06.943721 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.943701 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:06.957401 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.957384 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 15:39:06.957514 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.957383 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-hb7mh"] May 21 15:39:06.957514 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.957454 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:06.958635 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.958617 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 15:39:06.958786 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.958771 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 15:39:06.960346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.960109 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6ff27\"" May 21 15:39:06.960346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.960232 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 15:39:06.979324 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.979299 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l"] May 21 15:39:06.979324 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.979323 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-pwpzw"] May 21 15:39:06.979469 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.979406 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:06.987533 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.987514 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 15:39:06.987609 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.987516 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 15:39:06.987811 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.987796 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 15:39:06.987811 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.987802 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 15:39:06.987951 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.987835 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 15:39:06.988281 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.988269 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6q654\"" May 21 15:39:06.989907 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.989887 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 15:39:06.992469 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.992443 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7d4dw\"" May 21 15:39:06.993526 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.993505 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-hb7mh"] May 21 15:39:06.993526 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.993518 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 15:39:06.993639 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.993528 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 15:39:06.995032 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:06.995015 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 15:39:07.008443 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.008417 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz"] May 21 15:39:07.013469 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.013451 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 15:39:07.029467 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.029452 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7885686ccd-tvpmg"] May 21 15:39:07.029594 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.029580 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:07.033201 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.033186 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 15:39:07.035725 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.035704 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-287z8\"" May 21 15:39:07.053483 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.053463 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz"] May 21 15:39:07.053483 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.053482 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7885686ccd-tvpmg"] May 21 15:39:07.053588 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.053557 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.055220 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.055199 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 15:39:07.059050 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.059033 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 15:39:07.059201 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.059077 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 15:39:07.059286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.059269 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8khzk\"" May 21 15:39:07.059348 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.059332 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 15:39:07.064481 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hg8\" (UniqueName: \"kubernetes.io/projected/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-kube-api-access-z5hg8\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.064566 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064501 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.064566 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.064634 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e980e0-35d2-48ec-a1a1-c385cf825793-service-ca-bundle\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.064666 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064653 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e980e0-35d2-48ec-a1a1-c385cf825793-tmp\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.064704 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk5jv\" (UniqueName: \"kubernetes.io/projected/a6e980e0-35d2-48ec-a1a1-c385cf825793-kube-api-access-fk5jv\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.064737 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6e980e0-35d2-48ec-a1a1-c385cf825793-snapshots\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.064768 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064743 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e980e0-35d2-48ec-a1a1-c385cf825793-serving-cert\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.064798 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.064768 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e980e0-35d2-48ec-a1a1-c385cf825793-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.070748 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.070732 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 15:39:07.079448 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.079427 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 15:39:07.142843 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.142819 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf"] May 21 15:39:07.165287 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165238 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hg8\" (UniqueName: \"kubernetes.io/projected/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-kube-api-access-z5hg8\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.165287 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165277 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.165443 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165294 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.165443 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-bound-sa-token\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.165443 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.165419 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 15:39:07.165579 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:07.165579 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.165477 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls podName:ff6526b7-8014-45ef-9b1c-c1a1d801fd95 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:07.665463142 +0000 UTC m=+58.410136343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-s7n8l" (UID: "ff6526b7-8014-45ef-9b1c-c1a1d801fd95") : secret "cluster-monitoring-operator-tls" not found May 21 15:39:07.165579 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lzr5\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-kube-api-access-4lzr5\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.165579 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-trusted-ca\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.165579 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e588f33-6073-438c-9a8b-cb75bdf7a38f-trusted-ca\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-registry-certificates\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165624 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e980e0-35d2-48ec-a1a1-c385cf825793-service-ca-bundle\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165640 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp79r\" (UniqueName: \"kubernetes.io/projected/e4dfe694-eeb6-4080-80fb-26921ad4e769-kube-api-access-hp79r\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165712 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e980e0-35d2-48ec-a1a1-c385cf825793-tmp\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165729 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fk5jv\" (UniqueName: \"kubernetes.io/projected/a6e980e0-35d2-48ec-a1a1-c385cf825793-kube-api-access-fk5jv\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e588f33-6073-438c-9a8b-cb75bdf7a38f-config\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xmxn\" (UniqueName: \"kubernetes.io/projected/9e588f33-6073-438c-9a8b-cb75bdf7a38f-kube-api-access-9xmxn\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.165799 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165791 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6e980e0-35d2-48ec-a1a1-c385cf825793-snapshots\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165806 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/146c4bb5-b729-4a04-84e3-479a645b6255-ca-trust-extracted\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165825 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e980e0-35d2-48ec-a1a1-c385cf825793-serving-cert\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165841 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-image-registry-private-configuration\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165866 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e980e0-35d2-48ec-a1a1-c385cf825793-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-installation-pull-secrets\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165900 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e588f33-6073-438c-9a8b-cb75bdf7a38f-serving-cert\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.165997 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.166202 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e980e0-35d2-48ec-a1a1-c385cf825793-tmp\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.166216 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf" May 21 15:39:07.166318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.166282 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e980e0-35d2-48ec-a1a1-c385cf825793-service-ca-bundle\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.166775 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.166752 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6e980e0-35d2-48ec-a1a1-c385cf825793-snapshots\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.166841 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.166824 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e980e0-35d2-48ec-a1a1-c385cf825793-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.169190 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.169165 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e980e0-35d2-48ec-a1a1-c385cf825793-serving-cert\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.171097 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.171083 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p6zt5\"" May 21 15:39:07.178334 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.178316 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf"] May 21 15:39:07.199588 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.199565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hg8\" (UniqueName: \"kubernetes.io/projected/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-kube-api-access-z5hg8\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.200301 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.200278 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk5jv\" (UniqueName: \"kubernetes.io/projected/a6e980e0-35d2-48ec-a1a1-c385cf825793-kube-api-access-fk5jv\") pod \"insights-operator-78bdfb888c-pwpzw\" (UID: \"a6e980e0-35d2-48ec-a1a1-c385cf825793\") " pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.266318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266298 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" May 21 15:39:07.266449 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266432 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-image-registry-private-configuration\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.266503 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266460 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e588f33-6073-438c-9a8b-cb75bdf7a38f-serving-cert\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.266613 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266596 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-bound-sa-token\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.266685 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266637 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-trusted-ca\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.266685 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266670 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e588f33-6073-438c-9a8b-cb75bdf7a38f-config\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.266774 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266701 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/146c4bb5-b729-4a04-84e3-479a645b6255-ca-trust-extracted\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.266774 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266732 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-installation-pull-secrets\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.266870 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266779 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e588f33-6073-438c-9a8b-cb75bdf7a38f-trusted-ca\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.266870 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266810 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:07.266870 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266834 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lzr5\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-kube-api-access-4lzr5\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.266870 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266862 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-registry-certificates\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.267098 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266900 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hp79r\" (UniqueName: \"kubernetes.io/projected/e4dfe694-eeb6-4080-80fb-26921ad4e769-kube-api-access-hp79r\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:07.267098 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266953 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.267098 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.266991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb8wc\" (UniqueName: \"kubernetes.io/projected/f39873ef-8d8c-4180-9333-026cbf46f14a-kube-api-access-qb8wc\") pod \"network-check-source-7f44b6dd87-8qwhf\" (UID: \"f39873ef-8d8c-4180-9333-026cbf46f14a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf" May 21 15:39:07.267098 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.267044 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xmxn\" (UniqueName: \"kubernetes.io/projected/9e588f33-6073-438c-9a8b-cb75bdf7a38f-kube-api-access-9xmxn\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.267856 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.267414 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e588f33-6073-438c-9a8b-cb75bdf7a38f-config\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.267856 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.267513 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 15:39:07.267856 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.267558 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:39:07.267856 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.267576 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7885686ccd-tvpmg: secret "image-registry-tls" not found May 21 15:39:07.267856 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.267580 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls podName:e4dfe694-eeb6-4080-80fb-26921ad4e769 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:07.76756023 +0000 UTC m=+58.512233421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls") pod "cluster-samples-operator-697587599-lmvdz" (UID: "e4dfe694-eeb6-4080-80fb-26921ad4e769") : secret "samples-operator-tls" not found May 21 15:39:07.267856 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.267655 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls podName:146c4bb5-b729-4a04-84e3-479a645b6255 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:07.76763535 +0000 UTC m=+58.512308523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls") pod "image-registry-7885686ccd-tvpmg" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255") : secret "image-registry-tls" not found May 21 15:39:07.267856 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.267817 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e588f33-6073-438c-9a8b-cb75bdf7a38f-trusted-ca\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.268246 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.267883 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-registry-certificates\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.268246 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.268039 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/146c4bb5-b729-4a04-84e3-479a645b6255-ca-trust-extracted\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.268246 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.268041 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-trusted-ca\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.269039 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.269021 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e588f33-6073-438c-9a8b-cb75bdf7a38f-serving-cert\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.269542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.269524 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-image-registry-private-configuration\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.269864 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.269848 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-installation-pull-secrets\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.289292 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.289272 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-bound-sa-token\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.289741 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.289724 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lzr5\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-kube-api-access-4lzr5\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.292230 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.292204 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xmxn\" (UniqueName: \"kubernetes.io/projected/9e588f33-6073-438c-9a8b-cb75bdf7a38f-kube-api-access-9xmxn\") pod \"console-operator-76dff48d59-hb7mh\" (UID: \"9e588f33-6073-438c-9a8b-cb75bdf7a38f\") " pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.292230 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.292217 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp79r\" (UniqueName: \"kubernetes.io/projected/e4dfe694-eeb6-4080-80fb-26921ad4e769-kube-api-access-hp79r\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:07.367758 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.367725 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qb8wc\" (UniqueName: \"kubernetes.io/projected/f39873ef-8d8c-4180-9333-026cbf46f14a-kube-api-access-qb8wc\") pod \"network-check-source-7f44b6dd87-8qwhf\" (UID: \"f39873ef-8d8c-4180-9333-026cbf46f14a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf" May 21 15:39:07.377298 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.377269 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb8wc\" (UniqueName: \"kubernetes.io/projected/f39873ef-8d8c-4180-9333-026cbf46f14a-kube-api-access-qb8wc\") pod \"network-check-source-7f44b6dd87-8qwhf\" (UID: \"f39873ef-8d8c-4180-9333-026cbf46f14a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf" May 21 15:39:07.475713 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.475691 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-pwpzw"] May 21 15:39:07.477742 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.477728 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf" May 21 15:39:07.586939 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.586878 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:07.599057 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.599035 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf"] May 21 15:39:07.600731 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:07.600704 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39873ef_8d8c_4180_9333_026cbf46f14a.slice/crio-d9542eea753bb53c21c7c96ddc1b4b9c513f1e2d9be7a8706e8102d6723e4b2f WatchSource:0}: Error finding container d9542eea753bb53c21c7c96ddc1b4b9c513f1e2d9be7a8706e8102d6723e4b2f: Status 404 returned error can't find the container with id d9542eea753bb53c21c7c96ddc1b4b9c513f1e2d9be7a8706e8102d6723e4b2f May 21 15:39:07.670002 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.669973 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:07.670168 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.670105 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 15:39:07.670168 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.670159 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls podName:ff6526b7-8014-45ef-9b1c-c1a1d801fd95 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:08.670144451 +0000 UTC m=+59.414817618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-s7n8l" (UID: "ff6526b7-8014-45ef-9b1c-c1a1d801fd95") : secret "cluster-monitoring-operator-tls" not found May 21 15:39:07.728054 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.727992 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-hb7mh"] May 21 15:39:07.730528 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:07.730503 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e588f33_6073_438c_9a8b_cb75bdf7a38f.slice/crio-e6def59984b61df26713f1c0a6c0d4d7cdefc6285e6f5a447922f8f4f6ee87bb WatchSource:0}: Error finding container e6def59984b61df26713f1c0a6c0d4d7cdefc6285e6f5a447922f8f4f6ee87bb: Status 404 returned error can't find the container with id e6def59984b61df26713f1c0a6c0d4d7cdefc6285e6f5a447922f8f4f6ee87bb May 21 15:39:07.771103 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.771079 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:07.771190 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:07.771112 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:07.771245 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.771232 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 15:39:07.771280 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.771257 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:39:07.771280 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.771272 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7885686ccd-tvpmg: secret "image-registry-tls" not found May 21 15:39:07.771341 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.771303 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls podName:e4dfe694-eeb6-4080-80fb-26921ad4e769 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:08.771283655 +0000 UTC m=+59.515956836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls") pod "cluster-samples-operator-697587599-lmvdz" (UID: "e4dfe694-eeb6-4080-80fb-26921ad4e769") : secret "samples-operator-tls" not found May 21 15:39:07.771341 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:07.771318 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls podName:146c4bb5-b729-4a04-84e3-479a645b6255 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:08.771311713 +0000 UTC m=+59.515984878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls") pod "image-registry-7885686ccd-tvpmg" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255") : secret "image-registry-tls" not found May 21 15:39:08.060171 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:08.060121 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" event={"ID":"9e588f33-6073-438c-9a8b-cb75bdf7a38f","Type":"ContainerStarted","Data":"e6def59984b61df26713f1c0a6c0d4d7cdefc6285e6f5a447922f8f4f6ee87bb"} May 21 15:39:08.061158 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:08.061132 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" event={"ID":"a6e980e0-35d2-48ec-a1a1-c385cf825793","Type":"ContainerStarted","Data":"ca2858a9b2e2879f57f5c817f9143993b6ffe4a55bca206f5ec820cba425bbf8"} May 21 15:39:08.062196 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:08.062168 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf" event={"ID":"f39873ef-8d8c-4180-9333-026cbf46f14a","Type":"ContainerStarted","Data":"d9542eea753bb53c21c7c96ddc1b4b9c513f1e2d9be7a8706e8102d6723e4b2f"} May 21 15:39:08.678843 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:08.678794 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:08.679050 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:08.678984 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 15:39:08.679110 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:08.679067 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls podName:ff6526b7-8014-45ef-9b1c-c1a1d801fd95 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:10.679044758 +0000 UTC m=+61.423717947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-s7n8l" (UID: "ff6526b7-8014-45ef-9b1c-c1a1d801fd95") : secret "cluster-monitoring-operator-tls" not found May 21 15:39:08.779482 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:08.779447 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:08.779647 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:08.779500 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:08.779647 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:08.779596 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 15:39:08.779761 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:08.779665 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:39:08.779761 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:08.779679 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls podName:e4dfe694-eeb6-4080-80fb-26921ad4e769 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:10.779655857 +0000 UTC m=+61.524329053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls") pod "cluster-samples-operator-697587599-lmvdz" (UID: "e4dfe694-eeb6-4080-80fb-26921ad4e769") : secret "samples-operator-tls" not found May 21 15:39:08.779761 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:08.779683 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7885686ccd-tvpmg: secret "image-registry-tls" not found May 21 15:39:08.779761 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:08.779740 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls podName:146c4bb5-b729-4a04-84e3-479a645b6255 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:10.779721611 +0000 UTC m=+61.524394799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls") pod "image-registry-7885686ccd-tvpmg" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255") : secret "image-registry-tls" not found May 21 15:39:09.012516 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:09.012490 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9w2m" May 21 15:39:10.697559 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:10.697520 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:10.698111 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:10.697679 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 15:39:10.698111 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:10.697757 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls podName:ff6526b7-8014-45ef-9b1c-c1a1d801fd95 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:14.697735866 +0000 UTC m=+65.442409055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-s7n8l" (UID: "ff6526b7-8014-45ef-9b1c-c1a1d801fd95") : secret "cluster-monitoring-operator-tls" not found May 21 15:39:10.798449 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:10.798411 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:10.798681 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:10.798562 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:10.798681 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:10.798577 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:39:10.798681 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:10.798606 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7885686ccd-tvpmg: secret "image-registry-tls" not found May 21 15:39:10.798681 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:10.798669 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 15:39:10.798681 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:10.798682 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls podName:146c4bb5-b729-4a04-84e3-479a645b6255 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:14.798658074 +0000 UTC m=+65.543331281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls") pod "image-registry-7885686ccd-tvpmg" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255") : secret "image-registry-tls" not found May 21 15:39:10.798989 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:10.798726 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls podName:e4dfe694-eeb6-4080-80fb-26921ad4e769 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:14.798709769 +0000 UTC m=+65.543382952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls") pod "cluster-samples-operator-697587599-lmvdz" (UID: "e4dfe694-eeb6-4080-80fb-26921ad4e769") : secret "samples-operator-tls" not found May 21 15:39:12.071239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:12.071199 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf" event={"ID":"f39873ef-8d8c-4180-9333-026cbf46f14a","Type":"ContainerStarted","Data":"ea01021d26a1e3a02f180b0da2d9bebadebbc36d5411d8b5fcb8fd6748f4ae14"} May 21 15:39:12.072962 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:12.072936 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/0.log" May 21 15:39:12.073111 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:12.072981 2556 generic.go:358] "Generic (PLEG): container finished" podID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" containerID="19219c3366a34b7237a2719ce1133bcfea4bdbd66f7f701c53a25e66223a2165" exitCode=255 May 21 15:39:12.073111 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:12.073063 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" event={"ID":"9e588f33-6073-438c-9a8b-cb75bdf7a38f","Type":"ContainerDied","Data":"19219c3366a34b7237a2719ce1133bcfea4bdbd66f7f701c53a25e66223a2165"} May 21 15:39:12.073272 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:12.073254 2556 scope.go:117] "RemoveContainer" containerID="19219c3366a34b7237a2719ce1133bcfea4bdbd66f7f701c53a25e66223a2165" May 21 15:39:12.074444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:12.074424 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" event={"ID":"a6e980e0-35d2-48ec-a1a1-c385cf825793","Type":"ContainerStarted","Data":"d8ee9454a3fa874d40f35cf444454f00bc261ab25feecdbd6ea92bfc8b15a50f"} May 21 15:39:12.106214 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:12.106169 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8qwhf" podStartSLOduration=1.371168227 podStartE2EDuration="5.106154779s" podCreationTimestamp="2026-05-21 15:39:07 +0000 UTC" firstStartedPulling="2026-05-21 15:39:07.602495786 +0000 UTC m=+58.347168952" lastFinishedPulling="2026-05-21 15:39:11.337482324 +0000 UTC m=+62.082155504" observedRunningTime="2026-05-21 15:39:12.097683272 +0000 UTC m=+62.842356486" watchObservedRunningTime="2026-05-21 15:39:12.106154779 +0000 UTC m=+62.850827968" May 21 15:39:12.126760 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:12.126713 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" podStartSLOduration=2.267043429 podStartE2EDuration="6.126697915s" podCreationTimestamp="2026-05-21 15:39:06 +0000 UTC" firstStartedPulling="2026-05-21 15:39:07.481335842 +0000 UTC m=+58.226009007" lastFinishedPulling="2026-05-21 15:39:11.340990312 +0000 UTC m=+62.085663493" observedRunningTime="2026-05-21 15:39:12.125934879 +0000 UTC m=+62.870608070" watchObservedRunningTime="2026-05-21 15:39:12.126697915 +0000 UTC m=+62.871371108" May 21 15:39:13.077698 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:13.077667 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/1.log" May 21 15:39:13.078173 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:13.078156 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/0.log" May 21 15:39:13.078231 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:13.078202 2556 generic.go:358] "Generic (PLEG): container finished" podID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" containerID="428dd5a3fae8f3a97f358afe61a1edb27c90568b06e48f28d1b42efd4f461e62" exitCode=255 May 21 15:39:13.078317 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:13.078292 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" event={"ID":"9e588f33-6073-438c-9a8b-cb75bdf7a38f","Type":"ContainerDied","Data":"428dd5a3fae8f3a97f358afe61a1edb27c90568b06e48f28d1b42efd4f461e62"} May 21 15:39:13.078370 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:13.078336 2556 scope.go:117] "RemoveContainer" containerID="19219c3366a34b7237a2719ce1133bcfea4bdbd66f7f701c53a25e66223a2165" May 21 15:39:13.078805 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:13.078782 2556 scope.go:117] "RemoveContainer" containerID="428dd5a3fae8f3a97f358afe61a1edb27c90568b06e48f28d1b42efd4f461e62" May 21 15:39:13.078973 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:13.078956 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-hb7mh_openshift-console-operator(9e588f33-6073-438c-9a8b-cb75bdf7a38f)\"" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" podUID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" May 21 15:39:14.081325 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:14.081298 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/1.log" May 21 15:39:14.081691 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:14.081599 2556 scope.go:117] "RemoveContainer" containerID="428dd5a3fae8f3a97f358afe61a1edb27c90568b06e48f28d1b42efd4f461e62" May 21 15:39:14.081768 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:14.081751 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-hb7mh_openshift-console-operator(9e588f33-6073-438c-9a8b-cb75bdf7a38f)\"" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" podUID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" May 21 15:39:14.728869 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:14.728839 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:14.729027 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:14.728996 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 15:39:14.729080 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:14.729070 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls podName:ff6526b7-8014-45ef-9b1c-c1a1d801fd95 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:22.729051745 +0000 UTC m=+73.473724928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-s7n8l" (UID: "ff6526b7-8014-45ef-9b1c-c1a1d801fd95") : secret "cluster-monitoring-operator-tls" not found May 21 15:39:14.829534 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:14.829508 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:14.829657 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:14.829628 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:14.829717 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:14.829656 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:39:14.829717 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:14.829670 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7885686ccd-tvpmg: secret "image-registry-tls" not found May 21 15:39:14.829792 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:14.829720 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 15:39:14.829792 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:14.829723 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls podName:146c4bb5-b729-4a04-84e3-479a645b6255 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:22.829708229 +0000 UTC m=+73.574381408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls") pod "image-registry-7885686ccd-tvpmg" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255") : secret "image-registry-tls" not found May 21 15:39:14.829792 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:14.829773 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls podName:e4dfe694-eeb6-4080-80fb-26921ad4e769 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:22.829762128 +0000 UTC m=+73.574435302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls") pod "cluster-samples-operator-697587599-lmvdz" (UID: "e4dfe694-eeb6-4080-80fb-26921ad4e769") : secret "samples-operator-tls" not found May 21 15:39:15.398215 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.398184 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-k2tj6"] May 21 15:39:15.431822 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.431751 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-k2tj6"] May 21 15:39:15.431975 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.431872 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.435256 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.435236 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 15:39:15.435256 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.435251 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 15:39:15.436187 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.436170 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 15:39:15.436286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.436269 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 15:39:15.436376 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.436363 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zvskt\"" May 21 15:39:15.533429 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.533406 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6chlb\" (UniqueName: \"kubernetes.io/projected/8f08a364-7813-4c9f-96af-6e121800868a-kube-api-access-6chlb\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.533526 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.533436 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:39:15.533526 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.533456 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f08a364-7813-4c9f-96af-6e121800868a-signing-cabundle\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.533526 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.533503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f08a364-7813-4c9f-96af-6e121800868a-signing-key\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.533627 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:15.533545 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:39:15.533627 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.533555 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:39:15.533627 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:15.533601 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert podName:8889c4ae-38a1-493a-9edb-afe43dce4b4c nodeName:}" failed. No retries permitted until 2026-05-21 15:39:47.533588175 +0000 UTC m=+98.278261341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert") pod "ingress-canary-s2xdp" (UID: "8889c4ae-38a1-493a-9edb-afe43dce4b4c") : secret "canary-serving-cert" not found May 21 15:39:15.533749 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.533643 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:39:15.533749 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:15.533719 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:39:15.533749 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:15.533748 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls podName:a40b4ecc-e278-48c4-bbb4-69346bfde543 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:47.533740761 +0000 UTC m=+98.278413926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls") pod "dns-default-j6cnb" (UID: "a40b4ecc-e278-48c4-bbb4-69346bfde543") : secret "dns-default-metrics-tls" not found May 21 15:39:15.538236 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.538222 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 15:39:15.544486 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:15.544475 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 15:39:15.544531 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:15.544512 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs podName:3762df41-6506-4248-a95a-369c904c6404 nodeName:}" failed. No retries permitted until 2026-05-21 15:40:19.544501175 +0000 UTC m=+130.289174350 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs") pod "network-metrics-daemon-k8ngt" (UID: "3762df41-6506-4248-a95a-369c904c6404") : secret "metrics-daemon-secret" not found May 21 15:39:15.634104 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.634077 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6chlb\" (UniqueName: \"kubernetes.io/projected/8f08a364-7813-4c9f-96af-6e121800868a-kube-api-access-6chlb\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.634226 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.634115 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f08a364-7813-4c9f-96af-6e121800868a-signing-cabundle\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.634226 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.634134 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f08a364-7813-4c9f-96af-6e121800868a-signing-key\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.634226 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.634152 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:39:15.634725 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.634703 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f08a364-7813-4c9f-96af-6e121800868a-signing-cabundle\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.636475 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.636457 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f08a364-7813-4c9f-96af-6e121800868a-signing-key\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.636589 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.636571 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdgbb\" (UniqueName: \"kubernetes.io/projected/10c555ff-301c-4c19-9e26-919eca7c10e7-kube-api-access-wdgbb\") pod \"network-check-target-5bm4d\" (UID: \"10c555ff-301c-4c19-9e26-919eca7c10e7\") " pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:39:15.644684 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.644658 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6chlb\" (UniqueName: \"kubernetes.io/projected/8f08a364-7813-4c9f-96af-6e121800868a-kube-api-access-6chlb\") pod \"service-ca-67d667c7d-k2tj6\" (UID: \"8f08a364-7813-4c9f-96af-6e121800868a\") " pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.684759 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.684710 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xrjpb\"" May 21 15:39:15.689733 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.689721 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:39:15.739944 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.739907 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" May 21 15:39:15.815882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.815819 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5bm4d"] May 21 15:39:15.817678 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:15.817654 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c555ff_301c_4c19_9e26_919eca7c10e7.slice/crio-a30a10b2db9300b7281e601210c6fe5dff39c4d546442dd7941a2c1113f05747 WatchSource:0}: Error finding container a30a10b2db9300b7281e601210c6fe5dff39c4d546442dd7941a2c1113f05747: Status 404 returned error can't find the container with id a30a10b2db9300b7281e601210c6fe5dff39c4d546442dd7941a2c1113f05747 May 21 15:39:15.867032 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.867012 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-k2tj6"] May 21 15:39:15.875804 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:15.875781 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f08a364_7813_4c9f_96af_6e121800868a.slice/crio-1f6d91d55db1519d544565eb688689547142409b82fd49f1b14b94729f0a0425 WatchSource:0}: Error finding container 1f6d91d55db1519d544565eb688689547142409b82fd49f1b14b94729f0a0425: Status 404 returned error can't find the container with id 1f6d91d55db1519d544565eb688689547142409b82fd49f1b14b94729f0a0425 May 21 15:39:15.958346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:15.958295 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x976d_a925a804-0977-4537-af01-3193b0e87ac8/dns-node-resolver/0.log" May 21 15:39:16.085822 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:16.085792 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" event={"ID":"8f08a364-7813-4c9f-96af-6e121800868a","Type":"ContainerStarted","Data":"1f6d91d55db1519d544565eb688689547142409b82fd49f1b14b94729f0a0425"} May 21 15:39:16.087121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:16.087096 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5bm4d" event={"ID":"10c555ff-301c-4c19-9e26-919eca7c10e7","Type":"ContainerStarted","Data":"e6248628dad9107240f65d141f5878968d736a84d28f4660614cb4279cdb6663"} May 21 15:39:16.087121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:16.087122 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5bm4d" event={"ID":"10c555ff-301c-4c19-9e26-919eca7c10e7","Type":"ContainerStarted","Data":"a30a10b2db9300b7281e601210c6fe5dff39c4d546442dd7941a2c1113f05747"} May 21 15:39:16.087271 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:16.087243 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:39:16.119841 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:16.119798 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5bm4d" podStartSLOduration=66.119785305 podStartE2EDuration="1m6.119785305s" podCreationTimestamp="2026-05-21 15:38:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:39:16.118857731 +0000 UTC m=+66.863530920" watchObservedRunningTime="2026-05-21 15:39:16.119785305 +0000 UTC m=+66.864458493" May 21 15:39:16.561548 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:16.561518 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dj9r4_cc3131c6-aa28-4f44-89eb-6f1c6bf0918c/node-ca/0.log" May 21 15:39:17.587587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:17.587563 2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:17.587949 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:17.587599 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:17.588067 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:17.588051 2556 scope.go:117] "RemoveContainer" containerID="428dd5a3fae8f3a97f358afe61a1edb27c90568b06e48f28d1b42efd4f461e62" May 21 15:39:17.588240 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:17.588220 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-hb7mh_openshift-console-operator(9e588f33-6073-438c-9a8b-cb75bdf7a38f)\"" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" podUID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" May 21 15:39:18.094286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:18.094248 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" event={"ID":"8f08a364-7813-4c9f-96af-6e121800868a","Type":"ContainerStarted","Data":"759392c99ebdf4a853a7d8db94d2f182dc81a01db977c6408a7c3f29ed2f1d1a"} May 21 15:39:18.119960 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:18.119896 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-k2tj6" podStartSLOduration=1.439581462 podStartE2EDuration="3.119884262s" podCreationTimestamp="2026-05-21 15:39:15 +0000 UTC" firstStartedPulling="2026-05-21 15:39:15.877670496 +0000 UTC m=+66.622343679" lastFinishedPulling="2026-05-21 15:39:17.557973313 +0000 UTC m=+68.302646479" observedRunningTime="2026-05-21 15:39:18.119637308 +0000 UTC m=+68.864310497" watchObservedRunningTime="2026-05-21 15:39:18.119884262 +0000 UTC m=+68.864557451" May 21 15:39:22.790313 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.790193 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:22.790686 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:22.790338 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 15:39:22.790686 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:22.790400 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls podName:ff6526b7-8014-45ef-9b1c-c1a1d801fd95 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:38.790382679 +0000 UTC m=+89.535055865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-s7n8l" (UID: "ff6526b7-8014-45ef-9b1c-c1a1d801fd95") : secret "cluster-monitoring-operator-tls" not found May 21 15:39:22.890809 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.890783 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:22.890897 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.890815 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:22.893244 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.893217 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4dfe694-eeb6-4080-80fb-26921ad4e769-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmvdz\" (UID: \"e4dfe694-eeb6-4080-80fb-26921ad4e769\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:22.893340 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.893249 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"image-registry-7885686ccd-tvpmg\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:22.943198 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.943175 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-287z8\"" May 21 15:39:22.948266 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.948249 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" May 21 15:39:22.964848 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.964829 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8khzk\"" May 21 15:39:22.972369 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:22.972349 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:23.084295 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:23.084208 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz"] May 21 15:39:23.113773 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:23.113709 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7885686ccd-tvpmg"] May 21 15:39:23.121994 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:23.121961 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146c4bb5_b729_4a04_84e3_479a645b6255.slice/crio-e4a1a143d1a3c4be665257e248a9399c2a2bb12c4e585782007899a733f886e2 WatchSource:0}: Error finding container e4a1a143d1a3c4be665257e248a9399c2a2bb12c4e585782007899a733f886e2: Status 404 returned error can't find the container with id e4a1a143d1a3c4be665257e248a9399c2a2bb12c4e585782007899a733f886e2 May 21 15:39:24.115673 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:24.115631 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" event={"ID":"e4dfe694-eeb6-4080-80fb-26921ad4e769","Type":"ContainerStarted","Data":"fb4f846f04be027923819a510de81d81ebbdac2830c460f3dd0539e5ba002e58"} May 21 15:39:24.117282 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:24.117235 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" event={"ID":"146c4bb5-b729-4a04-84e3-479a645b6255","Type":"ContainerStarted","Data":"355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea"} May 21 15:39:24.117282 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:24.117265 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" event={"ID":"146c4bb5-b729-4a04-84e3-479a645b6255","Type":"ContainerStarted","Data":"e4a1a143d1a3c4be665257e248a9399c2a2bb12c4e585782007899a733f886e2"} May 21 15:39:24.117462 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:24.117377 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:24.147317 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:24.147269 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" podStartSLOduration=18.147252121 podStartE2EDuration="18.147252121s" podCreationTimestamp="2026-05-21 15:39:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:39:24.145101211 +0000 UTC m=+74.889774463" watchObservedRunningTime="2026-05-21 15:39:24.147252121 +0000 UTC m=+74.891925308" May 21 15:39:25.121632 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:25.121599 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" event={"ID":"e4dfe694-eeb6-4080-80fb-26921ad4e769","Type":"ContainerStarted","Data":"fd77fc79ca7cc10d7ecd5f720082ae9d0ab9f90f076ef4c2a2229eec2068aa29"} May 21 15:39:25.122002 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:25.121640 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" event={"ID":"e4dfe694-eeb6-4080-80fb-26921ad4e769","Type":"ContainerStarted","Data":"789622a0dbc80acae19618568d7259fad8888342e5b7f12de01437f85d049660"} May 21 15:39:25.143309 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:25.143229 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmvdz" podStartSLOduration=17.385161915 podStartE2EDuration="19.143214153s" podCreationTimestamp="2026-05-21 15:39:06 +0000 UTC" firstStartedPulling="2026-05-21 15:39:23.134041128 +0000 UTC m=+73.878714298" lastFinishedPulling="2026-05-21 15:39:24.892093356 +0000 UTC m=+75.636766536" observedRunningTime="2026-05-21 15:39:25.142696257 +0000 UTC m=+75.887369446" watchObservedRunningTime="2026-05-21 15:39:25.143214153 +0000 UTC m=+75.887887340" May 21 15:39:31.868227 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:31.868197 2556 scope.go:117] "RemoveContainer" containerID="428dd5a3fae8f3a97f358afe61a1edb27c90568b06e48f28d1b42efd4f461e62" May 21 15:39:32.139498 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:32.139447 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:39:32.139800 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:32.139783 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/1.log" May 21 15:39:32.139844 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:32.139818 2556 generic.go:358] "Generic (PLEG): container finished" podID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" containerID="a6a095a5f7856c815eab93a7ec0c490e24c54534c20e774e5c29fa3ba6cef159" exitCode=255 May 21 15:39:32.139882 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:32.139867 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" event={"ID":"9e588f33-6073-438c-9a8b-cb75bdf7a38f","Type":"ContainerDied","Data":"a6a095a5f7856c815eab93a7ec0c490e24c54534c20e774e5c29fa3ba6cef159"} May 21 15:39:32.139937 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:32.139897 2556 scope.go:117] "RemoveContainer" containerID="428dd5a3fae8f3a97f358afe61a1edb27c90568b06e48f28d1b42efd4f461e62" May 21 15:39:32.140179 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:32.140164 2556 scope.go:117] "RemoveContainer" containerID="a6a095a5f7856c815eab93a7ec0c490e24c54534c20e774e5c29fa3ba6cef159" May 21 15:39:32.140355 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:32.140335 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-hb7mh_openshift-console-operator(9e588f33-6073-438c-9a8b-cb75bdf7a38f)\"" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" podUID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" May 21 15:39:33.143834 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:33.143804 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:39:35.439550 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.439519 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n62hc"] May 21 15:39:35.442361 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.442344 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.446284 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.446265 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 15:39:35.446383 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.446322 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 15:39:35.446383 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.446351 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s8gwj\"" May 21 15:39:35.461445 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.461424 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n62hc"] May 21 15:39:35.466809 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.466789 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7885686ccd-tvpmg"] May 21 15:39:35.483636 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.483618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df43819b-2cc5-4790-b411-173db7cb6c16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.483705 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.483662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df43819b-2cc5-4790-b411-173db7cb6c16-data-volume\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.483764 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.483743 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df43819b-2cc5-4790-b411-173db7cb6c16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.483812 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.483799 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df43819b-2cc5-4790-b411-173db7cb6c16-crio-socket\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.483848 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.483825 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhqkj\" (UniqueName: \"kubernetes.io/projected/df43819b-2cc5-4790-b411-173db7cb6c16-kube-api-access-fhqkj\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.584418 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.584399 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df43819b-2cc5-4790-b411-173db7cb6c16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.584517 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.584438 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df43819b-2cc5-4790-b411-173db7cb6c16-crio-socket\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.584517 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.584457 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhqkj\" (UniqueName: \"kubernetes.io/projected/df43819b-2cc5-4790-b411-173db7cb6c16-kube-api-access-fhqkj\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.584517 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.584482 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df43819b-2cc5-4790-b411-173db7cb6c16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.584517 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.584512 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df43819b-2cc5-4790-b411-173db7cb6c16-data-volume\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.584698 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.584529 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df43819b-2cc5-4790-b411-173db7cb6c16-crio-socket\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.584829 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.584816 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df43819b-2cc5-4790-b411-173db7cb6c16-data-volume\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.584965 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.584943 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df43819b-2cc5-4790-b411-173db7cb6c16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.586597 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.586579 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df43819b-2cc5-4790-b411-173db7cb6c16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.600870 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.600848 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhqkj\" (UniqueName: \"kubernetes.io/projected/df43819b-2cc5-4790-b411-173db7cb6c16-kube-api-access-fhqkj\") pod \"insights-runtime-extractor-n62hc\" (UID: \"df43819b-2cc5-4790-b411-173db7cb6c16\") " pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.751354 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.751302 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n62hc" May 21 15:39:35.899366 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:35.899331 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n62hc"] May 21 15:39:35.902819 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:35.902793 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf43819b_2cc5_4790_b411_173db7cb6c16.slice/crio-0b44a92a52cb9020d288c6910e86d48b5eafa7cc7e95d9eeb3f17fd00ee3a0d5 WatchSource:0}: Error finding container 0b44a92a52cb9020d288c6910e86d48b5eafa7cc7e95d9eeb3f17fd00ee3a0d5: Status 404 returned error can't find the container with id 0b44a92a52cb9020d288c6910e86d48b5eafa7cc7e95d9eeb3f17fd00ee3a0d5 May 21 15:39:36.151555 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:36.151525 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n62hc" event={"ID":"df43819b-2cc5-4790-b411-173db7cb6c16","Type":"ContainerStarted","Data":"e373407fe4edc703a6488ff0687c05ead0a1126e2be4438272a1d7d1f728c25a"} May 21 15:39:36.151555 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:36.151558 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n62hc" event={"ID":"df43819b-2cc5-4790-b411-173db7cb6c16","Type":"ContainerStarted","Data":"0b44a92a52cb9020d288c6910e86d48b5eafa7cc7e95d9eeb3f17fd00ee3a0d5"} May 21 15:39:37.155506 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:37.155469 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n62hc" event={"ID":"df43819b-2cc5-4790-b411-173db7cb6c16","Type":"ContainerStarted","Data":"59774400b11e4b94a39fcc5bb72d01273a6f6a35795b3a16ce4a55cdd284d5d5"} May 21 15:39:37.587270 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:37.587235 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:37.587270 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:37.587279 2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:39:37.587654 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:37.587639 2556 scope.go:117] "RemoveContainer" containerID="a6a095a5f7856c815eab93a7ec0c490e24c54534c20e774e5c29fa3ba6cef159" May 21 15:39:37.587843 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:37.587820 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-hb7mh_openshift-console-operator(9e588f33-6073-438c-9a8b-cb75bdf7a38f)\"" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" podUID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" May 21 15:39:38.812778 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:38.812741 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:38.815135 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:38.815107 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff6526b7-8014-45ef-9b1c-c1a1d801fd95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-s7n8l\" (UID: \"ff6526b7-8014-45ef-9b1c-c1a1d801fd95\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:39.055986 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:39.055952 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6ff27\"" May 21 15:39:39.063260 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:39.063214 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" May 21 15:39:39.163248 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:39.163216 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n62hc" event={"ID":"df43819b-2cc5-4790-b411-173db7cb6c16","Type":"ContainerStarted","Data":"d5f175ec835acdcd261db01955ebee909bd2924cd9acbdb0f3bbdc68f723508d"} May 21 15:39:39.208225 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:39.208201 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l"] May 21 15:39:39.210482 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:39.210452 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6526b7_8014_45ef_9b1c_c1a1d801fd95.slice/crio-eaa3211e5f2e92eda19e49a004d8bfd9f03dec45511bb529aea29a1d5c47dfcf WatchSource:0}: Error finding container eaa3211e5f2e92eda19e49a004d8bfd9f03dec45511bb529aea29a1d5c47dfcf: Status 404 returned error can't find the container with id eaa3211e5f2e92eda19e49a004d8bfd9f03dec45511bb529aea29a1d5c47dfcf May 21 15:39:39.213899 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:39.213833 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n62hc" podStartSLOduration=1.854112426 podStartE2EDuration="4.213820433s" podCreationTimestamp="2026-05-21 15:39:35 +0000 UTC" firstStartedPulling="2026-05-21 15:39:35.974074688 +0000 UTC m=+86.718747858" lastFinishedPulling="2026-05-21 15:39:38.333782683 +0000 UTC m=+89.078455865" observedRunningTime="2026-05-21 15:39:39.212271604 +0000 UTC m=+89.956944791" watchObservedRunningTime="2026-05-21 15:39:39.213820433 +0000 UTC m=+89.958493616" May 21 15:39:40.167015 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:40.166974 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" event={"ID":"ff6526b7-8014-45ef-9b1c-c1a1d801fd95","Type":"ContainerStarted","Data":"eaa3211e5f2e92eda19e49a004d8bfd9f03dec45511bb529aea29a1d5c47dfcf"} May 21 15:39:41.172747 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.172669 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" event={"ID":"ff6526b7-8014-45ef-9b1c-c1a1d801fd95","Type":"ContainerStarted","Data":"6c2c8d7745112f306d84515bc1a320f734c32b7ebb0bdd807fad38e32517bf59"} May 21 15:39:41.256473 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.256427 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-s7n8l" podStartSLOduration=33.650175909 podStartE2EDuration="35.256414129s" podCreationTimestamp="2026-05-21 15:39:06 +0000 UTC" firstStartedPulling="2026-05-21 15:39:39.212321917 +0000 UTC m=+89.956995087" lastFinishedPulling="2026-05-21 15:39:40.818560126 +0000 UTC m=+91.563233307" observedRunningTime="2026-05-21 15:39:41.255762099 +0000 UTC m=+92.000435284" watchObservedRunningTime="2026-05-21 15:39:41.256414129 +0000 UTC m=+92.001087359" May 21 15:39:41.571805 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.571777 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7"] May 21 15:39:41.574744 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.574724 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" May 21 15:39:41.578558 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.578540 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 15:39:41.579034 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.578979 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-smcm2\"" May 21 15:39:41.589685 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.589660 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7"] May 21 15:39:41.635200 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.635173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7\" (UID: \"1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" May 21 15:39:41.736145 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.736121 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7\" (UID: \"1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" May 21 15:39:41.738373 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.738350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7\" (UID: \"1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" May 21 15:39:41.885769 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:41.885708 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" May 21 15:39:42.033148 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:42.033117 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7"] May 21 15:39:42.037998 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:42.037975 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb4cbaa_7a69_44c3_b3c2_58c49ca4c11d.slice/crio-2c01764aa2e5d989d3bef9a9b08bb51b2376b24966735e676f045251a7bd72d1 WatchSource:0}: Error finding container 2c01764aa2e5d989d3bef9a9b08bb51b2376b24966735e676f045251a7bd72d1: Status 404 returned error can't find the container with id 2c01764aa2e5d989d3bef9a9b08bb51b2376b24966735e676f045251a7bd72d1 May 21 15:39:42.175996 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:42.175939 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" event={"ID":"1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d","Type":"ContainerStarted","Data":"2c01764aa2e5d989d3bef9a9b08bb51b2376b24966735e676f045251a7bd72d1"} May 21 15:39:44.182218 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.182186 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" event={"ID":"1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d","Type":"ContainerStarted","Data":"aa5a6a8f0a5b8ebb93f0b8e9e96b6f4525806a86d6b5444a34dc5a5dffc84ca1"} May 21 15:39:44.182643 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.182398 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" May 21 15:39:44.186859 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.186835 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" May 21 15:39:44.228680 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.228642 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7" podStartSLOduration=1.694105523 podStartE2EDuration="3.228631119s" podCreationTimestamp="2026-05-21 15:39:41 +0000 UTC" firstStartedPulling="2026-05-21 15:39:42.04004114 +0000 UTC m=+92.784714305" lastFinishedPulling="2026-05-21 15:39:43.574566733 +0000 UTC m=+94.319239901" observedRunningTime="2026-05-21 15:39:44.228358248 +0000 UTC m=+94.973031437" watchObservedRunningTime="2026-05-21 15:39:44.228631119 +0000 UTC m=+94.973304320" May 21 15:39:44.786955 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.786906 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jd656"] May 21 15:39:44.809622 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.809599 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:44.817942 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.817905 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pdw6z\"" May 21 15:39:44.818245 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.818220 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jd656"] May 21 15:39:44.818384 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.818345 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 15:39:44.818384 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.818347 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 15:39:44.818475 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.818347 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 15:39:44.960967 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.960937 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee97082-6cd2-4be6-9433-e07ab4c39243-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:44.961108 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.960973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjvk2\" (UniqueName: \"kubernetes.io/projected/aee97082-6cd2-4be6-9433-e07ab4c39243-kube-api-access-pjvk2\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:44.961108 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.961061 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aee97082-6cd2-4be6-9433-e07ab4c39243-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:44.961180 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:44.961117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee97082-6cd2-4be6-9433-e07ab4c39243-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.062186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.062131 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aee97082-6cd2-4be6-9433-e07ab4c39243-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.062186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.062169 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee97082-6cd2-4be6-9433-e07ab4c39243-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.062315 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.062205 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee97082-6cd2-4be6-9433-e07ab4c39243-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.062315 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.062230 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjvk2\" (UniqueName: \"kubernetes.io/projected/aee97082-6cd2-4be6-9433-e07ab4c39243-kube-api-access-pjvk2\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.062898 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.062876 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee97082-6cd2-4be6-9433-e07ab4c39243-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.064418 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.064391 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aee97082-6cd2-4be6-9433-e07ab4c39243-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.064504 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.064402 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee97082-6cd2-4be6-9433-e07ab4c39243-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.072248 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.072230 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjvk2\" (UniqueName: \"kubernetes.io/projected/aee97082-6cd2-4be6-9433-e07ab4c39243-kube-api-access-pjvk2\") pod \"prometheus-operator-7779bbdd78-jd656\" (UID: \"aee97082-6cd2-4be6-9433-e07ab4c39243\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.118333 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.118311 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" May 21 15:39:45.272238 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.272211 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jd656"] May 21 15:39:45.275191 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:45.275168 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee97082_6cd2_4be6_9433_e07ab4c39243.slice/crio-37a5d3beb7c44fd15f9adaf300dad394405b89bbd2ba59b0d1da4057e5c45b00 WatchSource:0}: Error finding container 37a5d3beb7c44fd15f9adaf300dad394405b89bbd2ba59b0d1da4057e5c45b00: Status 404 returned error can't find the container with id 37a5d3beb7c44fd15f9adaf300dad394405b89bbd2ba59b0d1da4057e5c45b00 May 21 15:39:45.472005 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.471940 2556 patch_prober.go:28] interesting pod/image-registry-7885686ccd-tvpmg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 15:39:45.472005 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:45.471984 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" podUID="146c4bb5-b729-4a04-84e3-479a645b6255" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 15:39:46.188649 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:46.188616 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" event={"ID":"aee97082-6cd2-4be6-9433-e07ab4c39243","Type":"ContainerStarted","Data":"37a5d3beb7c44fd15f9adaf300dad394405b89bbd2ba59b0d1da4057e5c45b00"} May 21 15:39:47.091958 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.091909 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5bm4d" May 21 15:39:47.192808 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.192780 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" event={"ID":"aee97082-6cd2-4be6-9433-e07ab4c39243","Type":"ContainerStarted","Data":"6f9e9c4aa477739f9f34d881067df46b9f735ef27d4b081704104532de402533"} May 21 15:39:47.192808 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.192813 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" event={"ID":"aee97082-6cd2-4be6-9433-e07ab4c39243","Type":"ContainerStarted","Data":"c99d6ba97b6869f21e1fa9e31e4ad4131eb6f2949406f577572bf853ac1e3a56"} May 21 15:39:47.216527 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.216483 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jd656" podStartSLOduration=1.917632564 podStartE2EDuration="3.21647153s" podCreationTimestamp="2026-05-21 15:39:44 +0000 UTC" firstStartedPulling="2026-05-21 15:39:45.276903926 +0000 UTC m=+96.021577092" lastFinishedPulling="2026-05-21 15:39:46.575742892 +0000 UTC m=+97.320416058" observedRunningTime="2026-05-21 15:39:47.216443726 +0000 UTC m=+97.961116916" watchObservedRunningTime="2026-05-21 15:39:47.21647153 +0000 UTC m=+97.961144763" May 21 15:39:47.582607 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.582579 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:39:47.582786 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.582623 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:39:47.584861 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.584837 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a40b4ecc-e278-48c4-bbb4-69346bfde543-metrics-tls\") pod \"dns-default-j6cnb\" (UID: \"a40b4ecc-e278-48c4-bbb4-69346bfde543\") " pod="openshift-dns/dns-default-j6cnb" May 21 15:39:47.585000 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.584943 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8889c4ae-38a1-493a-9edb-afe43dce4b4c-cert\") pod \"ingress-canary-s2xdp\" (UID: \"8889c4ae-38a1-493a-9edb-afe43dce4b4c\") " pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:39:47.872087 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.872019 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-47t49\"" May 21 15:39:47.877934 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.877897 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n8nx8\"" May 21 15:39:47.879839 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.879823 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2xdp" May 21 15:39:47.885508 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:47.885487 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j6cnb" May 21 15:39:48.031940 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:48.031894 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2xdp"] May 21 15:39:48.034654 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:48.034629 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8889c4ae_38a1_493a_9edb_afe43dce4b4c.slice/crio-45c7ef1823f7ad4b54f409903d2a954dbfacfcca62b5c2d9dd6cfbdea77c7065 WatchSource:0}: Error finding container 45c7ef1823f7ad4b54f409903d2a954dbfacfcca62b5c2d9dd6cfbdea77c7065: Status 404 returned error can't find the container with id 45c7ef1823f7ad4b54f409903d2a954dbfacfcca62b5c2d9dd6cfbdea77c7065 May 21 15:39:48.061514 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:48.061491 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j6cnb"] May 21 15:39:48.063868 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:48.063834 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40b4ecc_e278_48c4_bbb4_69346bfde543.slice/crio-e2cdcad35330aa6bb42fffe3cd73e6d15bdb7d99bdf771ff524bb3a2b2cdba0e WatchSource:0}: Error finding container e2cdcad35330aa6bb42fffe3cd73e6d15bdb7d99bdf771ff524bb3a2b2cdba0e: Status 404 returned error can't find the container with id e2cdcad35330aa6bb42fffe3cd73e6d15bdb7d99bdf771ff524bb3a2b2cdba0e May 21 15:39:48.195739 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:48.195657 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6cnb" event={"ID":"a40b4ecc-e278-48c4-bbb4-69346bfde543","Type":"ContainerStarted","Data":"e2cdcad35330aa6bb42fffe3cd73e6d15bdb7d99bdf771ff524bb3a2b2cdba0e"} May 21 15:39:48.196688 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:48.196668 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2xdp" event={"ID":"8889c4ae-38a1-493a-9edb-afe43dce4b4c","Type":"ContainerStarted","Data":"45c7ef1823f7ad4b54f409903d2a954dbfacfcca62b5c2d9dd6cfbdea77c7065"} May 21 15:39:48.869199 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:48.868893 2556 scope.go:117] "RemoveContainer" containerID="a6a095a5f7856c815eab93a7ec0c490e24c54534c20e774e5c29fa3ba6cef159" May 21 15:39:48.869199 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:48.869145 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-hb7mh_openshift-console-operator(9e588f33-6073-438c-9a8b-cb75bdf7a38f)\"" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" podUID="9e588f33-6073-438c-9a8b-cb75bdf7a38f" May 21 15:39:49.616873 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.616734 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kdj52"] May 21 15:39:49.619831 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.619321 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.624363 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.624336 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 15:39:49.625026 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.624573 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 15:39:49.625026 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.624786 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nkc66\"" May 21 15:39:49.625026 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.624819 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 15:39:49.698865 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.698808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-textfile\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.698865 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.698847 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpp76\" (UniqueName: \"kubernetes.io/projected/8be2cec8-a370-43a5-a866-e7245435cbfe-kube-api-access-hpp76\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.699045 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.698967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-tls\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.699045 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.699014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-root\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.699743 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.699074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be2cec8-a370-43a5-a866-e7245435cbfe-metrics-client-ca\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.699743 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.699116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.699743 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.699203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-sys\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.699743 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.699232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-wtmp\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.699743 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.699253 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.800479 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800427 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-tls\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.800479 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800473 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-root\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.800671 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800541 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-root\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.800671 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:49.800578 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 15:39:49.800671 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:49.800647 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-tls podName:8be2cec8-a370-43a5-a866-e7245435cbfe nodeName:}" failed. No retries permitted until 2026-05-21 15:39:50.300625415 +0000 UTC m=+101.045298595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-tls") pod "node-exporter-kdj52" (UID: "8be2cec8-a370-43a5-a866-e7245435cbfe") : secret "node-exporter-tls" not found May 21 15:39:49.800830 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800687 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be2cec8-a370-43a5-a866-e7245435cbfe-metrics-client-ca\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.800830 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800747 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.800830 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800775 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-sys\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.800830 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800821 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-sys\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.801065 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800887 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-wtmp\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.801065 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800942 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.801065 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.800982 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-textfile\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.801065 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.801011 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpp76\" (UniqueName: \"kubernetes.io/projected/8be2cec8-a370-43a5-a866-e7245435cbfe-kube-api-access-hpp76\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.801247 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.801133 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-wtmp\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.801449 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.801389 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be2cec8-a370-43a5-a866-e7245435cbfe-metrics-client-ca\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.801556 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.801455 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.801556 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.801480 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-textfile\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.803704 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.803663 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:49.832679 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:49.832652 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpp76\" (UniqueName: \"kubernetes.io/projected/8be2cec8-a370-43a5-a866-e7245435cbfe-kube-api-access-hpp76\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:50.204114 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.204077 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6cnb" event={"ID":"a40b4ecc-e278-48c4-bbb4-69346bfde543","Type":"ContainerStarted","Data":"8dc99faba888de019419777a09853021f32dcc766d0b47a9d1a95ea6c0d1ff77"} May 21 15:39:50.204114 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.204122 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6cnb" event={"ID":"a40b4ecc-e278-48c4-bbb4-69346bfde543","Type":"ContainerStarted","Data":"c89e99d0e8e7d0aa3825b6bff74f255b253e64d0b36300f60a32543dc8498abc"} May 21 15:39:50.204350 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.204210 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j6cnb" May 21 15:39:50.205546 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.205516 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2xdp" event={"ID":"8889c4ae-38a1-493a-9edb-afe43dce4b4c","Type":"ContainerStarted","Data":"348410ae65fbf2783d38daa487d364d9301b60e595c176dea16b52d6c953c67a"} May 21 15:39:50.233137 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.233091 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-j6cnb" podStartSLOduration=65.912172068 podStartE2EDuration="1m7.233075028s" podCreationTimestamp="2026-05-21 15:38:43 +0000 UTC" firstStartedPulling="2026-05-21 15:39:48.065458951 +0000 UTC m=+98.810132121" lastFinishedPulling="2026-05-21 15:39:49.386361915 +0000 UTC m=+100.131035081" observedRunningTime="2026-05-21 15:39:50.232159147 +0000 UTC m=+100.976832336" watchObservedRunningTime="2026-05-21 15:39:50.233075028 +0000 UTC m=+100.977748216" May 21 15:39:50.263355 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.263306 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s2xdp" podStartSLOduration=65.209719498 podStartE2EDuration="1m7.263293734s" podCreationTimestamp="2026-05-21 15:38:43 +0000 UTC" firstStartedPulling="2026-05-21 15:39:48.036397458 +0000 UTC m=+98.781070628" lastFinishedPulling="2026-05-21 15:39:50.089971699 +0000 UTC m=+100.834644864" observedRunningTime="2026-05-21 15:39:50.263190072 +0000 UTC m=+101.007863259" watchObservedRunningTime="2026-05-21 15:39:50.263293734 +0000 UTC m=+101.007966921" May 21 15:39:50.305638 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.305560 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-tls\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:50.307903 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.307874 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8be2cec8-a370-43a5-a866-e7245435cbfe-node-exporter-tls\") pod \"node-exporter-kdj52\" (UID: \"8be2cec8-a370-43a5-a866-e7245435cbfe\") " pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:50.533575 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.533542 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kdj52" May 21 15:39:50.543817 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:50.543791 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be2cec8_a370_43a5_a866_e7245435cbfe.slice/crio-57d3f197d82b2d2faea7b3c583e9ee3f87356f08a31f6b349e7838fbe6bf29bd WatchSource:0}: Error finding container 57d3f197d82b2d2faea7b3c583e9ee3f87356f08a31f6b349e7838fbe6bf29bd: Status 404 returned error can't find the container with id 57d3f197d82b2d2faea7b3c583e9ee3f87356f08a31f6b349e7838fbe6bf29bd May 21 15:39:50.628492 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.626495 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:39:50.635876 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.635856 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.640556 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.640533 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 15:39:50.640670 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.640582 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 15:39:50.640670 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.640652 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-srdtl\"" May 21 15:39:50.640776 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.640684 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 15:39:50.640776 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.640583 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 15:39:50.641132 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.641113 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 15:39:50.641132 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.641126 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 15:39:50.641287 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.641170 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 15:39:50.641287 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.641131 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 15:39:50.641287 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.641209 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 15:39:50.660285 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.660264 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:39:50.708538 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708512 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708618 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78kpv\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-kube-api-access-78kpv\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708618 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708618 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708578 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-web-config\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708618 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708594 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708751 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708623 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708751 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708751 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708751 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708699 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708751 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708751 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708747 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-config-out\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708944 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.708944 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.708797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810207 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810176 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810368 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810287 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-config-out\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810368 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810339 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810477 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810445 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810532 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810514 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810589 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810542 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78kpv\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-kube-api-access-78kpv\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810589 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810571 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810683 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810595 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-web-config\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810683 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810626 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810683 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810657 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810683 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:50.810666 2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 21 15:39:50.810869 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810722 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810869 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:39:50.810742 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls podName:3e84163c-b56b-4374-a0a8-ddb636373b67 nodeName:}" failed. No retries permitted until 2026-05-21 15:39:51.310718291 +0000 UTC m=+102.055391476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67") : secret "alertmanager-main-tls" not found May 21 15:39:50.810869 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810789 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.810869 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.810843 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.811929 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.811886 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.812137 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.812113 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.812458 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.812437 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.813719 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.813416 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.813719 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.813526 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.814021 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.814007 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.814563 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.814518 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-config-out\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.814850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.814828 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-web-config\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.815076 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.815056 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.815484 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.815460 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.816237 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.816217 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:50.822542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:50.822521 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78kpv\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-kube-api-access-78kpv\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:51.209638 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:51.209577 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdj52" event={"ID":"8be2cec8-a370-43a5-a866-e7245435cbfe","Type":"ContainerStarted","Data":"57d3f197d82b2d2faea7b3c583e9ee3f87356f08a31f6b349e7838fbe6bf29bd"} May 21 15:39:51.315604 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:51.315516 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:51.317676 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:51.317653 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:51.546830 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:51.546797 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 15:39:51.698143 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:51.698106 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e84163c_b56b_4374_a0a8_ddb636373b67.slice/crio-3229fa8b3bcd9812992ce2aa0abd39e637242f6d40eea5bc4f2c9ff368147495 WatchSource:0}: Error finding container 3229fa8b3bcd9812992ce2aa0abd39e637242f6d40eea5bc4f2c9ff368147495: Status 404 returned error can't find the container with id 3229fa8b3bcd9812992ce2aa0abd39e637242f6d40eea5bc4f2c9ff368147495 May 21 15:39:51.701568 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:51.701548 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:39:52.213404 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.213334 2556 generic.go:358] "Generic (PLEG): container finished" podID="8be2cec8-a370-43a5-a866-e7245435cbfe" containerID="27c1cb37010036ed5eafb36c71641e7904f5995268566ab117815301ab0b0722" exitCode=0 May 21 15:39:52.213528 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.213413 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdj52" event={"ID":"8be2cec8-a370-43a5-a866-e7245435cbfe","Type":"ContainerDied","Data":"27c1cb37010036ed5eafb36c71641e7904f5995268566ab117815301ab0b0722"} May 21 15:39:52.214461 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.214436 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerStarted","Data":"3229fa8b3bcd9812992ce2aa0abd39e637242f6d40eea5bc4f2c9ff368147495"} May 21 15:39:52.504185 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.504110 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b69644bf8-z99wc"] May 21 15:39:52.507407 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.507385 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.512484 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.512094 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4dhih2d9lnpmf\"" May 21 15:39:52.512484 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.512136 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 15:39:52.512484 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.512197 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 15:39:52.512484 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.512343 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 15:39:52.512484 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.512409 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 15:39:52.513123 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.513075 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-b5242\"" May 21 15:39:52.513558 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.513542 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 15:39:52.533971 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.533946 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b69644bf8-z99wc"] May 21 15:39:52.627440 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.627395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.627593 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.627503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af67dba-6a80-40c7-89f2-64270442b92b-metrics-client-ca\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.627593 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.627536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-tls\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.627593 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.627580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.627776 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.627611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-grpc-tls\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.627776 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.627636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fz48\" (UniqueName: \"kubernetes.io/projected/7af67dba-6a80-40c7-89f2-64270442b92b-kube-api-access-9fz48\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.627776 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.627732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.627886 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.627800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.729016 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.728977 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-grpc-tls\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.729016 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.729013 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fz48\" (UniqueName: \"kubernetes.io/projected/7af67dba-6a80-40c7-89f2-64270442b92b-kube-api-access-9fz48\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.729523 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.729047 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.729523 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.729107 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.729523 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.729139 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.729523 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.729211 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af67dba-6a80-40c7-89f2-64270442b92b-metrics-client-ca\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.729523 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.729244 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-tls\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.729523 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.729283 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.730083 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.730028 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af67dba-6a80-40c7-89f2-64270442b92b-metrics-client-ca\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.732318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.732268 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-grpc-tls\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.732452 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.732420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.732709 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.732685 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.733161 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.733141 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-tls\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.733250 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.733174 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.733329 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.733266 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7af67dba-6a80-40c7-89f2-64270442b92b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.740181 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.740159 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fz48\" (UniqueName: \"kubernetes.io/projected/7af67dba-6a80-40c7-89f2-64270442b92b-kube-api-access-9fz48\") pod \"thanos-querier-7b69644bf8-z99wc\" (UID: \"7af67dba-6a80-40c7-89f2-64270442b92b\") " pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.819148 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.819127 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:52.971639 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:52.971612 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b69644bf8-z99wc"] May 21 15:39:52.973027 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:52.973006 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af67dba_6a80_40c7_89f2_64270442b92b.slice/crio-1bd584f81ffef1a066fe0ab6cee39a307a65b68c54955c288a56ef6047102259 WatchSource:0}: Error finding container 1bd584f81ffef1a066fe0ab6cee39a307a65b68c54955c288a56ef6047102259: Status 404 returned error can't find the container with id 1bd584f81ffef1a066fe0ab6cee39a307a65b68c54955c288a56ef6047102259 May 21 15:39:53.218730 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:53.218655 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdj52" event={"ID":"8be2cec8-a370-43a5-a866-e7245435cbfe","Type":"ContainerStarted","Data":"f10b205710c226199d94c9a6c9e1347767055f6b982011d76d7f9a93524201f0"} May 21 15:39:53.218730 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:53.218691 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdj52" event={"ID":"8be2cec8-a370-43a5-a866-e7245435cbfe","Type":"ContainerStarted","Data":"9d2016f2262c9760bd4162a97a98d4627b0849bc7b2b59c7e8a20b34d8ce506b"} May 21 15:39:53.220561 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:53.220535 2556 generic.go:358] "Generic (PLEG): container finished" podID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerID="2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c" exitCode=0 May 21 15:39:53.220679 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:53.220584 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerDied","Data":"2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c"} May 21 15:39:53.221716 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:53.221694 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" event={"ID":"7af67dba-6a80-40c7-89f2-64270442b92b","Type":"ContainerStarted","Data":"1bd584f81ffef1a066fe0ab6cee39a307a65b68c54955c288a56ef6047102259"} May 21 15:39:53.256038 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:53.256001 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kdj52" podStartSLOduration=3.498241875 podStartE2EDuration="4.255989264s" podCreationTimestamp="2026-05-21 15:39:49 +0000 UTC" firstStartedPulling="2026-05-21 15:39:50.545390568 +0000 UTC m=+101.290063735" lastFinishedPulling="2026-05-21 15:39:51.303137958 +0000 UTC m=+102.047811124" observedRunningTime="2026-05-21 15:39:53.255803302 +0000 UTC m=+104.000476502" watchObservedRunningTime="2026-05-21 15:39:53.255989264 +0000 UTC m=+104.000662484" May 21 15:39:54.877595 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.877559 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d97cb4675-95dzf"] May 21 15:39:54.880044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.880015 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:54.883232 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.883206 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 15:39:54.883550 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.883532 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7xf4r\"" May 21 15:39:54.883779 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.883756 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 15:39:54.883927 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.883885 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 15:39:54.885130 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.885110 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 15:39:54.885221 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.885127 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 15:39:54.905220 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.905197 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 15:39:54.914251 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.914231 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d97cb4675-95dzf"] May 21 15:39:54.949439 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.949416 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-metrics-client-ca\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:54.949540 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.949451 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-serving-certs-ca-bundle\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:54.949540 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.949478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-federate-client-tls\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:54.949653 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.949551 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-secret-telemeter-client\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:54.949702 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.949661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:54.949750 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.949704 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6g6l\" (UniqueName: \"kubernetes.io/projected/c8eadd44-da30-4e31-98e1-2ea66334d2cd-kube-api-access-l6g6l\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:54.949750 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.949734 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-telemeter-client-tls\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:54.949847 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:54.949808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.051299 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.051261 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-metrics-client-ca\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.051479 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.051311 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-serving-certs-ca-bundle\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.051479 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.051341 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-federate-client-tls\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.051479 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.051376 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-secret-telemeter-client\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.051650 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.051570 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.051650 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.051624 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g6l\" (UniqueName: \"kubernetes.io/projected/c8eadd44-da30-4e31-98e1-2ea66334d2cd-kube-api-access-l6g6l\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.051744 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.051657 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-telemeter-client-tls\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.051744 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.051708 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.052176 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.052077 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-metrics-client-ca\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.052176 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.052107 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-serving-certs-ca-bundle\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.052828 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.052804 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8eadd44-da30-4e31-98e1-2ea66334d2cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.054212 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.054169 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.054579 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.054536 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-federate-client-tls\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.054677 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.054667 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-secret-telemeter-client\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.054970 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.054938 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c8eadd44-da30-4e31-98e1-2ea66334d2cd-telemeter-client-tls\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.074092 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.074071 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6g6l\" (UniqueName: \"kubernetes.io/projected/c8eadd44-da30-4e31-98e1-2ea66334d2cd-kube-api-access-l6g6l\") pod \"telemeter-client-6d97cb4675-95dzf\" (UID: \"c8eadd44-da30-4e31-98e1-2ea66334d2cd\") " pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.191401 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.191328 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" May 21 15:39:55.472077 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.472002 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:39:55.697221 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.697170 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d97cb4675-95dzf"] May 21 15:39:55.987622 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.987540 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:39:55.990407 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.990382 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:55.994863 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.994845 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 15:39:55.996526 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.996481 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 15:39:55.996650 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.996582 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 15:39:55.996719 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.996586 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 15:39:55.996719 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.996713 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 15:39:55.996791 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.996713 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 15:39:55.996832 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.996788 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 15:39:55.997255 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.997239 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hxcls\"" May 21 15:39:55.997255 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.997240 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 15:39:55.997779 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.997556 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2uisn46ntisb2\"" May 21 15:39:55.997779 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.997667 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 15:39:55.997901 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.997889 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 15:39:55.998186 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:55.998168 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 15:39:56.000200 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.000175 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 15:39:56.001429 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.001412 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 15:39:56.018714 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.018678 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:39:56.162221 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162349 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162349 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-config-out\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162349 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162349 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-config\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162349 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162525 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162525 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162486 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162525 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162620 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162525 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162620 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162620 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162559 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162620 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162583 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162620 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmdbd\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-kube-api-access-fmdbd\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162786 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162639 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162786 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-web-config\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162786 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.162870 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.162796 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.234083 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.234045 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerStarted","Data":"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3"} May 21 15:39:56.234083 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.234086 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerStarted","Data":"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600"} May 21 15:39:56.234285 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.234100 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerStarted","Data":"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2"} May 21 15:39:56.234285 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.234112 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerStarted","Data":"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543"} May 21 15:39:56.234285 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.234126 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerStarted","Data":"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76"} May 21 15:39:56.236024 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.235992 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" event={"ID":"7af67dba-6a80-40c7-89f2-64270442b92b","Type":"ContainerStarted","Data":"45248598084e47505aa440dd22c86e0ea9c205694649cf8af25d42faa29463bd"} May 21 15:39:56.236024 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.236023 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" event={"ID":"7af67dba-6a80-40c7-89f2-64270442b92b","Type":"ContainerStarted","Data":"30650e3efe585a7484196db84efedb3c5f6525d5fc77ae582dfe3577d723f4f5"} May 21 15:39:56.236184 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.236034 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" event={"ID":"7af67dba-6a80-40c7-89f2-64270442b92b","Type":"ContainerStarted","Data":"1a07a7723837a4143eefdce29e8dba86af2f5b57cb2383c01d780b1c2acd64f2"} May 21 15:39:56.236960 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.236939 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" event={"ID":"c8eadd44-da30-4e31-98e1-2ea66334d2cd","Type":"ContainerStarted","Data":"cf97df43848c7d339e4341aa25ff5d69bdc369c6fa1294d68dc04f6dfa247dd3"} May 21 15:39:56.263394 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263360 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263505 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263401 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263505 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263427 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263505 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263459 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263505 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263491 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263695 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263615 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263695 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263658 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmdbd\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-kube-api-access-fmdbd\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263788 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263721 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263788 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263748 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-web-config\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.263980 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.263960 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264140 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264097 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264218 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264174 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264218 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264212 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264323 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264261 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264323 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264301 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-config-out\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264422 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264316 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264422 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264332 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264422 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264382 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-config\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264422 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264412 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.264616 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.264438 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.265308 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.265279 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.266584 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.266453 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.266584 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.266529 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.266737 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.266642 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-web-config\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.267318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.267136 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.267318 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.267169 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.267909 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.267882 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.268175 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.268097 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.268175 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.268151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.268322 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.268245 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.269167 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.269143 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-config\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.269263 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.269146 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.269890 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.269869 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.269990 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.269869 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.270051 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.269997 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-config-out\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.273586 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.273565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmdbd\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-kube-api-access-fmdbd\") pod \"prometheus-k8s-0\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.301557 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.301537 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:39:56.470971 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:56.470935 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:39:56.473747 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:39:56.473717 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660e048a_49b4_485c_b38b_3999b0641c56.slice/crio-61edb99430af932c8b9011c3e360fbeecb140473df0713e7190191b871a94047 WatchSource:0}: Error finding container 61edb99430af932c8b9011c3e360fbeecb140473df0713e7190191b871a94047: Status 404 returned error can't find the container with id 61edb99430af932c8b9011c3e360fbeecb140473df0713e7190191b871a94047 May 21 15:39:57.242062 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.241990 2556 generic.go:358] "Generic (PLEG): container finished" podID="660e048a-49b4-485c-b38b-3999b0641c56" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" exitCode=0 May 21 15:39:57.242493 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.242090 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerDied","Data":"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd"} May 21 15:39:57.242493 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.242133 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerStarted","Data":"61edb99430af932c8b9011c3e360fbeecb140473df0713e7190191b871a94047"} May 21 15:39:57.245621 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.245592 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" event={"ID":"7af67dba-6a80-40c7-89f2-64270442b92b","Type":"ContainerStarted","Data":"f5c3c6999b984a6c8ba9b4d6935b69757f9449dc46222d3d4366426ae7782ed1"} May 21 15:39:57.245725 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.245630 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" event={"ID":"7af67dba-6a80-40c7-89f2-64270442b92b","Type":"ContainerStarted","Data":"feeea12d0c0a741ea3458218c3a0856a6c661c86dbe6b74f644988967c0a4f9f"} May 21 15:39:57.245725 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.245645 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" event={"ID":"7af67dba-6a80-40c7-89f2-64270442b92b","Type":"ContainerStarted","Data":"f47ad306f4f1cc4476aab8518da27027935873ce22deeff7ece2757fcc04a1a5"} May 21 15:39:57.245844 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.245728 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:39:57.248997 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.248976 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerStarted","Data":"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893"} May 21 15:39:57.312431 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.312380 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" podStartSLOduration=1.510274143 podStartE2EDuration="5.312365762s" podCreationTimestamp="2026-05-21 15:39:52 +0000 UTC" firstStartedPulling="2026-05-21 15:39:52.974767376 +0000 UTC m=+103.719440545" lastFinishedPulling="2026-05-21 15:39:56.776858998 +0000 UTC m=+107.521532164" observedRunningTime="2026-05-21 15:39:57.311939414 +0000 UTC m=+108.056612603" watchObservedRunningTime="2026-05-21 15:39:57.312365762 +0000 UTC m=+108.057038950" May 21 15:39:57.349098 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:57.349056 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.280649048 podStartE2EDuration="7.349042712s" podCreationTimestamp="2026-05-21 15:39:50 +0000 UTC" firstStartedPulling="2026-05-21 15:39:51.700467284 +0000 UTC m=+102.445140454" lastFinishedPulling="2026-05-21 15:39:56.76886095 +0000 UTC m=+107.513534118" observedRunningTime="2026-05-21 15:39:57.346976848 +0000 UTC m=+108.091650036" watchObservedRunningTime="2026-05-21 15:39:57.349042712 +0000 UTC m=+108.093715901" May 21 15:39:58.254451 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:58.254409 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" event={"ID":"c8eadd44-da30-4e31-98e1-2ea66334d2cd","Type":"ContainerStarted","Data":"d9086250ac30a2cbecd70fcd7f476435f7d31b8d5af7d8522e5041db2b44f20f"} May 21 15:39:58.254451 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:58.254453 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" event={"ID":"c8eadd44-da30-4e31-98e1-2ea66334d2cd","Type":"ContainerStarted","Data":"71419933d876142cd1ef056b43d8891c5e96a3fd9b9858737601cea83e82df54"} May 21 15:39:58.255015 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:58.254465 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" event={"ID":"c8eadd44-da30-4e31-98e1-2ea66334d2cd","Type":"ContainerStarted","Data":"387117d7018c3cacf896504263c3a3047a8b70a59dd9306830f4558ab8973446"} May 21 15:39:58.304732 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:39:58.304679 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d97cb4675-95dzf" podStartSLOduration=2.3618357039999998 podStartE2EDuration="4.304663257s" podCreationTimestamp="2026-05-21 15:39:54 +0000 UTC" firstStartedPulling="2026-05-21 15:39:55.702624979 +0000 UTC m=+106.447298158" lastFinishedPulling="2026-05-21 15:39:57.645452543 +0000 UTC m=+108.390125711" observedRunningTime="2026-05-21 15:39:58.302281116 +0000 UTC m=+109.046954305" watchObservedRunningTime="2026-05-21 15:39:58.304663257 +0000 UTC m=+109.049336447" May 21 15:40:00.212525 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.212492 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j6cnb" May 21 15:40:00.484697 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.484659 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" podUID="146c4bb5-b729-4a04-84e3-479a645b6255" containerName="registry" containerID="cri-o://355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea" gracePeriod=30 May 21 15:40:00.776081 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.776059 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:40:00.869770 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.869578 2556 scope.go:117] "RemoveContainer" containerID="a6a095a5f7856c815eab93a7ec0c490e24c54534c20e774e5c29fa3ba6cef159" May 21 15:40:00.908730 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.908705 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-bound-sa-token\") pod \"146c4bb5-b729-4a04-84e3-479a645b6255\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " May 21 15:40:00.908830 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.908778 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") pod \"146c4bb5-b729-4a04-84e3-479a645b6255\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " May 21 15:40:00.908830 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.908821 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/146c4bb5-b729-4a04-84e3-479a645b6255-ca-trust-extracted\") pod \"146c4bb5-b729-4a04-84e3-479a645b6255\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " May 21 15:40:00.908898 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.908854 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lzr5\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-kube-api-access-4lzr5\") pod \"146c4bb5-b729-4a04-84e3-479a645b6255\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " May 21 15:40:00.908898 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.908880 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-installation-pull-secrets\") pod \"146c4bb5-b729-4a04-84e3-479a645b6255\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " May 21 15:40:00.909019 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.908905 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-image-registry-private-configuration\") pod \"146c4bb5-b729-4a04-84e3-479a645b6255\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " May 21 15:40:00.909019 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.908961 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-registry-certificates\") pod \"146c4bb5-b729-4a04-84e3-479a645b6255\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " May 21 15:40:00.909019 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.908996 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-trusted-ca\") pod \"146c4bb5-b729-4a04-84e3-479a645b6255\" (UID: \"146c4bb5-b729-4a04-84e3-479a645b6255\") " May 21 15:40:00.909606 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.909553 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "146c4bb5-b729-4a04-84e3-479a645b6255" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:40:00.909711 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.909624 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "146c4bb5-b729-4a04-84e3-479a645b6255" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:40:00.911328 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.911289 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "146c4bb5-b729-4a04-84e3-479a645b6255" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:40:00.911558 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.911513 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "146c4bb5-b729-4a04-84e3-479a645b6255" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:40:00.911558 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.911513 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "146c4bb5-b729-4a04-84e3-479a645b6255" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:40:00.911707 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.911643 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-kube-api-access-4lzr5" (OuterVolumeSpecName: "kube-api-access-4lzr5") pod "146c4bb5-b729-4a04-84e3-479a645b6255" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255"). InnerVolumeSpecName "kube-api-access-4lzr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:40:00.912075 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.912050 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "146c4bb5-b729-4a04-84e3-479a645b6255" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:40:00.918879 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:00.918815 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/146c4bb5-b729-4a04-84e3-479a645b6255-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "146c4bb5-b729-4a04-84e3-479a645b6255" (UID: "146c4bb5-b729-4a04-84e3-479a645b6255"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:40:01.010312 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.010218 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-bound-sa-token\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:40:01.010312 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.010252 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-registry-tls\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:40:01.010312 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.010265 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/146c4bb5-b729-4a04-84e3-479a645b6255-ca-trust-extracted\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:40:01.010312 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.010276 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lzr5\" (UniqueName: \"kubernetes.io/projected/146c4bb5-b729-4a04-84e3-479a645b6255-kube-api-access-4lzr5\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:40:01.010312 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.010292 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-installation-pull-secrets\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:40:01.010312 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.010308 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/146c4bb5-b729-4a04-84e3-479a645b6255-image-registry-private-configuration\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:40:01.010594 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.010322 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-registry-certificates\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:40:01.010594 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.010335 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/146c4bb5-b729-4a04-84e3-479a645b6255-trusted-ca\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:40:01.269838 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.269804 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:40:01.270261 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.269941 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" event={"ID":"9e588f33-6073-438c-9a8b-cb75bdf7a38f","Type":"ContainerStarted","Data":"8ba495818bca074d12c07c64f1a20d0a7de010a3011aa2f7db36c8aa1753890c"} May 21 15:40:01.270362 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.270344 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:40:01.273344 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.273322 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerStarted","Data":"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8"} May 21 15:40:01.273486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.273351 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerStarted","Data":"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a"} May 21 15:40:01.273486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.273363 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerStarted","Data":"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206"} May 21 15:40:01.273486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.273375 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerStarted","Data":"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9"} May 21 15:40:01.273486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.273390 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerStarted","Data":"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a"} May 21 15:40:01.273486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.273403 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerStarted","Data":"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea"} May 21 15:40:01.274486 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.274466 2556 generic.go:358] "Generic (PLEG): container finished" podID="146c4bb5-b729-4a04-84e3-479a645b6255" containerID="355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea" exitCode=0 May 21 15:40:01.274568 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.274504 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" event={"ID":"146c4bb5-b729-4a04-84e3-479a645b6255","Type":"ContainerDied","Data":"355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea"} May 21 15:40:01.274568 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.274510 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" May 21 15:40:01.274568 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.274521 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7885686ccd-tvpmg" event={"ID":"146c4bb5-b729-4a04-84e3-479a645b6255","Type":"ContainerDied","Data":"e4a1a143d1a3c4be665257e248a9399c2a2bb12c4e585782007899a733f886e2"} May 21 15:40:01.274568 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.274537 2556 scope.go:117] "RemoveContainer" containerID="355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea" May 21 15:40:01.282928 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.282899 2556 scope.go:117] "RemoveContainer" containerID="355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea" May 21 15:40:01.283195 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:40:01.283177 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea\": container with ID starting with 355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea not found: ID does not exist" containerID="355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea" May 21 15:40:01.283264 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.283202 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea"} err="failed to get container status \"355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea\": rpc error: code = NotFound desc = could not find container \"355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea\": container with ID starting with 355ce0c1550e40c8bdab338d29642de0faaa9b9f647eb6c8dd56353ca1c0bfea not found: ID does not exist" May 21 15:40:01.302388 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.302370 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:40:01.315301 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.315260 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" podStartSLOduration=51.703822434 podStartE2EDuration="55.31524982s" podCreationTimestamp="2026-05-21 15:39:06 +0000 UTC" firstStartedPulling="2026-05-21 15:39:07.732335002 +0000 UTC m=+58.477008172" lastFinishedPulling="2026-05-21 15:39:11.34376239 +0000 UTC m=+62.088435558" observedRunningTime="2026-05-21 15:40:01.311407297 +0000 UTC m=+112.056080485" watchObservedRunningTime="2026-05-21 15:40:01.31524982 +0000 UTC m=+112.059923008" May 21 15:40:01.377838 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.377791 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.311050601 podStartE2EDuration="6.377776501s" podCreationTimestamp="2026-05-21 15:39:55 +0000 UTC" firstStartedPulling="2026-05-21 15:39:57.243403827 +0000 UTC m=+107.988076993" lastFinishedPulling="2026-05-21 15:40:00.310129724 +0000 UTC m=+111.054802893" observedRunningTime="2026-05-21 15:40:01.371363476 +0000 UTC m=+112.116036664" watchObservedRunningTime="2026-05-21 15:40:01.377776501 +0000 UTC m=+112.122449691" May 21 15:40:01.402225 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.402202 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7885686ccd-tvpmg"] May 21 15:40:01.405702 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.405683 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7885686ccd-tvpmg"] May 21 15:40:01.618841 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.618776 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-hb7mh" May 21 15:40:01.876686 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:01.876612 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="146c4bb5-b729-4a04-84e3-479a645b6255" path="/var/lib/kubelet/pods/146c4bb5-b729-4a04-84e3-479a645b6255/volumes" May 21 15:40:03.261112 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:03.261082 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b69644bf8-z99wc" May 21 15:40:19.569935 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:19.569879 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:40:19.572285 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:19.572259 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3762df41-6506-4248-a95a-369c904c6404-metrics-certs\") pod \"network-metrics-daemon-k8ngt\" (UID: \"3762df41-6506-4248-a95a-369c904c6404\") " pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:40:19.588626 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:19.588606 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zgm4t\"" May 21 15:40:19.596777 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:19.596761 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8ngt" May 21 15:40:19.722720 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:19.722693 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k8ngt"] May 21 15:40:19.725169 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:40:19.725144 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3762df41_6506_4248_a95a_369c904c6404.slice/crio-aa65389d52e1fb9a6e21a0220f33de650a0b3c10a63bd313423ce6eb79bf79b8 WatchSource:0}: Error finding container aa65389d52e1fb9a6e21a0220f33de650a0b3c10a63bd313423ce6eb79bf79b8: Status 404 returned error can't find the container with id aa65389d52e1fb9a6e21a0220f33de650a0b3c10a63bd313423ce6eb79bf79b8 May 21 15:40:20.336464 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:20.336430 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k8ngt" event={"ID":"3762df41-6506-4248-a95a-369c904c6404","Type":"ContainerStarted","Data":"aa65389d52e1fb9a6e21a0220f33de650a0b3c10a63bd313423ce6eb79bf79b8"} May 21 15:40:21.341452 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:21.341417 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k8ngt" event={"ID":"3762df41-6506-4248-a95a-369c904c6404","Type":"ContainerStarted","Data":"534faf71690d94e3d39a6c1c9c428acf2c3eaadb7e0f0368a58d54b426ac6829"} May 21 15:40:21.341896 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:21.341462 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k8ngt" event={"ID":"3762df41-6506-4248-a95a-369c904c6404","Type":"ContainerStarted","Data":"98f6730438ba80c4eb88888e12a85a757d1c237f914f80adc75d9b6fd5e9941b"} May 21 15:40:21.361549 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:21.361489 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k8ngt" podStartSLOduration=131.456897943 podStartE2EDuration="2m12.361474919s" podCreationTimestamp="2026-05-21 15:38:09 +0000 UTC" firstStartedPulling="2026-05-21 15:40:19.727576577 +0000 UTC m=+130.472249742" lastFinishedPulling="2026-05-21 15:40:20.632153549 +0000 UTC m=+131.376826718" observedRunningTime="2026-05-21 15:40:21.359997439 +0000 UTC m=+132.104670626" watchObservedRunningTime="2026-05-21 15:40:21.361474919 +0000 UTC m=+132.106148110" May 21 15:40:23.348555 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:23.348521 2556 generic.go:358] "Generic (PLEG): container finished" podID="a6e980e0-35d2-48ec-a1a1-c385cf825793" containerID="d8ee9454a3fa874d40f35cf444454f00bc261ab25feecdbd6ea92bfc8b15a50f" exitCode=0 May 21 15:40:23.348941 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:23.348592 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" event={"ID":"a6e980e0-35d2-48ec-a1a1-c385cf825793","Type":"ContainerDied","Data":"d8ee9454a3fa874d40f35cf444454f00bc261ab25feecdbd6ea92bfc8b15a50f"} May 21 15:40:23.348941 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:23.348905 2556 scope.go:117] "RemoveContainer" containerID="d8ee9454a3fa874d40f35cf444454f00bc261ab25feecdbd6ea92bfc8b15a50f" May 21 15:40:24.352581 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:24.352548 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-pwpzw" event={"ID":"a6e980e0-35d2-48ec-a1a1-c385cf825793","Type":"ContainerStarted","Data":"2466ccaa4691a4f6c4c3a84c99ae1366e09c1d16b91934d39ed9b14cd9096f7b"} May 21 15:40:56.301844 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:56.301760 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:40:56.322537 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:56.322512 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:40:56.469268 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:40:56.469238 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:10.125172 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.125138 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:41:10.125594 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.125549 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="alertmanager" containerID="cri-o://a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76" gracePeriod=120 May 21 15:41:10.125725 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.125606 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy-metric" containerID="cri-o://690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3" gracePeriod=120 May 21 15:41:10.125725 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.125652 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy-web" containerID="cri-o://8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2" gracePeriod=120 May 21 15:41:10.125725 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.125687 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy" containerID="cri-o://637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600" gracePeriod=120 May 21 15:41:10.125725 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.125695 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="config-reloader" containerID="cri-o://79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543" gracePeriod=120 May 21 15:41:10.125961 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.125652 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="prom-label-proxy" containerID="cri-o://1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893" gracePeriod=120 May 21 15:41:10.505598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.505515 2556 generic.go:358] "Generic (PLEG): container finished" podID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerID="1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893" exitCode=0 May 21 15:41:10.505598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.505543 2556 generic.go:358] "Generic (PLEG): container finished" podID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerID="637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600" exitCode=0 May 21 15:41:10.505598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.505552 2556 generic.go:358] "Generic (PLEG): container finished" podID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerID="79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543" exitCode=0 May 21 15:41:10.505598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.505560 2556 generic.go:358] "Generic (PLEG): container finished" podID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerID="a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76" exitCode=0 May 21 15:41:10.505598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.505587 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerDied","Data":"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893"} May 21 15:41:10.505852 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.505620 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerDied","Data":"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600"} May 21 15:41:10.505852 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.505630 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerDied","Data":"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543"} May 21 15:41:10.505852 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:10.505638 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerDied","Data":"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76"} May 21 15:41:11.369584 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.369563 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.476340 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476275 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476340 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476304 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476340 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476338 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-trusted-ca-bundle\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476367 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78kpv\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-kube-api-access-78kpv\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476386 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-config-volume\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476408 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-config-out\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476428 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-web\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476464 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-web-config\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476488 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-metrics-client-ca\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476516 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476555 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-cluster-tls-config\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.476598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476585 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-tls-assets\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.477074 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476621 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-main-db\") pod \"3e84163c-b56b-4374-a0a8-ddb636373b67\" (UID: \"3e84163c-b56b-4374-a0a8-ddb636373b67\") " May 21 15:41:11.477074 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.476706 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:41:11.477074 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.477060 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.477467 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.477263 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:41:11.477626 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.477600 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:41:11.479160 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.479132 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-config-out" (OuterVolumeSpecName: "config-out") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:41:11.479271 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.479216 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-kube-api-access-78kpv" (OuterVolumeSpecName: "kube-api-access-78kpv") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "kube-api-access-78kpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:41:11.479856 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.479639 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:11.479856 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.479806 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-config-volume" (OuterVolumeSpecName: "config-volume") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:11.479856 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.479825 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:41:11.480081 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.480013 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:11.480238 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.480210 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:11.480764 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.480741 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:11.484284 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.484266 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:11.491685 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.491666 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-web-config" (OuterVolumeSpecName: "web-config") pod "3e84163c-b56b-4374-a0a8-ddb636373b67" (UID: "3e84163c-b56b-4374-a0a8-ddb636373b67"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:11.510580 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.510556 2556 generic.go:358] "Generic (PLEG): container finished" podID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerID="690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3" exitCode=0 May 21 15:41:11.510580 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.510576 2556 generic.go:358] "Generic (PLEG): container finished" podID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerID="8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2" exitCode=0 May 21 15:41:11.510687 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.510633 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerDied","Data":"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3"} May 21 15:41:11.510687 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.510658 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.510687 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.510669 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerDied","Data":"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2"} May 21 15:41:11.510687 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.510681 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e84163c-b56b-4374-a0a8-ddb636373b67","Type":"ContainerDied","Data":"3229fa8b3bcd9812992ce2aa0abd39e637242f6d40eea5bc4f2c9ff368147495"} May 21 15:41:11.510824 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.510698 2556 scope.go:117] "RemoveContainer" containerID="1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893" May 21 15:41:11.517773 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.517755 2556 scope.go:117] "RemoveContainer" containerID="690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3" May 21 15:41:11.524842 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.524828 2556 scope.go:117] "RemoveContainer" containerID="637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600" May 21 15:41:11.530617 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.530602 2556 scope.go:117] "RemoveContainer" containerID="8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2" May 21 15:41:11.537315 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.537292 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:41:11.537566 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.537550 2556 scope.go:117] "RemoveContainer" containerID="79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543" May 21 15:41:11.543377 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.543355 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:41:11.544676 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.544651 2556 scope.go:117] "RemoveContainer" containerID="a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76" May 21 15:41:11.550705 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.550690 2556 scope.go:117] "RemoveContainer" containerID="2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c" May 21 15:41:11.556779 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.556763 2556 scope.go:117] "RemoveContainer" containerID="1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893" May 21 15:41:11.557082 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:11.557064 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893\": container with ID starting with 1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893 not found: ID does not exist" containerID="1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893" May 21 15:41:11.557121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557090 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893"} err="failed to get container status \"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893\": rpc error: code = NotFound desc = could not find container \"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893\": container with ID starting with 1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893 not found: ID does not exist" May 21 15:41:11.557121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557108 2556 scope.go:117] "RemoveContainer" containerID="690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3" May 21 15:41:11.557331 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:11.557317 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3\": container with ID starting with 690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3 not found: ID does not exist" containerID="690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3" May 21 15:41:11.557375 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557335 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3"} err="failed to get container status \"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3\": rpc error: code = NotFound desc = could not find container \"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3\": container with ID starting with 690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3 not found: ID does not exist" May 21 15:41:11.557375 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557347 2556 scope.go:117] "RemoveContainer" containerID="637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600" May 21 15:41:11.557526 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:11.557513 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600\": container with ID starting with 637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600 not found: ID does not exist" containerID="637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600" May 21 15:41:11.557564 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557529 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600"} err="failed to get container status \"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600\": rpc error: code = NotFound desc = could not find container \"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600\": container with ID starting with 637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600 not found: ID does not exist" May 21 15:41:11.557564 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557542 2556 scope.go:117] "RemoveContainer" containerID="8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2" May 21 15:41:11.557760 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:11.557745 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2\": container with ID starting with 8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2 not found: ID does not exist" containerID="8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2" May 21 15:41:11.557801 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557763 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2"} err="failed to get container status \"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2\": rpc error: code = NotFound desc = could not find container \"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2\": container with ID starting with 8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2 not found: ID does not exist" May 21 15:41:11.557801 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557776 2556 scope.go:117] "RemoveContainer" containerID="79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543" May 21 15:41:11.557969 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:11.557955 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543\": container with ID starting with 79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543 not found: ID does not exist" containerID="79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543" May 21 15:41:11.558031 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557971 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543"} err="failed to get container status \"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543\": rpc error: code = NotFound desc = could not find container \"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543\": container with ID starting with 79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543 not found: ID does not exist" May 21 15:41:11.558031 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.557982 2556 scope.go:117] "RemoveContainer" containerID="a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76" May 21 15:41:11.558197 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:11.558181 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76\": container with ID starting with a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76 not found: ID does not exist" containerID="a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76" May 21 15:41:11.558241 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558200 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76"} err="failed to get container status \"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76\": rpc error: code = NotFound desc = could not find container \"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76\": container with ID starting with a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76 not found: ID does not exist" May 21 15:41:11.558241 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558213 2556 scope.go:117] "RemoveContainer" containerID="2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c" May 21 15:41:11.558411 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:11.558397 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c\": container with ID starting with 2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c not found: ID does not exist" containerID="2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c" May 21 15:41:11.558448 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558413 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c"} err="failed to get container status \"2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c\": rpc error: code = NotFound desc = could not find container \"2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c\": container with ID starting with 2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c not found: ID does not exist" May 21 15:41:11.558448 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558423 2556 scope.go:117] "RemoveContainer" containerID="1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893" May 21 15:41:11.558620 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558603 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893"} err="failed to get container status \"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893\": rpc error: code = NotFound desc = could not find container \"1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893\": container with ID starting with 1df261fde6c6b3e65f49ee1a0160b9e33aca2e0f655b45fc37002f03942c3893 not found: ID does not exist" May 21 15:41:11.558659 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558620 2556 scope.go:117] "RemoveContainer" containerID="690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3" May 21 15:41:11.558788 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558773 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3"} err="failed to get container status \"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3\": rpc error: code = NotFound desc = could not find container \"690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3\": container with ID starting with 690774d2e9861cf1be538031d7529be655daa944e8dadfda42b90464d89cdaa3 not found: ID does not exist" May 21 15:41:11.558840 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558788 2556 scope.go:117] "RemoveContainer" containerID="637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600" May 21 15:41:11.559015 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.558993 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600"} err="failed to get container status \"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600\": rpc error: code = NotFound desc = could not find container \"637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600\": container with ID starting with 637f6df28524540f7ed3828776c703dda3f7b5a9c4a9fccf50ed0de531bd2600 not found: ID does not exist" May 21 15:41:11.559096 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.559018 2556 scope.go:117] "RemoveContainer" containerID="8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2" May 21 15:41:11.559259 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.559241 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2"} err="failed to get container status \"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2\": rpc error: code = NotFound desc = could not find container \"8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2\": container with ID starting with 8fbe84ff46324eb152e946dca7d885c63ccfce559d24c80e27184397d1b1e9b2 not found: ID does not exist" May 21 15:41:11.559309 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.559260 2556 scope.go:117] "RemoveContainer" containerID="79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543" May 21 15:41:11.559460 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.559445 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543"} err="failed to get container status \"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543\": rpc error: code = NotFound desc = could not find container \"79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543\": container with ID starting with 79e4b242a62fd174b35634097f594374dd64cc33356ba811144cbb65a5470543 not found: ID does not exist" May 21 15:41:11.559508 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.559459 2556 scope.go:117] "RemoveContainer" containerID="a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76" May 21 15:41:11.559662 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.559644 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76"} err="failed to get container status \"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76\": rpc error: code = NotFound desc = could not find container \"a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76\": container with ID starting with a7d0015a1be617657522b97aecf4196f043c34c80d0a041365f41428739b5e76 not found: ID does not exist" May 21 15:41:11.559734 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.559663 2556 scope.go:117] "RemoveContainer" containerID="2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c" May 21 15:41:11.559864 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.559850 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c"} err="failed to get container status \"2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c\": rpc error: code = NotFound desc = could not find container \"2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c\": container with ID starting with 2d84dad08fb044268242f8ed16793eac8b121c6a4a166427ec5e818ca032904c not found: ID does not exist" May 21 15:41:11.574979 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.574957 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:41:11.575302 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575287 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy" May 21 15:41:11.575343 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575303 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy" May 21 15:41:11.575343 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575317 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy-web" May 21 15:41:11.575343 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575323 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy-web" May 21 15:41:11.575343 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575334 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146c4bb5-b729-4a04-84e3-479a645b6255" containerName="registry" May 21 15:41:11.575343 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575339 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="146c4bb5-b729-4a04-84e3-479a645b6255" containerName="registry" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575347 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="init-config-reloader" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575353 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="init-config-reloader" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575360 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="config-reloader" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575365 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="config-reloader" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575373 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy-metric" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575378 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy-metric" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575384 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="prom-label-proxy" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575389 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="prom-label-proxy" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575397 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="alertmanager" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575401 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="alertmanager" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575443 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="config-reloader" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575452 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="146c4bb5-b729-4a04-84e3-479a645b6255" containerName="registry" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575460 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy-web" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575466 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="alertmanager" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575472 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="prom-label-proxy" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575478 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy" May 21 15:41:11.575543 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.575484 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" containerName="kube-rbac-proxy-metric" May 21 15:41:11.577647 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577629 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-main-tls\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577684 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577653 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577684 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577665 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78kpv\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-kube-api-access-78kpv\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577684 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577675 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-config-volume\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577684 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-config-out\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577693 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577702 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-web-config\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577709 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e84163c-b56b-4374-a0a8-ddb636373b67-metrics-client-ca\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577718 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577726 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e84163c-b56b-4374-a0a8-ddb636373b67-cluster-tls-config\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577734 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e84163c-b56b-4374-a0a8-ddb636373b67-tls-assets\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.577772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.577742 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e84163c-b56b-4374-a0a8-ddb636373b67-alertmanager-main-db\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:11.579013 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.578997 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.581870 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.581849 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 15:41:11.581984 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.581871 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 15:41:11.581984 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.581895 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 15:41:11.581984 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.581940 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 15:41:11.581984 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.581849 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 15:41:11.582177 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.581849 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 15:41:11.582230 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.582207 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-srdtl\"" May 21 15:41:11.582276 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.582267 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 15:41:11.582330 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.582276 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 15:41:11.588814 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.588797 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 15:41:11.592402 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.592372 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:41:11.678096 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-config-volume\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678222 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-web-config\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678222 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678222 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678206 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678321 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678321 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678381 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-config-out\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678381 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678441 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678441 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678499 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678499 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678466 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.678564 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.678520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74b6r\" (UniqueName: \"kubernetes.io/projected/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-kube-api-access-74b6r\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.779475 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.779450 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.779583 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.779492 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-config-out\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.779583 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.779510 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.779583 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.779539 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.779583 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.779567 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.779784 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.779592 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.779784 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.779619 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.779784 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.779647 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74b6r\" (UniqueName: \"kubernetes.io/projected/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-kube-api-access-74b6r\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.780598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.780047 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-config-volume\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.780598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.780094 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-web-config\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.780598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.780123 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.780598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.780165 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.780598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.780198 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.780598 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.780418 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.782542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.782513 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-config-out\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.782987 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.782644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.782987 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.782667 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.782987 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.782834 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.782987 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.782938 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.782987 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.782946 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.783235 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.783096 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-web-config\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.783235 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.783189 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.783235 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.783209 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.783343 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.783322 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.784735 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.784717 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-config-volume\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.792047 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.792029 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74b6r\" (UniqueName: \"kubernetes.io/projected/b44e2a82-043e-45c6-92ed-f70a9bf7aef9-kube-api-access-74b6r\") pod \"alertmanager-main-0\" (UID: \"b44e2a82-043e-45c6-92ed-f70a9bf7aef9\") " pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:11.872153 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.872121 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e84163c-b56b-4374-a0a8-ddb636373b67" path="/var/lib/kubelet/pods/3e84163c-b56b-4374-a0a8-ddb636373b67/volumes" May 21 15:41:11.889876 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:11.889855 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 15:41:12.020289 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:12.020266 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 15:41:12.022096 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:41:12.022063 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44e2a82_043e_45c6_92ed_f70a9bf7aef9.slice/crio-cbf136ca0e48425743bfd7984ad747b627c17f92ce607869081252860e5c3bec WatchSource:0}: Error finding container cbf136ca0e48425743bfd7984ad747b627c17f92ce607869081252860e5c3bec: Status 404 returned error can't find the container with id cbf136ca0e48425743bfd7984ad747b627c17f92ce607869081252860e5c3bec May 21 15:41:12.514867 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:12.514833 2556 generic.go:358] "Generic (PLEG): container finished" podID="b44e2a82-043e-45c6-92ed-f70a9bf7aef9" containerID="58fe639ffac7b220caa6899812aee823cc878f8ae362149c7053d8497102a44a" exitCode=0 May 21 15:41:12.515299 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:12.514877 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b44e2a82-043e-45c6-92ed-f70a9bf7aef9","Type":"ContainerDied","Data":"58fe639ffac7b220caa6899812aee823cc878f8ae362149c7053d8497102a44a"} May 21 15:41:12.515299 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:12.514908 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b44e2a82-043e-45c6-92ed-f70a9bf7aef9","Type":"ContainerStarted","Data":"cbf136ca0e48425743bfd7984ad747b627c17f92ce607869081252860e5c3bec"} May 21 15:41:13.522043 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:13.522009 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b44e2a82-043e-45c6-92ed-f70a9bf7aef9","Type":"ContainerStarted","Data":"2c80470e62100639093a708340e3b6441fe57b9788a73188af058e55cd7f0e14"} May 21 15:41:13.522043 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:13.522046 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b44e2a82-043e-45c6-92ed-f70a9bf7aef9","Type":"ContainerStarted","Data":"d1ddecadad564912c5aae77da9d8df4e5bbef7c4de51d09ae2bdd3b238626487"} May 21 15:41:13.522425 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:13.522057 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b44e2a82-043e-45c6-92ed-f70a9bf7aef9","Type":"ContainerStarted","Data":"7ae16a8d190afeacc3559c05209205ea92da930d601fb07a866a3163b06e4d4d"} May 21 15:41:13.522425 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:13.522067 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b44e2a82-043e-45c6-92ed-f70a9bf7aef9","Type":"ContainerStarted","Data":"929600dc0f118cff825c8d6a5af441d41f2db141aaed9f8a38c21709202c109d"} May 21 15:41:13.522425 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:13.522077 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b44e2a82-043e-45c6-92ed-f70a9bf7aef9","Type":"ContainerStarted","Data":"f3f87499bac06be0146f82b01644353b34bdc5afefac92c0ffba4640bf9b48d1"} May 21 15:41:13.522425 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:13.522085 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b44e2a82-043e-45c6-92ed-f70a9bf7aef9","Type":"ContainerStarted","Data":"5a3f76a926640249b3f1a0dd5975be58ac5bcab71b02aebc6c1f46efaed9a810"} May 21 15:41:13.553059 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:13.553008 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5529934450000002 podStartE2EDuration="2.552993445s" podCreationTimestamp="2026-05-21 15:41:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:41:13.550394796 +0000 UTC m=+184.295067985" watchObservedRunningTime="2026-05-21 15:41:13.552993445 +0000 UTC m=+184.297666675" May 21 15:41:14.423821 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.423784 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:41:14.424552 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.424381 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="prometheus" containerID="cri-o://7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" gracePeriod=600 May 21 15:41:14.424552 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.424400 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy" containerID="cri-o://2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" gracePeriod=600 May 21 15:41:14.424552 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.424422 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="config-reloader" containerID="cri-o://5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" gracePeriod=600 May 21 15:41:14.424552 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.424434 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy-web" containerID="cri-o://ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" gracePeriod=600 May 21 15:41:14.424552 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.424400 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="thanos-sidecar" containerID="cri-o://37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" gracePeriod=600 May 21 15:41:14.424877 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.424737 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" gracePeriod=600 May 21 15:41:14.687638 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.687614 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:14.702606 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702586 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-tls-assets\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702746 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702615 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-kube-rbac-proxy\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702746 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702634 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-web-config\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702746 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702651 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-config-out\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702746 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702673 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-kubelet-serving-ca-bundle\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702992 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702803 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-rulefiles-0\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702992 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702866 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702992 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702896 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-db\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702992 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702953 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.702992 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.702980 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-metrics-client-ca\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703016 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-metrics-client-certs\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703047 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmdbd\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-kube-api-access-fmdbd\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703049 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:41:14.703239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703100 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-trusted-ca-bundle\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703130 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-serving-certs-ca-bundle\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703179 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-grpc-tls\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703209 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-config\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703234 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-tls\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703686 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703260 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-thanos-prometheus-http-client-file\") pod \"660e048a-49b4-485c-b38b-3999b0641c56\" (UID: \"660e048a-49b4-485c-b38b-3999b0641c56\") " May 21 15:41:14.703686 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703528 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.705278 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.703979 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:41:14.705278 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.704325 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:41:14.705278 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.704568 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:41:14.705628 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.705592 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:41:14.706112 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.705931 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:41:14.706112 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.705979 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-config-out" (OuterVolumeSpecName: "config-out") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:41:14.706112 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.706012 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:41:14.706411 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.706377 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.706998 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.706971 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.707626 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.707590 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-config" (OuterVolumeSpecName: "config") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.707793 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.707768 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.708185 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.708154 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.708344 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.708291 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-kube-api-access-fmdbd" (OuterVolumeSpecName: "kube-api-access-fmdbd") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "kube-api-access-fmdbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:41:14.708564 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.708539 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.709087 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.709050 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.709505 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.709485 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.720902 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.720878 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-web-config" (OuterVolumeSpecName: "web-config") pod "660e048a-49b4-485c-b38b-3999b0641c56" (UID: "660e048a-49b4-485c-b38b-3999b0641c56"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:41:14.804650 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804622 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-db\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804650 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804646 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804650 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804657 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-metrics-client-ca\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804666 2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-metrics-client-certs\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804675 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmdbd\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-kube-api-access-fmdbd\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804685 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804693 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804702 2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-grpc-tls\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804710 2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-config\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804721 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804729 2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804739 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/660e048a-49b4-485c-b38b-3999b0641c56-tls-assets\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804747 2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-kube-rbac-proxy\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804756 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-web-config\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804764 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/660e048a-49b4-485c-b38b-3999b0641c56-config-out\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804771 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/660e048a-49b4-485c-b38b-3999b0641c56-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:14.804850 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:14.804780 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/660e048a-49b4-485c-b38b-3999b0641c56-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 15:41:15.531538 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531504 2556 generic.go:358] "Generic (PLEG): container finished" podID="660e048a-49b4-485c-b38b-3999b0641c56" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" exitCode=0 May 21 15:41:15.531538 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531536 2556 generic.go:358] "Generic (PLEG): container finished" podID="660e048a-49b4-485c-b38b-3999b0641c56" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" exitCode=0 May 21 15:41:15.531715 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531547 2556 generic.go:358] "Generic (PLEG): container finished" podID="660e048a-49b4-485c-b38b-3999b0641c56" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" exitCode=0 May 21 15:41:15.531715 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531555 2556 generic.go:358] "Generic (PLEG): container finished" podID="660e048a-49b4-485c-b38b-3999b0641c56" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" exitCode=0 May 21 15:41:15.531715 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531562 2556 generic.go:358] "Generic (PLEG): container finished" podID="660e048a-49b4-485c-b38b-3999b0641c56" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" exitCode=0 May 21 15:41:15.531715 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531569 2556 generic.go:358] "Generic (PLEG): container finished" podID="660e048a-49b4-485c-b38b-3999b0641c56" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" exitCode=0 May 21 15:41:15.531715 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531585 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerDied","Data":"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8"} May 21 15:41:15.531715 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531624 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerDied","Data":"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a"} May 21 15:41:15.531715 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531634 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.531715 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531647 2556 scope.go:117] "RemoveContainer" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" May 21 15:41:15.532027 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531637 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerDied","Data":"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206"} May 21 15:41:15.532027 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531778 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerDied","Data":"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9"} May 21 15:41:15.532027 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531802 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerDied","Data":"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a"} May 21 15:41:15.532027 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531815 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerDied","Data":"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea"} May 21 15:41:15.532027 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.531830 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"660e048a-49b4-485c-b38b-3999b0641c56","Type":"ContainerDied","Data":"61edb99430af932c8b9011c3e360fbeecb140473df0713e7190191b871a94047"} May 21 15:41:15.539761 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.539744 2556 scope.go:117] "RemoveContainer" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" May 21 15:41:15.548832 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.548118 2556 scope.go:117] "RemoveContainer" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" May 21 15:41:15.554844 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.554823 2556 scope.go:117] "RemoveContainer" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" May 21 15:41:15.559286 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.559263 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:41:15.561371 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.561352 2556 scope.go:117] "RemoveContainer" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" May 21 15:41:15.564263 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.564243 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:41:15.567783 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.567765 2556 scope.go:117] "RemoveContainer" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" May 21 15:41:15.574277 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.574261 2556 scope.go:117] "RemoveContainer" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" May 21 15:41:15.580416 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.580402 2556 scope.go:117] "RemoveContainer" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" May 21 15:41:15.580641 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:15.580623 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": container with ID starting with f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8 not found: ID does not exist" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" May 21 15:41:15.580697 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.580649 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8"} err="failed to get container status \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": rpc error: code = NotFound desc = could not find container \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": container with ID starting with f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8 not found: ID does not exist" May 21 15:41:15.580697 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.580666 2556 scope.go:117] "RemoveContainer" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" May 21 15:41:15.580879 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:15.580864 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": container with ID starting with 2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a not found: ID does not exist" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" May 21 15:41:15.580931 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.580883 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a"} err="failed to get container status \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": rpc error: code = NotFound desc = could not find container \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": container with ID starting with 2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a not found: ID does not exist" May 21 15:41:15.580931 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.580896 2556 scope.go:117] "RemoveContainer" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" May 21 15:41:15.581153 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:15.581136 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": container with ID starting with ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206 not found: ID does not exist" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" May 21 15:41:15.581211 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.581158 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206"} err="failed to get container status \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": rpc error: code = NotFound desc = could not find container \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": container with ID starting with ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206 not found: ID does not exist" May 21 15:41:15.581211 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.581173 2556 scope.go:117] "RemoveContainer" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" May 21 15:41:15.581408 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:15.581393 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": container with ID starting with 37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9 not found: ID does not exist" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" May 21 15:41:15.581456 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.581410 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9"} err="failed to get container status \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": rpc error: code = NotFound desc = could not find container \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": container with ID starting with 37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9 not found: ID does not exist" May 21 15:41:15.581456 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.581422 2556 scope.go:117] "RemoveContainer" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" May 21 15:41:15.581612 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:15.581596 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": container with ID starting with 5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a not found: ID does not exist" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" May 21 15:41:15.581651 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.581615 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a"} err="failed to get container status \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": rpc error: code = NotFound desc = could not find container \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": container with ID starting with 5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a not found: ID does not exist" May 21 15:41:15.581651 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.581628 2556 scope.go:117] "RemoveContainer" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" May 21 15:41:15.581810 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:15.581796 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": container with ID starting with 7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea not found: ID does not exist" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" May 21 15:41:15.581845 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.581812 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea"} err="failed to get container status \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": rpc error: code = NotFound desc = could not find container \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": container with ID starting with 7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea not found: ID does not exist" May 21 15:41:15.581845 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.581823 2556 scope.go:117] "RemoveContainer" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" May 21 15:41:15.582038 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:41:15.582022 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": container with ID starting with a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd not found: ID does not exist" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" May 21 15:41:15.582074 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582042 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd"} err="failed to get container status \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": rpc error: code = NotFound desc = could not find container \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": container with ID starting with a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd not found: ID does not exist" May 21 15:41:15.582074 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582056 2556 scope.go:117] "RemoveContainer" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" May 21 15:41:15.582262 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582246 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8"} err="failed to get container status \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": rpc error: code = NotFound desc = could not find container \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": container with ID starting with f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8 not found: ID does not exist" May 21 15:41:15.582328 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582262 2556 scope.go:117] "RemoveContainer" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" May 21 15:41:15.582465 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582450 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a"} err="failed to get container status \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": rpc error: code = NotFound desc = could not find container \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": container with ID starting with 2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a not found: ID does not exist" May 21 15:41:15.582520 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582464 2556 scope.go:117] "RemoveContainer" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" May 21 15:41:15.582670 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582653 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206"} err="failed to get container status \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": rpc error: code = NotFound desc = could not find container \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": container with ID starting with ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206 not found: ID does not exist" May 21 15:41:15.582719 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582670 2556 scope.go:117] "RemoveContainer" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" May 21 15:41:15.582853 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582838 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9"} err="failed to get container status \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": rpc error: code = NotFound desc = could not find container \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": container with ID starting with 37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9 not found: ID does not exist" May 21 15:41:15.582903 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.582852 2556 scope.go:117] "RemoveContainer" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" May 21 15:41:15.583032 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583012 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a"} err="failed to get container status \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": rpc error: code = NotFound desc = could not find container \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": container with ID starting with 5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a not found: ID does not exist" May 21 15:41:15.583078 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583031 2556 scope.go:117] "RemoveContainer" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" May 21 15:41:15.583267 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583246 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea"} err="failed to get container status \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": rpc error: code = NotFound desc = could not find container \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": container with ID starting with 7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea not found: ID does not exist" May 21 15:41:15.583267 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583266 2556 scope.go:117] "RemoveContainer" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" May 21 15:41:15.583437 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583419 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd"} err="failed to get container status \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": rpc error: code = NotFound desc = could not find container \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": container with ID starting with a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd not found: ID does not exist" May 21 15:41:15.583494 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583439 2556 scope.go:117] "RemoveContainer" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" May 21 15:41:15.583696 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583680 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8"} err="failed to get container status \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": rpc error: code = NotFound desc = could not find container \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": container with ID starting with f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8 not found: ID does not exist" May 21 15:41:15.583696 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583696 2556 scope.go:117] "RemoveContainer" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" May 21 15:41:15.583871 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583855 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a"} err="failed to get container status \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": rpc error: code = NotFound desc = could not find container \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": container with ID starting with 2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a not found: ID does not exist" May 21 15:41:15.583936 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.583871 2556 scope.go:117] "RemoveContainer" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" May 21 15:41:15.584080 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584065 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206"} err="failed to get container status \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": rpc error: code = NotFound desc = could not find container \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": container with ID starting with ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206 not found: ID does not exist" May 21 15:41:15.584119 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584080 2556 scope.go:117] "RemoveContainer" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" May 21 15:41:15.584229 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584215 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9"} err="failed to get container status \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": rpc error: code = NotFound desc = could not find container \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": container with ID starting with 37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9 not found: ID does not exist" May 21 15:41:15.584267 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584231 2556 scope.go:117] "RemoveContainer" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" May 21 15:41:15.584432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584415 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a"} err="failed to get container status \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": rpc error: code = NotFound desc = could not find container \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": container with ID starting with 5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a not found: ID does not exist" May 21 15:41:15.584432 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584432 2556 scope.go:117] "RemoveContainer" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" May 21 15:41:15.584661 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584642 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea"} err="failed to get container status \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": rpc error: code = NotFound desc = could not find container \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": container with ID starting with 7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea not found: ID does not exist" May 21 15:41:15.584707 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584662 2556 scope.go:117] "RemoveContainer" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" May 21 15:41:15.584864 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584850 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd"} err="failed to get container status \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": rpc error: code = NotFound desc = could not find container \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": container with ID starting with a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd not found: ID does not exist" May 21 15:41:15.584864 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.584864 2556 scope.go:117] "RemoveContainer" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" May 21 15:41:15.585095 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585077 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8"} err="failed to get container status \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": rpc error: code = NotFound desc = could not find container \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": container with ID starting with f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8 not found: ID does not exist" May 21 15:41:15.585142 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585096 2556 scope.go:117] "RemoveContainer" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" May 21 15:41:15.585308 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585287 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a"} err="failed to get container status \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": rpc error: code = NotFound desc = could not find container \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": container with ID starting with 2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a not found: ID does not exist" May 21 15:41:15.585356 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585308 2556 scope.go:117] "RemoveContainer" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" May 21 15:41:15.585493 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585477 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206"} err="failed to get container status \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": rpc error: code = NotFound desc = could not find container \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": container with ID starting with ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206 not found: ID does not exist" May 21 15:41:15.585535 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585493 2556 scope.go:117] "RemoveContainer" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" May 21 15:41:15.585694 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585677 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9"} err="failed to get container status \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": rpc error: code = NotFound desc = could not find container \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": container with ID starting with 37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9 not found: ID does not exist" May 21 15:41:15.585739 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585694 2556 scope.go:117] "RemoveContainer" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" May 21 15:41:15.585868 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585853 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a"} err="failed to get container status \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": rpc error: code = NotFound desc = could not find container \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": container with ID starting with 5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a not found: ID does not exist" May 21 15:41:15.585907 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.585867 2556 scope.go:117] "RemoveContainer" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" May 21 15:41:15.586062 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586047 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea"} err="failed to get container status \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": rpc error: code = NotFound desc = could not find container \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": container with ID starting with 7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea not found: ID does not exist" May 21 15:41:15.586062 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586060 2556 scope.go:117] "RemoveContainer" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" May 21 15:41:15.586266 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586250 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd"} err="failed to get container status \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": rpc error: code = NotFound desc = could not find container \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": container with ID starting with a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd not found: ID does not exist" May 21 15:41:15.586317 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586266 2556 scope.go:117] "RemoveContainer" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" May 21 15:41:15.586446 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586433 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8"} err="failed to get container status \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": rpc error: code = NotFound desc = could not find container \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": container with ID starting with f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8 not found: ID does not exist" May 21 15:41:15.586488 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586446 2556 scope.go:117] "RemoveContainer" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" May 21 15:41:15.586669 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586652 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a"} err="failed to get container status \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": rpc error: code = NotFound desc = could not find container \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": container with ID starting with 2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a not found: ID does not exist" May 21 15:41:15.586669 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586669 2556 scope.go:117] "RemoveContainer" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" May 21 15:41:15.586853 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586838 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206"} err="failed to get container status \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": rpc error: code = NotFound desc = could not find container \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": container with ID starting with ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206 not found: ID does not exist" May 21 15:41:15.586853 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.586852 2556 scope.go:117] "RemoveContainer" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" May 21 15:41:15.587052 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587035 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9"} err="failed to get container status \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": rpc error: code = NotFound desc = could not find container \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": container with ID starting with 37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9 not found: ID does not exist" May 21 15:41:15.587097 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587052 2556 scope.go:117] "RemoveContainer" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" May 21 15:41:15.587233 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587218 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a"} err="failed to get container status \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": rpc error: code = NotFound desc = could not find container \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": container with ID starting with 5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a not found: ID does not exist" May 21 15:41:15.587289 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587233 2556 scope.go:117] "RemoveContainer" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" May 21 15:41:15.587406 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587392 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea"} err="failed to get container status \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": rpc error: code = NotFound desc = could not find container \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": container with ID starting with 7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea not found: ID does not exist" May 21 15:41:15.587447 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587406 2556 scope.go:117] "RemoveContainer" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" May 21 15:41:15.587620 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587600 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd"} err="failed to get container status \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": rpc error: code = NotFound desc = could not find container \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": container with ID starting with a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd not found: ID does not exist" May 21 15:41:15.587670 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587620 2556 scope.go:117] "RemoveContainer" containerID="f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8" May 21 15:41:15.587835 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587820 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8"} err="failed to get container status \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": rpc error: code = NotFound desc = could not find container \"f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8\": container with ID starting with f435071f914b6df2acba56e058a90f0d46f55143fa9d0531f415c1dc41bf9da8 not found: ID does not exist" May 21 15:41:15.587891 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.587834 2556 scope.go:117] "RemoveContainer" containerID="2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a" May 21 15:41:15.588052 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588035 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a"} err="failed to get container status \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": rpc error: code = NotFound desc = could not find container \"2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a\": container with ID starting with 2f70cbd621c46c56ba4018f20b514e28cfb82809faeec34963a0d49f918bbc4a not found: ID does not exist" May 21 15:41:15.588093 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588053 2556 scope.go:117] "RemoveContainer" containerID="ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206" May 21 15:41:15.588248 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588233 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206"} err="failed to get container status \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": rpc error: code = NotFound desc = could not find container \"ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206\": container with ID starting with ebb0b2b46fad326ddbbc76913e979ae80d1e457827de7a6fb79d3f96a2b53206 not found: ID does not exist" May 21 15:41:15.588248 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588247 2556 scope.go:117] "RemoveContainer" containerID="37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9" May 21 15:41:15.588447 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588429 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9"} err="failed to get container status \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": rpc error: code = NotFound desc = could not find container \"37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9\": container with ID starting with 37b1811c75200efbc8851904ce77ca9724058b0b2e1772e2ca0ef8244ff545e9 not found: ID does not exist" May 21 15:41:15.588447 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588447 2556 scope.go:117] "RemoveContainer" containerID="5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a" May 21 15:41:15.588647 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588629 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a"} err="failed to get container status \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": rpc error: code = NotFound desc = could not find container \"5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a\": container with ID starting with 5e68569eb0e0b0f16ca40d752a9dcea4150915bb0a570d738f96272571388c8a not found: ID does not exist" May 21 15:41:15.588647 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588644 2556 scope.go:117] "RemoveContainer" containerID="7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea" May 21 15:41:15.588844 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588826 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea"} err="failed to get container status \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": rpc error: code = NotFound desc = could not find container \"7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea\": container with ID starting with 7b31b23b8c838d4b320d8a10203b6f6dcf4327d4c880167bb0f0dd871188f6ea not found: ID does not exist" May 21 15:41:15.588887 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.588855 2556 scope.go:117] "RemoveContainer" containerID="a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd" May 21 15:41:15.589146 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.589123 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd"} err="failed to get container status \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": rpc error: code = NotFound desc = could not find container \"a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd\": container with ID starting with a059dfde683135432c91567a06a39609a32a173ab562d5bea4eb5a34e2475ebd not found: ID does not exist" May 21 15:41:15.593762 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.593741 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:41:15.594082 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594069 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="config-reloader" May 21 15:41:15.594121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594084 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="config-reloader" May 21 15:41:15.594121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594096 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="thanos-sidecar" May 21 15:41:15.594121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594101 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="thanos-sidecar" May 21 15:41:15.594121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594108 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy-thanos" May 21 15:41:15.594121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594114 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy-thanos" May 21 15:41:15.594121 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594121 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy-web" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594126 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy-web" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594142 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="prometheus" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594148 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="prometheus" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594158 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="init-config-reloader" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594163 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="init-config-reloader" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594169 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594175 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594223 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="thanos-sidecar" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594231 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="prometheus" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594237 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy-thanos" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594244 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy-web" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594251 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="config-reloader" May 21 15:41:15.594311 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.594257 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="660e048a-49b4-485c-b38b-3999b0641c56" containerName="kube-rbac-proxy" May 21 15:41:15.597864 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.597849 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.600596 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.600580 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 15:41:15.601124 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601105 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 15:41:15.601124 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601123 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 15:41:15.601272 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601155 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 15:41:15.601272 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601195 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 15:41:15.601272 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601235 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 15:41:15.601466 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601453 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hxcls\"" May 21 15:41:15.601681 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601666 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 15:41:15.601759 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601740 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 15:41:15.601818 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601781 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2uisn46ntisb2\"" May 21 15:41:15.601878 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601862 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 15:41:15.601878 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.601871 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 15:41:15.602271 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.602253 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 15:41:15.604287 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.604271 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 15:41:15.608316 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.608300 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 15:41:15.613442 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.613424 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:41:15.714105 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714042 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-config\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714105 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714105 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acb2293a-0936-4176-94f0-391b575bdf60-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714354 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714379 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acb2293a-0936-4176-94f0-391b575bdf60-config-out\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714444 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714433 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-web-config\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714739 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxlr2\" (UniqueName: \"kubernetes.io/projected/acb2293a-0936-4176-94f0-391b575bdf60-kube-api-access-xxlr2\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714739 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714739 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.714739 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.714519 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815202 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815171 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxlr2\" (UniqueName: \"kubernetes.io/projected/acb2293a-0936-4176-94f0-391b575bdf60-kube-api-access-xxlr2\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815207 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815248 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815271 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815290 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-config\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815311 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815612 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815339 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815612 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815399 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acb2293a-0936-4176-94f0-391b575bdf60-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815612 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815445 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815612 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815478 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815612 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815509 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815612 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815567 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815612 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815609 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815947 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815633 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815947 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815679 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acb2293a-0936-4176-94f0-391b575bdf60-config-out\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815947 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815708 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815947 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815733 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.815947 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.815759 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-web-config\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.816211 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.816067 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.816211 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.816136 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.817191 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.817130 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.817314 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.817217 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.818314 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.818239 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.818784 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.818663 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-config\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.819119 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.819097 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.819506 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.819485 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.819581 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.819503 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-web-config\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.820088 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.820036 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.820088 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.820050 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.820088 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.820082 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acb2293a-0936-4176-94f0-391b575bdf60-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.820322 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.820307 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.820906 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.820876 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acb2293a-0936-4176-94f0-391b575bdf60-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.821337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.821309 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.821337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.821328 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acb2293a-0936-4176-94f0-391b575bdf60-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.821463 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.821331 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acb2293a-0936-4176-94f0-391b575bdf60-config-out\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.824176 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.824161 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxlr2\" (UniqueName: \"kubernetes.io/projected/acb2293a-0936-4176-94f0-391b575bdf60-kube-api-access-xxlr2\") pod \"prometheus-k8s-0\" (UID: \"acb2293a-0936-4176-94f0-391b575bdf60\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:15.874355 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.874325 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="660e048a-49b4-485c-b38b-3999b0641c56" path="/var/lib/kubelet/pods/660e048a-49b4-485c-b38b-3999b0641c56/volumes" May 21 15:41:15.907686 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:15.907666 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:16.046929 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:16.046780 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 15:41:16.049979 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:41:16.049908 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb2293a_0936_4176_94f0_391b575bdf60.slice/crio-fea619c1b91d0f8dacf0ef98e719eefb9f7f1e6b87c77fdcedc6c4be436dd21d WatchSource:0}: Error finding container fea619c1b91d0f8dacf0ef98e719eefb9f7f1e6b87c77fdcedc6c4be436dd21d: Status 404 returned error can't find the container with id fea619c1b91d0f8dacf0ef98e719eefb9f7f1e6b87c77fdcedc6c4be436dd21d May 21 15:41:16.536013 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:16.535975 2556 generic.go:358] "Generic (PLEG): container finished" podID="acb2293a-0936-4176-94f0-391b575bdf60" containerID="571a11b31e5bf06abf1e3fd0ea170c40214694bbde37dc7b676e8cd912411a59" exitCode=0 May 21 15:41:16.536147 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:16.536067 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acb2293a-0936-4176-94f0-391b575bdf60","Type":"ContainerDied","Data":"571a11b31e5bf06abf1e3fd0ea170c40214694bbde37dc7b676e8cd912411a59"} May 21 15:41:16.536147 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:16.536109 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acb2293a-0936-4176-94f0-391b575bdf60","Type":"ContainerStarted","Data":"fea619c1b91d0f8dacf0ef98e719eefb9f7f1e6b87c77fdcedc6c4be436dd21d"} May 21 15:41:17.544983 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:17.544950 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acb2293a-0936-4176-94f0-391b575bdf60","Type":"ContainerStarted","Data":"46f0f23e050c967f91328dd67a37ebd4b11b17e6601532c071bf2f42d234bdfb"} May 21 15:41:17.544983 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:17.544988 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acb2293a-0936-4176-94f0-391b575bdf60","Type":"ContainerStarted","Data":"a33090671d4a8c7fd721b92eebd3da45f3a9604ffe7bdd5392223ade49ef6f24"} May 21 15:41:17.545364 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:17.545000 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acb2293a-0936-4176-94f0-391b575bdf60","Type":"ContainerStarted","Data":"c320f7d685ffa533e167f06ce605964b8ae6189a692e89749d5ec026aab493ad"} May 21 15:41:17.545364 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:17.545011 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acb2293a-0936-4176-94f0-391b575bdf60","Type":"ContainerStarted","Data":"509a16386736079c1b8ad1763a0d44ba24dc85eb7c422f557bba0107e47216b8"} May 21 15:41:17.545364 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:17.545022 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acb2293a-0936-4176-94f0-391b575bdf60","Type":"ContainerStarted","Data":"3abb5304ef7bd050f31d07e3beb52998b9bf77809e75cb905514dfa2bea95481"} May 21 15:41:17.545364 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:17.545033 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acb2293a-0936-4176-94f0-391b575bdf60","Type":"ContainerStarted","Data":"b4d17d37104877dbafa014d1959c7413b530afbb89cafc941367aed5df879e5c"} May 21 15:41:17.584705 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:17.579481 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5794657020000002 podStartE2EDuration="2.579465702s" podCreationTimestamp="2026-05-21 15:41:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:41:17.575716893 +0000 UTC m=+188.320390102" watchObservedRunningTime="2026-05-21 15:41:17.579465702 +0000 UTC m=+188.324138891" May 21 15:41:20.908018 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:20.907987 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:41:54.171537 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.171499 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-k7vk7"] May 21 15:41:54.173566 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.173547 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.176243 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.176221 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 15:41:54.182661 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.182639 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k7vk7"] May 21 15:41:54.293029 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.293008 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f63688fe-2c9d-48f3-9924-e5057f368c4f-kubelet-config\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.293154 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.293041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f63688fe-2c9d-48f3-9924-e5057f368c4f-dbus\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.293154 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.293065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f63688fe-2c9d-48f3-9924-e5057f368c4f-original-pull-secret\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.393381 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.393357 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f63688fe-2c9d-48f3-9924-e5057f368c4f-original-pull-secret\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.393476 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.393421 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f63688fe-2c9d-48f3-9924-e5057f368c4f-kubelet-config\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.393476 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.393464 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f63688fe-2c9d-48f3-9924-e5057f368c4f-dbus\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.393557 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.393494 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f63688fe-2c9d-48f3-9924-e5057f368c4f-kubelet-config\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.393609 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.393596 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f63688fe-2c9d-48f3-9924-e5057f368c4f-dbus\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.395735 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.395707 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f63688fe-2c9d-48f3-9924-e5057f368c4f-original-pull-secret\") pod \"global-pull-secret-syncer-k7vk7\" (UID: \"f63688fe-2c9d-48f3-9924-e5057f368c4f\") " pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.484105 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.484053 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7vk7" May 21 15:41:54.607904 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.607868 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k7vk7"] May 21 15:41:54.610617 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:41:54.610589 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63688fe_2c9d_48f3_9924_e5057f368c4f.slice/crio-4dd90676a665bebe38438992818b771495c5f056fd4c72208fd940bc2f045f7f WatchSource:0}: Error finding container 4dd90676a665bebe38438992818b771495c5f056fd4c72208fd940bc2f045f7f: Status 404 returned error can't find the container with id 4dd90676a665bebe38438992818b771495c5f056fd4c72208fd940bc2f045f7f May 21 15:41:54.654006 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:54.653983 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k7vk7" event={"ID":"f63688fe-2c9d-48f3-9924-e5057f368c4f","Type":"ContainerStarted","Data":"4dd90676a665bebe38438992818b771495c5f056fd4c72208fd940bc2f045f7f"} May 21 15:41:59.671579 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:59.671539 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k7vk7" event={"ID":"f63688fe-2c9d-48f3-9924-e5057f368c4f","Type":"ContainerStarted","Data":"9e24f146a5bf0253f046f6cb206425b56662c0e7eb488dbc9bdaef469e4c26c8"} May 21 15:41:59.688223 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:41:59.688178 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k7vk7" podStartSLOduration=1.720550341 podStartE2EDuration="5.688166188s" podCreationTimestamp="2026-05-21 15:41:54 +0000 UTC" firstStartedPulling="2026-05-21 15:41:54.612175821 +0000 UTC m=+225.356848987" lastFinishedPulling="2026-05-21 15:41:58.579791669 +0000 UTC m=+229.324464834" observedRunningTime="2026-05-21 15:41:59.687202337 +0000 UTC m=+230.431875526" watchObservedRunningTime="2026-05-21 15:41:59.688166188 +0000 UTC m=+230.432839375" May 21 15:42:15.908781 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:15.908748 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:42:15.923456 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:15.923436 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:42:16.737441 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:16.737413 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 15:42:48.229283 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.229247 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww"] May 21 15:42:48.231556 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.231537 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" May 21 15:42:48.234433 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.234408 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 15:42:48.234522 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.234459 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 15:42:48.235331 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.235313 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q7hkn\"" May 21 15:42:48.240442 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.240421 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww"] May 21 15:42:48.311649 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.311624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb5b6b62-6664-4de1-86bd-9922bdd0ed9f-tmp\") pod \"openshift-lws-operator-bfc7f696d-sbxww\" (UID: \"cb5b6b62-6664-4de1-86bd-9922bdd0ed9f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" May 21 15:42:48.311764 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.311665 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drbkt\" (UniqueName: \"kubernetes.io/projected/cb5b6b62-6664-4de1-86bd-9922bdd0ed9f-kube-api-access-drbkt\") pod \"openshift-lws-operator-bfc7f696d-sbxww\" (UID: \"cb5b6b62-6664-4de1-86bd-9922bdd0ed9f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" May 21 15:42:48.412968 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.412941 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb5b6b62-6664-4de1-86bd-9922bdd0ed9f-tmp\") pod \"openshift-lws-operator-bfc7f696d-sbxww\" (UID: \"cb5b6b62-6664-4de1-86bd-9922bdd0ed9f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" May 21 15:42:48.413094 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.412977 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drbkt\" (UniqueName: \"kubernetes.io/projected/cb5b6b62-6664-4de1-86bd-9922bdd0ed9f-kube-api-access-drbkt\") pod \"openshift-lws-operator-bfc7f696d-sbxww\" (UID: \"cb5b6b62-6664-4de1-86bd-9922bdd0ed9f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" May 21 15:42:48.413315 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.413295 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb5b6b62-6664-4de1-86bd-9922bdd0ed9f-tmp\") pod \"openshift-lws-operator-bfc7f696d-sbxww\" (UID: \"cb5b6b62-6664-4de1-86bd-9922bdd0ed9f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" May 21 15:42:48.422203 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.422182 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drbkt\" (UniqueName: \"kubernetes.io/projected/cb5b6b62-6664-4de1-86bd-9922bdd0ed9f-kube-api-access-drbkt\") pod \"openshift-lws-operator-bfc7f696d-sbxww\" (UID: \"cb5b6b62-6664-4de1-86bd-9922bdd0ed9f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" May 21 15:42:48.551223 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.551190 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" May 21 15:42:48.674594 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.674572 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww"] May 21 15:42:48.676663 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:42:48.676629 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb5b6b62_6664_4de1_86bd_9922bdd0ed9f.slice/crio-f7d81f279cf38a5bdafeebb1d02c8f571e6885828a1d8009a60d02c000c2da73 WatchSource:0}: Error finding container f7d81f279cf38a5bdafeebb1d02c8f571e6885828a1d8009a60d02c000c2da73: Status 404 returned error can't find the container with id f7d81f279cf38a5bdafeebb1d02c8f571e6885828a1d8009a60d02c000c2da73 May 21 15:42:48.819842 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:48.819767 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" event={"ID":"cb5b6b62-6664-4de1-86bd-9922bdd0ed9f","Type":"ContainerStarted","Data":"f7d81f279cf38a5bdafeebb1d02c8f571e6885828a1d8009a60d02c000c2da73"} May 21 15:42:51.830722 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:51.830648 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" event={"ID":"cb5b6b62-6664-4de1-86bd-9922bdd0ed9f","Type":"ContainerStarted","Data":"2a22eb108c7e15e4c6604c394a24e780660b2cead4d2d9151e5c74253acdfe50"} May 21 15:42:51.849573 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:42:51.849532 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sbxww" podStartSLOduration=0.998158691 podStartE2EDuration="3.849518818s" podCreationTimestamp="2026-05-21 15:42:48 +0000 UTC" firstStartedPulling="2026-05-21 15:42:48.678174359 +0000 UTC m=+279.422847525" lastFinishedPulling="2026-05-21 15:42:51.529534482 +0000 UTC m=+282.274207652" observedRunningTime="2026-05-21 15:42:51.848096962 +0000 UTC m=+282.592770161" watchObservedRunningTime="2026-05-21 15:42:51.849518818 +0000 UTC m=+282.594192005" May 21 15:43:09.748957 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:09.748907 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:43:09.751360 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:09.751332 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:43:09.752211 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:09.752192 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:43:09.754116 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:09.754095 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:43:09.758981 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:09.758965 2556 kubelet.go:1628] "Image garbage collection succeeded" May 21 15:43:11.235294 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.235261 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8"] May 21 15:43:11.238251 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.238236 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.241479 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.241458 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 15:43:11.241614 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.241457 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 15:43:11.242302 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.242283 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 15:43:11.242413 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.242336 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tsxsz\"" May 21 15:43:11.242585 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.242572 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 15:43:11.265888 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.265864 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8"] May 21 15:43:11.402242 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.402216 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwcf\" (UniqueName: \"kubernetes.io/projected/b421aa16-8001-4bef-bdc0-b0faf33e16d6-kube-api-access-fpwcf\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.402242 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.402251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b421aa16-8001-4bef-bdc0-b0faf33e16d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.402424 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.402277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b421aa16-8001-4bef-bdc0-b0faf33e16d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.503542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.503481 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwcf\" (UniqueName: \"kubernetes.io/projected/b421aa16-8001-4bef-bdc0-b0faf33e16d6-kube-api-access-fpwcf\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.503542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.503513 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b421aa16-8001-4bef-bdc0-b0faf33e16d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.503542 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.503539 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b421aa16-8001-4bef-bdc0-b0faf33e16d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.506036 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.506009 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b421aa16-8001-4bef-bdc0-b0faf33e16d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.506036 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.506029 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b421aa16-8001-4bef-bdc0-b0faf33e16d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.514188 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.514165 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwcf\" (UniqueName: \"kubernetes.io/projected/b421aa16-8001-4bef-bdc0-b0faf33e16d6-kube-api-access-fpwcf\") pod \"opendatahub-operator-controller-manager-5fcb49cc88-cw7l8\" (UID: \"b421aa16-8001-4bef-bdc0-b0faf33e16d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.549014 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.548990 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:11.684887 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.684865 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8"] May 21 15:43:11.687229 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:43:11.687203 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb421aa16_8001_4bef_bdc0_b0faf33e16d6.slice/crio-b827b2937300e734ca607089be1a9392485a431321e5449669997277d5da9a37 WatchSource:0}: Error finding container b827b2937300e734ca607089be1a9392485a431321e5449669997277d5da9a37: Status 404 returned error can't find the container with id b827b2937300e734ca607089be1a9392485a431321e5449669997277d5da9a37 May 21 15:43:11.689518 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.689501 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:43:11.897781 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:11.897755 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" event={"ID":"b421aa16-8001-4bef-bdc0-b0faf33e16d6","Type":"ContainerStarted","Data":"b827b2937300e734ca607089be1a9392485a431321e5449669997277d5da9a37"} May 21 15:43:14.909780 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:14.909732 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" event={"ID":"b421aa16-8001-4bef-bdc0-b0faf33e16d6","Type":"ContainerStarted","Data":"456278a8573d0fc7be8cf57c5e9b2e07a281721dbc83e9931c1001a355b757d9"} May 21 15:43:14.910270 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:14.909841 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:14.951328 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:14.951281 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" podStartSLOduration=1.499253287 podStartE2EDuration="3.951268206s" podCreationTimestamp="2026-05-21 15:43:11 +0000 UTC" firstStartedPulling="2026-05-21 15:43:11.689620282 +0000 UTC m=+302.434293451" lastFinishedPulling="2026-05-21 15:43:14.141635199 +0000 UTC m=+304.886308370" observedRunningTime="2026-05-21 15:43:14.946351742 +0000 UTC m=+305.691024945" watchObservedRunningTime="2026-05-21 15:43:14.951268206 +0000 UTC m=+305.695941394" May 21 15:43:17.468044 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.468006 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76499b6586-k582z"] May 21 15:43:17.471654 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.471631 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.475313 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.475274 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 15:43:17.475448 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.475419 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d9qhc\"" May 21 15:43:17.476114 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.476099 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 15:43:17.476187 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.476140 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 15:43:17.486101 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.486079 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76499b6586-k582z"] May 21 15:43:17.558337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.558302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2162b28-adaf-4c4d-ae33-d1abe08be83d-cert\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.558337 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.558337 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdfr8\" (UniqueName: \"kubernetes.io/projected/a2162b28-adaf-4c4d-ae33-d1abe08be83d-kube-api-access-kdfr8\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.558564 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.558422 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2162b28-adaf-4c4d-ae33-d1abe08be83d-manager-config\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.558564 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.558510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2162b28-adaf-4c4d-ae33-d1abe08be83d-metrics-cert\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.658903 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.658861 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2162b28-adaf-4c4d-ae33-d1abe08be83d-metrics-cert\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.659081 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.658908 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2162b28-adaf-4c4d-ae33-d1abe08be83d-cert\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.659081 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.658960 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdfr8\" (UniqueName: \"kubernetes.io/projected/a2162b28-adaf-4c4d-ae33-d1abe08be83d-kube-api-access-kdfr8\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.659081 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.659001 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2162b28-adaf-4c4d-ae33-d1abe08be83d-manager-config\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.659629 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.659606 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2162b28-adaf-4c4d-ae33-d1abe08be83d-manager-config\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.661326 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.661306 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2162b28-adaf-4c4d-ae33-d1abe08be83d-metrics-cert\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.661389 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.661337 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2162b28-adaf-4c4d-ae33-d1abe08be83d-cert\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.674993 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.674969 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdfr8\" (UniqueName: \"kubernetes.io/projected/a2162b28-adaf-4c4d-ae33-d1abe08be83d-kube-api-access-kdfr8\") pod \"lws-controller-manager-76499b6586-k582z\" (UID: \"a2162b28-adaf-4c4d-ae33-d1abe08be83d\") " pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.782113 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.782088 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:17.919206 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:17.919178 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76499b6586-k582z"] May 21 15:43:17.922412 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:43:17.922378 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2162b28_adaf_4c4d_ae33_d1abe08be83d.slice/crio-5616ff6383ac6bc14f3a4ff4b219a9c240f097b079367652522163a176ea6973 WatchSource:0}: Error finding container 5616ff6383ac6bc14f3a4ff4b219a9c240f097b079367652522163a176ea6973: Status 404 returned error can't find the container with id 5616ff6383ac6bc14f3a4ff4b219a9c240f097b079367652522163a176ea6973 May 21 15:43:18.924700 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:18.924654 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" event={"ID":"a2162b28-adaf-4c4d-ae33-d1abe08be83d","Type":"ContainerStarted","Data":"5616ff6383ac6bc14f3a4ff4b219a9c240f097b079367652522163a176ea6973"} May 21 15:43:20.932496 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:20.932458 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" event={"ID":"a2162b28-adaf-4c4d-ae33-d1abe08be83d","Type":"ContainerStarted","Data":"09851d04f554ac2111ab27f25408232b54e772f76d2325e8f026b9a5dc734070"} May 21 15:43:20.932873 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:20.932600 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:20.960119 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:20.960078 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" podStartSLOduration=1.866827703 podStartE2EDuration="3.960066753s" podCreationTimestamp="2026-05-21 15:43:17 +0000 UTC" firstStartedPulling="2026-05-21 15:43:17.924064597 +0000 UTC m=+308.668737767" lastFinishedPulling="2026-05-21 15:43:20.01730365 +0000 UTC m=+310.761976817" observedRunningTime="2026-05-21 15:43:20.958022594 +0000 UTC m=+311.702695782" watchObservedRunningTime="2026-05-21 15:43:20.960066753 +0000 UTC m=+311.704739941" May 21 15:43:25.914600 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:25.914576 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fcb49cc88-cw7l8" May 21 15:43:30.016365 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.016330 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2"] May 21 15:43:30.021240 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.021224 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.026109 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.026079 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-29rr4\"" May 21 15:43:30.026239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.026131 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 15:43:30.026239 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.026131 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 15:43:30.026356 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.026302 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 15:43:30.026408 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.026359 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 15:43:30.035159 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.035137 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2"] May 21 15:43:30.054657 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.054631 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54ada04-080f-48b6-914e-babe3139928c-tls-certs\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.054777 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.054669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c54ada04-080f-48b6-914e-babe3139928c-tmp\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.054777 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.054720 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g7mg\" (UniqueName: \"kubernetes.io/projected/c54ada04-080f-48b6-914e-babe3139928c-kube-api-access-9g7mg\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.155951 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.155892 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54ada04-080f-48b6-914e-babe3139928c-tls-certs\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.156084 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.155988 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c54ada04-080f-48b6-914e-babe3139928c-tmp\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.156084 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.156032 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9g7mg\" (UniqueName: \"kubernetes.io/projected/c54ada04-080f-48b6-914e-babe3139928c-kube-api-access-9g7mg\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.158223 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.158198 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c54ada04-080f-48b6-914e-babe3139928c-tmp\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.158459 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.158439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54ada04-080f-48b6-914e-babe3139928c-tls-certs\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.170127 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.170099 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g7mg\" (UniqueName: \"kubernetes.io/projected/c54ada04-080f-48b6-914e-babe3139928c-kube-api-access-9g7mg\") pod \"kube-auth-proxy-89947cdcb-x2jl2\" (UID: \"c54ada04-080f-48b6-914e-babe3139928c\") " pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.330827 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.330759 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" May 21 15:43:30.459030 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.459008 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2"] May 21 15:43:30.461176 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:43:30.461150 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54ada04_080f_48b6_914e_babe3139928c.slice/crio-8346edf3874bfc3dd415ef37b33d891ea9db21858dc45ec5ceca4a4cf586f5b6 WatchSource:0}: Error finding container 8346edf3874bfc3dd415ef37b33d891ea9db21858dc45ec5ceca4a4cf586f5b6: Status 404 returned error can't find the container with id 8346edf3874bfc3dd415ef37b33d891ea9db21858dc45ec5ceca4a4cf586f5b6 May 21 15:43:30.962467 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:30.962434 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" event={"ID":"c54ada04-080f-48b6-914e-babe3139928c","Type":"ContainerStarted","Data":"8346edf3874bfc3dd415ef37b33d891ea9db21858dc45ec5ceca4a4cf586f5b6"} May 21 15:43:31.937654 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:31.937620 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76499b6586-k582z" May 21 15:43:33.972662 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:33.972631 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" event={"ID":"c54ada04-080f-48b6-914e-babe3139928c","Type":"ContainerStarted","Data":"21c11beb88ec9bc927b7b43052e244d224b09f8f19ad1af79e026458af3d1214"} May 21 15:43:33.992831 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:43:33.992780 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-89947cdcb-x2jl2" podStartSLOduration=1.65183434 podStartE2EDuration="4.992767187s" podCreationTimestamp="2026-05-21 15:43:29 +0000 UTC" firstStartedPulling="2026-05-21 15:43:30.462826344 +0000 UTC m=+321.207499511" lastFinishedPulling="2026-05-21 15:43:33.803759189 +0000 UTC m=+324.548432358" observedRunningTime="2026-05-21 15:43:33.990787107 +0000 UTC m=+324.735460297" watchObservedRunningTime="2026-05-21 15:43:33.992767187 +0000 UTC m=+324.737440375" May 21 15:45:03.043388 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.043353 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g"] May 21 15:45:03.046672 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.046655 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" May 21 15:45:03.055847 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.055831 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 15:45:03.055945 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.055887 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kjvjl\"" May 21 15:45:03.056763 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.056748 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 15:45:03.056805 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.056749 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 15:45:03.065115 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.065087 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g"] May 21 15:45:03.166058 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.166022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v925d\" (UniqueName: \"kubernetes.io/projected/942a9f6d-b84f-4980-81ff-cbb6669cc961-kube-api-access-v925d\") pod \"dns-operator-controller-manager-648d5c98bc-jmv4g\" (UID: \"942a9f6d-b84f-4980-81ff-cbb6669cc961\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" May 21 15:45:03.267476 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.267443 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v925d\" (UniqueName: \"kubernetes.io/projected/942a9f6d-b84f-4980-81ff-cbb6669cc961-kube-api-access-v925d\") pod \"dns-operator-controller-manager-648d5c98bc-jmv4g\" (UID: \"942a9f6d-b84f-4980-81ff-cbb6669cc961\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" May 21 15:45:03.278752 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.278723 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v925d\" (UniqueName: \"kubernetes.io/projected/942a9f6d-b84f-4980-81ff-cbb6669cc961-kube-api-access-v925d\") pod \"dns-operator-controller-manager-648d5c98bc-jmv4g\" (UID: \"942a9f6d-b84f-4980-81ff-cbb6669cc961\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" May 21 15:45:03.356723 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.356650 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" May 21 15:45:03.493050 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:03.493020 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g"] May 21 15:45:03.497275 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:45:03.497251 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942a9f6d_b84f_4980_81ff_cbb6669cc961.slice/crio-f0b4d5d31ee0224aabe6ad64f781d213b7352f96f4ceeb15a2e0a02f3a8a3c0a WatchSource:0}: Error finding container f0b4d5d31ee0224aabe6ad64f781d213b7352f96f4ceeb15a2e0a02f3a8a3c0a: Status 404 returned error can't find the container with id f0b4d5d31ee0224aabe6ad64f781d213b7352f96f4ceeb15a2e0a02f3a8a3c0a May 21 15:45:04.272230 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:04.272183 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" event={"ID":"942a9f6d-b84f-4980-81ff-cbb6669cc961","Type":"ContainerStarted","Data":"f0b4d5d31ee0224aabe6ad64f781d213b7352f96f4ceeb15a2e0a02f3a8a3c0a"} May 21 15:45:06.281253 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:06.281215 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" event={"ID":"942a9f6d-b84f-4980-81ff-cbb6669cc961","Type":"ContainerStarted","Data":"9b84343a57a13a368d90ad7d6b778c17c1073ecdb6d178c28900c586e4249327"} May 21 15:45:06.281600 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:06.281345 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" May 21 15:45:06.316880 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:06.316796 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" podStartSLOduration=1.319404006 podStartE2EDuration="3.316780063s" podCreationTimestamp="2026-05-21 15:45:03 +0000 UTC" firstStartedPulling="2026-05-21 15:45:03.49967039 +0000 UTC m=+414.244343556" lastFinishedPulling="2026-05-21 15:45:05.497046441 +0000 UTC m=+416.241719613" observedRunningTime="2026-05-21 15:45:06.314828144 +0000 UTC m=+417.059501332" watchObservedRunningTime="2026-05-21 15:45:06.316780063 +0000 UTC m=+417.061453252" May 21 15:45:10.336036 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.336002 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c"] May 21 15:45:10.339552 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.339533 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:10.343112 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.343079 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 15:45:10.343112 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.343082 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xk6l2\"" May 21 15:45:10.343754 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.343736 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 15:45:10.354943 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.354906 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c"] May 21 15:45:10.424841 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.424817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/00f06d34-7481-4f8c-acf1-63092e7b1310-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:10.424948 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.424863 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q99th\" (UniqueName: \"kubernetes.io/projected/00f06d34-7481-4f8c-acf1-63092e7b1310-kube-api-access-q99th\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:10.424948 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.424905 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/00f06d34-7481-4f8c-acf1-63092e7b1310-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:10.525925 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.525892 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/00f06d34-7481-4f8c-acf1-63092e7b1310-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:10.526006 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.525973 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q99th\" (UniqueName: \"kubernetes.io/projected/00f06d34-7481-4f8c-acf1-63092e7b1310-kube-api-access-q99th\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:10.526061 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.526006 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/00f06d34-7481-4f8c-acf1-63092e7b1310-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:10.526099 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:45:10.526053 2556 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 21 15:45:10.526145 ip-10-0-129-52 kubenswrapper[2556]: E0521 15:45:10.526120 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00f06d34-7481-4f8c-acf1-63092e7b1310-plugin-serving-cert podName:00f06d34-7481-4f8c-acf1-63092e7b1310 nodeName:}" failed. No retries permitted until 2026-05-21 15:45:11.026098553 +0000 UTC m=+421.770771725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/00f06d34-7481-4f8c-acf1-63092e7b1310-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-fm59c" (UID: "00f06d34-7481-4f8c-acf1-63092e7b1310") : secret "plugin-serving-cert" not found May 21 15:45:10.526594 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.526578 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/00f06d34-7481-4f8c-acf1-63092e7b1310-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:10.547018 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:10.546988 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q99th\" (UniqueName: \"kubernetes.io/projected/00f06d34-7481-4f8c-acf1-63092e7b1310-kube-api-access-q99th\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:11.029764 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:11.029730 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/00f06d34-7481-4f8c-acf1-63092e7b1310-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:11.031952 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:11.031928 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/00f06d34-7481-4f8c-acf1-63092e7b1310-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fm59c\" (UID: \"00f06d34-7481-4f8c-acf1-63092e7b1310\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:11.248729 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:11.248698 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" May 21 15:45:11.401536 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:11.401472 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c"] May 21 15:45:11.403857 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:45:11.403828 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00f06d34_7481_4f8c_acf1_63092e7b1310.slice/crio-0c33c39cac79d91037df1986854649860b1f0a60a885bde0f17d8abca251371f WatchSource:0}: Error finding container 0c33c39cac79d91037df1986854649860b1f0a60a885bde0f17d8abca251371f: Status 404 returned error can't find the container with id 0c33c39cac79d91037df1986854649860b1f0a60a885bde0f17d8abca251371f May 21 15:45:12.302770 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:12.302723 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" event={"ID":"00f06d34-7481-4f8c-acf1-63092e7b1310","Type":"ContainerStarted","Data":"0c33c39cac79d91037df1986854649860b1f0a60a885bde0f17d8abca251371f"} May 21 15:45:17.286603 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:17.286573 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jmv4g" May 21 15:45:20.935390 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:20.935205 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4"] May 21 15:45:20.938929 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:20.938890 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:20.942378 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:20.942356 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rf582\"" May 21 15:45:20.970698 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:20.970676 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4"] May 21 15:45:21.023382 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:21.023358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83122028-ea16-4b22-9af6-bdc83685386e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf4j4\" (UID: \"83122028-ea16-4b22-9af6-bdc83685386e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:21.023527 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:21.023506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xlxj\" (UniqueName: \"kubernetes.io/projected/83122028-ea16-4b22-9af6-bdc83685386e-kube-api-access-8xlxj\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf4j4\" (UID: \"83122028-ea16-4b22-9af6-bdc83685386e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:21.124631 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:21.124589 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xlxj\" (UniqueName: \"kubernetes.io/projected/83122028-ea16-4b22-9af6-bdc83685386e-kube-api-access-8xlxj\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf4j4\" (UID: \"83122028-ea16-4b22-9af6-bdc83685386e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:21.124791 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:21.124710 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83122028-ea16-4b22-9af6-bdc83685386e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf4j4\" (UID: \"83122028-ea16-4b22-9af6-bdc83685386e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:21.125127 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:21.125097 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83122028-ea16-4b22-9af6-bdc83685386e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf4j4\" (UID: \"83122028-ea16-4b22-9af6-bdc83685386e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:21.139849 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:21.139822 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xlxj\" (UniqueName: \"kubernetes.io/projected/83122028-ea16-4b22-9af6-bdc83685386e-kube-api-access-8xlxj\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf4j4\" (UID: \"83122028-ea16-4b22-9af6-bdc83685386e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:21.250752 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:21.250678 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:34.966425 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:34.966400 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4"] May 21 15:45:34.967260 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:45:34.967232 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83122028_ea16_4b22_9af6_bdc83685386e.slice/crio-5375668ab83b4deb0aa5ca6253b838259b324ccd437930e5ef34391e67202efe WatchSource:0}: Error finding container 5375668ab83b4deb0aa5ca6253b838259b324ccd437930e5ef34391e67202efe: Status 404 returned error can't find the container with id 5375668ab83b4deb0aa5ca6253b838259b324ccd437930e5ef34391e67202efe May 21 15:45:35.393495 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:35.393453 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" event={"ID":"83122028-ea16-4b22-9af6-bdc83685386e","Type":"ContainerStarted","Data":"5375668ab83b4deb0aa5ca6253b838259b324ccd437930e5ef34391e67202efe"} May 21 15:45:35.394587 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:35.394564 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" event={"ID":"00f06d34-7481-4f8c-acf1-63092e7b1310","Type":"ContainerStarted","Data":"e5587de92d47695dc7333352fa4923e942763057069a07bd80437c023c263cd8"} May 21 15:45:35.418686 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:35.418632 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fm59c" podStartSLOduration=1.887413429 podStartE2EDuration="25.418616668s" podCreationTimestamp="2026-05-21 15:45:10 +0000 UTC" firstStartedPulling="2026-05-21 15:45:11.405084015 +0000 UTC m=+422.149757184" lastFinishedPulling="2026-05-21 15:45:34.936287251 +0000 UTC m=+445.680960423" observedRunningTime="2026-05-21 15:45:35.417440125 +0000 UTC m=+446.162113312" watchObservedRunningTime="2026-05-21 15:45:35.418616668 +0000 UTC m=+446.163289858" May 21 15:45:40.416761 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:40.416717 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" event={"ID":"83122028-ea16-4b22-9af6-bdc83685386e","Type":"ContainerStarted","Data":"079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede"} May 21 15:45:40.417299 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:40.416845 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:45:40.441218 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:40.441167 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" podStartSLOduration=15.477185817 podStartE2EDuration="20.441152013s" podCreationTimestamp="2026-05-21 15:45:20 +0000 UTC" firstStartedPulling="2026-05-21 15:45:34.969495035 +0000 UTC m=+445.714168210" lastFinishedPulling="2026-05-21 15:45:39.933461237 +0000 UTC m=+450.678134406" observedRunningTime="2026-05-21 15:45:40.439548798 +0000 UTC m=+451.184222011" watchObservedRunningTime="2026-05-21 15:45:40.441152013 +0000 UTC m=+451.185825500" May 21 15:45:51.422644 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:45:51.422613 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 15:47:38.168985 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.168946 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-5bctx"] May 21 15:47:38.171429 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.171411 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" May 21 15:47:38.174548 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.174528 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p9hdw\"" May 21 15:47:38.174548 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.174544 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 15:47:38.183149 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.183126 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-5bctx"] May 21 15:47:38.325686 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.325649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dklps\" (UniqueName: \"kubernetes.io/projected/75f426d4-7f51-4254-9ae1-c4562265735c-kube-api-access-dklps\") pod \"payload-processing-58b6c8fdc7-5bctx\" (UID: \"75f426d4-7f51-4254-9ae1-c4562265735c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" May 21 15:47:38.426604 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.426511 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dklps\" (UniqueName: \"kubernetes.io/projected/75f426d4-7f51-4254-9ae1-c4562265735c-kube-api-access-dklps\") pod \"payload-processing-58b6c8fdc7-5bctx\" (UID: \"75f426d4-7f51-4254-9ae1-c4562265735c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" May 21 15:47:38.437040 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.437014 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dklps\" (UniqueName: \"kubernetes.io/projected/75f426d4-7f51-4254-9ae1-c4562265735c-kube-api-access-dklps\") pod \"payload-processing-58b6c8fdc7-5bctx\" (UID: \"75f426d4-7f51-4254-9ae1-c4562265735c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" May 21 15:47:38.482026 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.481996 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" May 21 15:47:38.616191 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.616155 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-5bctx"] May 21 15:47:38.620016 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:47:38.619984 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f426d4_7f51_4254_9ae1_c4562265735c.slice/crio-4941a92f11344ecd7df57098189f8f6119cdf431028d1cee1a6dc0610026d6e2 WatchSource:0}: Error finding container 4941a92f11344ecd7df57098189f8f6119cdf431028d1cee1a6dc0610026d6e2: Status 404 returned error can't find the container with id 4941a92f11344ecd7df57098189f8f6119cdf431028d1cee1a6dc0610026d6e2 May 21 15:47:38.819560 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:38.819524 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" event={"ID":"75f426d4-7f51-4254-9ae1-c4562265735c","Type":"ContainerStarted","Data":"4941a92f11344ecd7df57098189f8f6119cdf431028d1cee1a6dc0610026d6e2"} May 21 15:47:41.832030 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:41.831993 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" event={"ID":"75f426d4-7f51-4254-9ae1-c4562265735c","Type":"ContainerStarted","Data":"80e526eb8359da25be660bd8e0e229b7c45c2ddeaf2dcdc40ee2ff5935ef8e80"} May 21 15:47:41.832429 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:41.832090 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" May 21 15:47:41.852438 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:41.852391 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" podStartSLOduration=1.461575615 podStartE2EDuration="3.85237653s" podCreationTimestamp="2026-05-21 15:47:38 +0000 UTC" firstStartedPulling="2026-05-21 15:47:38.621758072 +0000 UTC m=+569.366431241" lastFinishedPulling="2026-05-21 15:47:41.012558991 +0000 UTC m=+571.757232156" observedRunningTime="2026-05-21 15:47:41.849866712 +0000 UTC m=+572.594539900" watchObservedRunningTime="2026-05-21 15:47:41.85237653 +0000 UTC m=+572.597049717" May 21 15:47:52.837952 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:47:52.837899 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-5bctx" May 21 15:48:02.202458 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.202422 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp"] May 21 15:48:02.211359 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.211315 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.216492 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.216453 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 15:48:02.218033 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.218003 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 15:48:02.218033 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.218024 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qjlht\"" May 21 15:48:02.218209 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.218016 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 15:48:02.221901 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.221880 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp"] May 21 15:48:02.244036 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.244005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efe64955-738c-4ba0-aaa5-ebdf613ab378-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.244162 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.244080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfv22\" (UniqueName: \"kubernetes.io/projected/efe64955-738c-4ba0-aaa5-ebdf613ab378-kube-api-access-zfv22\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.244162 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.244101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.244162 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.244117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.244162 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.244137 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.244162 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.244154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345117 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345079 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv22\" (UniqueName: \"kubernetes.io/projected/efe64955-738c-4ba0-aaa5-ebdf613ab378-kube-api-access-zfv22\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345309 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345125 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345309 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345148 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345309 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345169 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345309 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345192 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345309 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345246 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efe64955-738c-4ba0-aaa5-ebdf613ab378-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345685 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345656 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345755 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345700 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.345755 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.345744 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.347550 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.347526 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efe64955-738c-4ba0-aaa5-ebdf613ab378-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.347796 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.347778 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efe64955-738c-4ba0-aaa5-ebdf613ab378-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.353856 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.353834 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfv22\" (UniqueName: \"kubernetes.io/projected/efe64955-738c-4ba0-aaa5-ebdf613ab378-kube-api-access-zfv22\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp\" (UID: \"efe64955-738c-4ba0-aaa5-ebdf613ab378\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.527564 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.527519 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:02.666683 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.666654 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp"] May 21 15:48:02.669598 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:48:02.669565 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe64955_738c_4ba0_aaa5_ebdf613ab378.slice/crio-36a8372bdb9c19b31e27a4827f8c325163b352d962d96b2c39514347015416c1 WatchSource:0}: Error finding container 36a8372bdb9c19b31e27a4827f8c325163b352d962d96b2c39514347015416c1: Status 404 returned error can't find the container with id 36a8372bdb9c19b31e27a4827f8c325163b352d962d96b2c39514347015416c1 May 21 15:48:02.907445 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:02.907361 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" event={"ID":"efe64955-738c-4ba0-aaa5-ebdf613ab378","Type":"ContainerStarted","Data":"36a8372bdb9c19b31e27a4827f8c325163b352d962d96b2c39514347015416c1"} May 21 15:48:08.933465 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:08.933425 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" event={"ID":"efe64955-738c-4ba0-aaa5-ebdf613ab378","Type":"ContainerStarted","Data":"14319449b5405142706ccc7824743ad7c0af5c2e1a654ec660c3240b1a162a34"} May 21 15:48:09.780714 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:09.780685 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:48:09.781119 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:09.781091 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:48:09.786826 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:09.786788 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:48:09.787282 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:09.787261 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:48:13.954585 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:13.954494 2556 generic.go:358] "Generic (PLEG): container finished" podID="efe64955-738c-4ba0-aaa5-ebdf613ab378" containerID="14319449b5405142706ccc7824743ad7c0af5c2e1a654ec660c3240b1a162a34" exitCode=0 May 21 15:48:13.954585 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:13.954566 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" event={"ID":"efe64955-738c-4ba0-aaa5-ebdf613ab378","Type":"ContainerDied","Data":"14319449b5405142706ccc7824743ad7c0af5c2e1a654ec660c3240b1a162a34"} May 21 15:48:13.955233 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:13.955217 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:48:15.963550 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:15.963513 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" event={"ID":"efe64955-738c-4ba0-aaa5-ebdf613ab378","Type":"ContainerStarted","Data":"fba2428a18e9fcab057039e61457e7715280dae850b4212ef93c7ca67a35a88a"} May 21 15:48:15.963956 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:15.963731 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:15.990841 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:15.990790 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" podStartSLOduration=1.539870803 podStartE2EDuration="13.990773895s" podCreationTimestamp="2026-05-21 15:48:02 +0000 UTC" firstStartedPulling="2026-05-21 15:48:02.671317318 +0000 UTC m=+593.415990487" lastFinishedPulling="2026-05-21 15:48:15.122220405 +0000 UTC m=+605.866893579" observedRunningTime="2026-05-21 15:48:15.98909969 +0000 UTC m=+606.733772879" watchObservedRunningTime="2026-05-21 15:48:15.990773895 +0000 UTC m=+606.735447082" May 21 15:48:16.109872 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.109837 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d"] May 21 15:48:16.113409 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.113394 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.116063 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.116041 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 15:48:16.124219 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.124196 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d"] May 21 15:48:16.183518 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.183488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.183677 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.183548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.183677 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.183590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.183677 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.183625 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9smkh\" (UniqueName: \"kubernetes.io/projected/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-kube-api-access-9smkh\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.183677 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.183671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.183836 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.183697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.284476 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.284432 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.284654 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.284534 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.284654 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.284581 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.284654 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.284617 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9smkh\" (UniqueName: \"kubernetes.io/projected/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-kube-api-access-9smkh\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.284801 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.284664 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.284801 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.284692 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.284895 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.284877 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.285014 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.284889 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.285130 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.285108 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.286809 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.286787 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.287118 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.287099 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.294581 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.294547 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9smkh\" (UniqueName: \"kubernetes.io/projected/3589a9db-d1cd-4f1d-aa97-6b9a0531ee19-kube-api-access-9smkh\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-wn27d\" (UID: \"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.422972 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.422933 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:16.562855 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.562822 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d"] May 21 15:48:16.565544 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:48:16.565517 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3589a9db_d1cd_4f1d_aa97_6b9a0531ee19.slice/crio-9674881b5e7565eae0e2aad17f6be2e9daa047692d8378bf6cf05a25dee677de WatchSource:0}: Error finding container 9674881b5e7565eae0e2aad17f6be2e9daa047692d8378bf6cf05a25dee677de: Status 404 returned error can't find the container with id 9674881b5e7565eae0e2aad17f6be2e9daa047692d8378bf6cf05a25dee677de May 21 15:48:16.968373 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.968279 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" event={"ID":"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19","Type":"ContainerStarted","Data":"5ca6a949a43cc2cbd82334eb4bcf808f533c4fa01d7afadd84a3c5b618105142"} May 21 15:48:16.968373 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:16.968329 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" event={"ID":"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19","Type":"ContainerStarted","Data":"9674881b5e7565eae0e2aad17f6be2e9daa047692d8378bf6cf05a25dee677de"} May 21 15:48:21.995821 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:21.995736 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p"] May 21 15:48:22.002290 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.002262 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.007094 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.007066 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 15:48:22.009128 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.009104 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p"] May 21 15:48:22.150167 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.150122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.150346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.150223 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e893059-2034-48c1-bb28-88a5dd26e2e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.150346 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.150304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.150421 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.150391 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2vlg\" (UniqueName: \"kubernetes.io/projected/3e893059-2034-48c1-bb28-88a5dd26e2e2-kube-api-access-z2vlg\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.150492 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.150465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.150540 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.150515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.251418 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.251327 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.251418 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.251369 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.251418 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.251414 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.251671 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.251475 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e893059-2034-48c1-bb28-88a5dd26e2e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.251671 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.251527 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.251671 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.251570 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2vlg\" (UniqueName: \"kubernetes.io/projected/3e893059-2034-48c1-bb28-88a5dd26e2e2-kube-api-access-z2vlg\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.251889 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.251863 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.252089 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.252055 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.252156 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.252068 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.253656 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.253633 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e893059-2034-48c1-bb28-88a5dd26e2e2-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.254127 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.254103 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e893059-2034-48c1-bb28-88a5dd26e2e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.264772 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.264749 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2vlg\" (UniqueName: \"kubernetes.io/projected/3e893059-2034-48c1-bb28-88a5dd26e2e2-kube-api-access-z2vlg\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p\" (UID: \"3e893059-2034-48c1-bb28-88a5dd26e2e2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.316158 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.316116 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:22.465856 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:22.465826 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p"] May 21 15:48:22.468392 ip-10-0-129-52 kubenswrapper[2556]: W0521 15:48:22.468352 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e893059_2034_48c1_bb28_88a5dd26e2e2.slice/crio-8e58e56745936d1eb9e42f14a12338315e4249bd874860994420402d7fd395f7 WatchSource:0}: Error finding container 8e58e56745936d1eb9e42f14a12338315e4249bd874860994420402d7fd395f7: Status 404 returned error can't find the container with id 8e58e56745936d1eb9e42f14a12338315e4249bd874860994420402d7fd395f7 May 21 15:48:23.002350 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:23.002307 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" event={"ID":"3e893059-2034-48c1-bb28-88a5dd26e2e2","Type":"ContainerStarted","Data":"6afc997ba16fab6a938c3358a5a8db6b5e995f4650d952c8c7dba76293d72d6f"} May 21 15:48:23.002350 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:23.002349 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" event={"ID":"3e893059-2034-48c1-bb28-88a5dd26e2e2","Type":"ContainerStarted","Data":"8e58e56745936d1eb9e42f14a12338315e4249bd874860994420402d7fd395f7"} May 21 15:48:25.012539 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:25.012502 2556 generic.go:358] "Generic (PLEG): container finished" podID="3589a9db-d1cd-4f1d-aa97-6b9a0531ee19" containerID="5ca6a949a43cc2cbd82334eb4bcf808f533c4fa01d7afadd84a3c5b618105142" exitCode=0 May 21 15:48:25.012928 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:25.012566 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" event={"ID":"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19","Type":"ContainerDied","Data":"5ca6a949a43cc2cbd82334eb4bcf808f533c4fa01d7afadd84a3c5b618105142"} May 21 15:48:26.017849 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:26.017814 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" event={"ID":"3589a9db-d1cd-4f1d-aa97-6b9a0531ee19","Type":"ContainerStarted","Data":"d8c8406f45ee2b09693b4a6a101a586f137b06a5d08ca8ce0aef25866383e013"} May 21 15:48:26.018213 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:26.018055 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:26.040116 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:26.040054 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" podStartSLOduration=9.707734591 podStartE2EDuration="10.040034684s" podCreationTimestamp="2026-05-21 15:48:16 +0000 UTC" firstStartedPulling="2026-05-21 15:48:25.013211252 +0000 UTC m=+615.757884422" lastFinishedPulling="2026-05-21 15:48:25.345511349 +0000 UTC m=+616.090184515" observedRunningTime="2026-05-21 15:48:26.038396241 +0000 UTC m=+616.783069442" watchObservedRunningTime="2026-05-21 15:48:26.040034684 +0000 UTC m=+616.784707872" May 21 15:48:26.981962 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:26.981911 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp" May 21 15:48:29.030268 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:29.030231 2556 generic.go:358] "Generic (PLEG): container finished" podID="3e893059-2034-48c1-bb28-88a5dd26e2e2" containerID="6afc997ba16fab6a938c3358a5a8db6b5e995f4650d952c8c7dba76293d72d6f" exitCode=0 May 21 15:48:29.030677 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:29.030277 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" event={"ID":"3e893059-2034-48c1-bb28-88a5dd26e2e2","Type":"ContainerDied","Data":"6afc997ba16fab6a938c3358a5a8db6b5e995f4650d952c8c7dba76293d72d6f"} May 21 15:48:30.035649 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:30.035616 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" event={"ID":"3e893059-2034-48c1-bb28-88a5dd26e2e2","Type":"ContainerStarted","Data":"807bd7fef063022a49cdc30d080110a8ba76b32134e83fb7519371c98fdd753d"} May 21 15:48:30.036060 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:30.035830 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:48:30.061817 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:30.061765 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" podStartSLOduration=8.779014453 podStartE2EDuration="9.061749218s" podCreationTimestamp="2026-05-21 15:48:21 +0000 UTC" firstStartedPulling="2026-05-21 15:48:29.030887663 +0000 UTC m=+619.775560831" lastFinishedPulling="2026-05-21 15:48:29.313622429 +0000 UTC m=+620.058295596" observedRunningTime="2026-05-21 15:48:30.060217533 +0000 UTC m=+620.804890722" watchObservedRunningTime="2026-05-21 15:48:30.061749218 +0000 UTC m=+620.806422455" May 21 15:48:37.034249 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:37.034218 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-wn27d" May 21 15:48:41.053084 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:48:41.053054 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p" May 21 15:53:09.817822 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:53:09.817796 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:53:09.822437 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:53:09.822411 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:53:09.823830 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:53:09.823812 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:53:09.825187 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:53:09.825166 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:58:09.848073 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:58:09.848040 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:58:09.850004 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:58:09.849983 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 15:58:09.851000 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:58:09.850980 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 15:58:09.852692 ip-10-0-129-52 kubenswrapper[2556]: I0521 15:58:09.852671 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 16:01:01.354367 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:01.354330 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4"] May 21 16:01:01.355862 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:01.354647 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" podUID="83122028-ea16-4b22-9af6-bdc83685386e" containerName="manager" containerID="cri-o://079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede" gracePeriod=10 May 21 16:01:01.904999 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:01.904973 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 16:01:01.943776 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:01.943748 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83122028-ea16-4b22-9af6-bdc83685386e-extensions-socket-volume\") pod \"83122028-ea16-4b22-9af6-bdc83685386e\" (UID: \"83122028-ea16-4b22-9af6-bdc83685386e\") " May 21 16:01:01.943776 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:01.943781 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xlxj\" (UniqueName: \"kubernetes.io/projected/83122028-ea16-4b22-9af6-bdc83685386e-kube-api-access-8xlxj\") pod \"83122028-ea16-4b22-9af6-bdc83685386e\" (UID: \"83122028-ea16-4b22-9af6-bdc83685386e\") " May 21 16:01:01.944166 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:01.944134 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83122028-ea16-4b22-9af6-bdc83685386e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "83122028-ea16-4b22-9af6-bdc83685386e" (UID: "83122028-ea16-4b22-9af6-bdc83685386e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:01:01.946119 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:01.946091 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83122028-ea16-4b22-9af6-bdc83685386e-kube-api-access-8xlxj" (OuterVolumeSpecName: "kube-api-access-8xlxj") pod "83122028-ea16-4b22-9af6-bdc83685386e" (UID: "83122028-ea16-4b22-9af6-bdc83685386e"). InnerVolumeSpecName "kube-api-access-8xlxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:01:02.045233 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.045182 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83122028-ea16-4b22-9af6-bdc83685386e-extensions-socket-volume\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 16:01:02.045233 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.045223 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xlxj\" (UniqueName: \"kubernetes.io/projected/83122028-ea16-4b22-9af6-bdc83685386e-kube-api-access-8xlxj\") on node \"ip-10-0-129-52.ec2.internal\" DevicePath \"\"" May 21 16:01:02.761271 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.761236 2556 generic.go:358] "Generic (PLEG): container finished" podID="83122028-ea16-4b22-9af6-bdc83685386e" containerID="079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede" exitCode=0 May 21 16:01:02.761661 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.761293 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" May 21 16:01:02.761661 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.761319 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" event={"ID":"83122028-ea16-4b22-9af6-bdc83685386e","Type":"ContainerDied","Data":"079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede"} May 21 16:01:02.761661 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.761360 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4" event={"ID":"83122028-ea16-4b22-9af6-bdc83685386e","Type":"ContainerDied","Data":"5375668ab83b4deb0aa5ca6253b838259b324ccd437930e5ef34391e67202efe"} May 21 16:01:02.761661 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.761379 2556 scope.go:117] "RemoveContainer" containerID="079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede" May 21 16:01:02.770440 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.770419 2556 scope.go:117] "RemoveContainer" containerID="079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede" May 21 16:01:02.770722 ip-10-0-129-52 kubenswrapper[2556]: E0521 16:01:02.770703 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede\": container with ID starting with 079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede not found: ID does not exist" containerID="079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede" May 21 16:01:02.770763 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.770730 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede"} err="failed to get container status \"079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede\": rpc error: code = NotFound desc = could not find container \"079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede\": container with ID starting with 079cfdbb5eebf8f560b07fa6bb76cf49435e77296ba1d91723890ed151ed2ede not found: ID does not exist" May 21 16:01:02.782711 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.782688 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4"] May 21 16:01:02.786660 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:02.786639 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf4j4"] May 21 16:01:03.872763 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:01:03.872729 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83122028-ea16-4b22-9af6-bdc83685386e" path="/var/lib/kubelet/pods/83122028-ea16-4b22-9af6-bdc83685386e/volumes" May 21 16:02:07.495170 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.495093 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk"] May 21 16:02:07.495652 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.495635 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83122028-ea16-4b22-9af6-bdc83685386e" containerName="manager" May 21 16:02:07.495699 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.495654 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="83122028-ea16-4b22-9af6-bdc83685386e" containerName="manager" May 21 16:02:07.495737 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.495716 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="83122028-ea16-4b22-9af6-bdc83685386e" containerName="manager" May 21 16:02:07.497823 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.497806 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:07.500846 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.500823 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rf582\"" May 21 16:02:07.510472 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.510452 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk"] May 21 16:02:07.588779 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.588748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/252a1652-7ca6-4e1d-be78-76254e1a2199-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zkqgk\" (UID: \"252a1652-7ca6-4e1d-be78-76254e1a2199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:07.588897 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.588793 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg2vc\" (UniqueName: \"kubernetes.io/projected/252a1652-7ca6-4e1d-be78-76254e1a2199-kube-api-access-mg2vc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zkqgk\" (UID: \"252a1652-7ca6-4e1d-be78-76254e1a2199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:07.689955 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.689900 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/252a1652-7ca6-4e1d-be78-76254e1a2199-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zkqgk\" (UID: \"252a1652-7ca6-4e1d-be78-76254e1a2199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:07.690092 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.689989 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg2vc\" (UniqueName: \"kubernetes.io/projected/252a1652-7ca6-4e1d-be78-76254e1a2199-kube-api-access-mg2vc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zkqgk\" (UID: \"252a1652-7ca6-4e1d-be78-76254e1a2199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:07.690251 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.690235 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/252a1652-7ca6-4e1d-be78-76254e1a2199-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zkqgk\" (UID: \"252a1652-7ca6-4e1d-be78-76254e1a2199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:07.698568 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.698548 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg2vc\" (UniqueName: \"kubernetes.io/projected/252a1652-7ca6-4e1d-be78-76254e1a2199-kube-api-access-mg2vc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zkqgk\" (UID: \"252a1652-7ca6-4e1d-be78-76254e1a2199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:07.807738 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.807719 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:07.943623 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.943594 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk"] May 21 16:02:07.944413 ip-10-0-129-52 kubenswrapper[2556]: W0521 16:02:07.944383 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252a1652_7ca6_4e1d_be78_76254e1a2199.slice/crio-26ddd37793c3fb067194c1d1ea02ab114f4dba695c3426577492f0f2a766b36d WatchSource:0}: Error finding container 26ddd37793c3fb067194c1d1ea02ab114f4dba695c3426577492f0f2a766b36d: Status 404 returned error can't find the container with id 26ddd37793c3fb067194c1d1ea02ab114f4dba695c3426577492f0f2a766b36d May 21 16:02:07.946805 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.946788 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:02:07.986661 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:07.986632 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" event={"ID":"252a1652-7ca6-4e1d-be78-76254e1a2199","Type":"ContainerStarted","Data":"26ddd37793c3fb067194c1d1ea02ab114f4dba695c3426577492f0f2a766b36d"} May 21 16:02:08.991670 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:08.991635 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" event={"ID":"252a1652-7ca6-4e1d-be78-76254e1a2199","Type":"ContainerStarted","Data":"35e942f6c232be5833ab89239e0663e53912998d310b573254ac5da111e11437"} May 21 16:02:08.992162 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:08.991727 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:02:09.011904 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:09.011851 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" podStartSLOduration=2.011835773 podStartE2EDuration="2.011835773s" podCreationTimestamp="2026-05-21 16:02:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:02:09.008806492 +0000 UTC m=+1439.753479680" watchObservedRunningTime="2026-05-21 16:02:09.011835773 +0000 UTC m=+1439.756508964" May 21 16:02:19.996928 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:02:19.996895 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zkqgk" May 21 16:03:09.876060 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:03:09.876034 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 16:03:09.878032 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:03:09.878007 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 16:03:09.878603 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:03:09.878583 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 16:03:09.887341 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:03:09.887318 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 16:08:09.911407 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:08:09.911376 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 16:08:09.914045 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:08:09.914024 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 16:08:09.914295 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:08:09.914277 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 16:08:09.920074 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:08:09.920053 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 16:11:59.434719 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:11:59.434685 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fcb49cc88-cw7l8_b421aa16-8001-4bef-bdc0-b0faf33e16d6/manager/0.log" May 21 16:12:01.318910 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:01.318874 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-jmv4g_942a9f6d-b84f-4980-81ff-cbb6669cc961/manager/0.log" May 21 16:12:01.435933 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:01.435886 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-fm59c_00f06d34-7481-4f8c-acf1-63092e7b1310/kuadrant-console-plugin/0.log" May 21 16:12:01.684963 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:01.684866 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-zkqgk_252a1652-7ca6-4e1d-be78-76254e1a2199/manager/0.log" May 21 16:12:02.630690 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:02.630658 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89947cdcb-x2jl2_c54ada04-080f-48b6-914e-babe3139928c/kube-auth-proxy/0.log" May 21 16:12:02.870339 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:02.870308 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-5bctx_75f426d4-7f51-4254-9ae1-c4562265735c/payload-processing/0.log" May 21 16:12:03.319861 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:03.319832 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp_efe64955-738c-4ba0-aaa5-ebdf613ab378/storage-initializer/0.log" May 21 16:12:03.326640 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:03.326621 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-b2ptp_efe64955-738c-4ba0-aaa5-ebdf613ab378/main/0.log" May 21 16:12:03.451500 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:03.451469 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p_3e893059-2034-48c1-bb28-88a5dd26e2e2/main/0.log" May 21 16:12:03.459626 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:03.459597 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-h2d6p_3e893059-2034-48c1-bb28-88a5dd26e2e2/storage-initializer/0.log" May 21 16:12:03.923534 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:03.923500 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-wn27d_3589a9db-d1cd-4f1d-aa97-6b9a0531ee19/storage-initializer/0.log" May 21 16:12:03.930637 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:03.930614 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-wn27d_3589a9db-d1cd-4f1d-aa97-6b9a0531ee19/main/0.log" May 21 16:12:10.886161 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:10.886134 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k7vk7_f63688fe-2c9d-48f3-9924-e5057f368c4f/global-pull-secret-syncer/0.log" May 21 16:12:10.971097 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:10.971066 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-45jk6_1d20b143-e9dd-4091-b94c-eab9f4b3795e/konnectivity-agent/0.log" May 21 16:12:11.064371 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:11.064341 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-52.ec2.internal_6570d05f87a90cb80699b013db438d94/haproxy/0.log" May 21 16:12:15.248503 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:15.248472 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-jmv4g_942a9f6d-b84f-4980-81ff-cbb6669cc961/manager/0.log" May 21 16:12:15.273465 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:15.273443 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-fm59c_00f06d34-7481-4f8c-acf1-63092e7b1310/kuadrant-console-plugin/0.log" May 21 16:12:15.377093 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:15.377067 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-zkqgk_252a1652-7ca6-4e1d-be78-76254e1a2199/manager/0.log" May 21 16:12:16.655088 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:16.655058 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b44e2a82-043e-45c6-92ed-f70a9bf7aef9/alertmanager/0.log" May 21 16:12:16.679135 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:16.679108 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b44e2a82-043e-45c6-92ed-f70a9bf7aef9/config-reloader/0.log" May 21 16:12:16.706554 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:16.706486 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b44e2a82-043e-45c6-92ed-f70a9bf7aef9/kube-rbac-proxy-web/0.log" May 21 16:12:16.730671 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:16.730642 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b44e2a82-043e-45c6-92ed-f70a9bf7aef9/kube-rbac-proxy/0.log" May 21 16:12:16.753637 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:16.753615 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b44e2a82-043e-45c6-92ed-f70a9bf7aef9/kube-rbac-proxy-metric/0.log" May 21 16:12:16.778664 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:16.778649 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b44e2a82-043e-45c6-92ed-f70a9bf7aef9/prom-label-proxy/0.log" May 21 16:12:16.803437 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:16.803420 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b44e2a82-043e-45c6-92ed-f70a9bf7aef9/init-config-reloader/0.log" May 21 16:12:16.844776 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:16.844751 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-s7n8l_ff6526b7-8014-45ef-9b1c-c1a1d801fd95/cluster-monitoring-operator/0.log" May 21 16:12:17.173509 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.173480 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdj52_8be2cec8-a370-43a5-a866-e7245435cbfe/node-exporter/0.log" May 21 16:12:17.194825 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.194804 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdj52_8be2cec8-a370-43a5-a866-e7245435cbfe/kube-rbac-proxy/0.log" May 21 16:12:17.216490 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.216465 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdj52_8be2cec8-a370-43a5-a866-e7245435cbfe/init-textfile/0.log" May 21 16:12:17.347053 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.347026 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acb2293a-0936-4176-94f0-391b575bdf60/prometheus/0.log" May 21 16:12:17.365559 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.365536 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acb2293a-0936-4176-94f0-391b575bdf60/config-reloader/0.log" May 21 16:12:17.384346 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.384326 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acb2293a-0936-4176-94f0-391b575bdf60/thanos-sidecar/0.log" May 21 16:12:17.406017 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.405998 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acb2293a-0936-4176-94f0-391b575bdf60/kube-rbac-proxy-web/0.log" May 21 16:12:17.424086 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.424035 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acb2293a-0936-4176-94f0-391b575bdf60/kube-rbac-proxy/0.log" May 21 16:12:17.442821 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.442804 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acb2293a-0936-4176-94f0-391b575bdf60/kube-rbac-proxy-thanos/0.log" May 21 16:12:17.464016 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.463992 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acb2293a-0936-4176-94f0-391b575bdf60/init-config-reloader/0.log" May 21 16:12:17.492976 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.492956 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-jd656_aee97082-6cd2-4be6-9433-e07ab4c39243/prometheus-operator/0.log" May 21 16:12:17.517979 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.517961 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-jd656_aee97082-6cd2-4be6-9433-e07ab4c39243/kube-rbac-proxy/0.log" May 21 16:12:17.540319 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.540299 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-lrwq7_1eb4cbaa-7a69-44c3-b3c2-58c49ca4c11d/prometheus-operator-admission-webhook/0.log" May 21 16:12:17.574209 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.574185 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d97cb4675-95dzf_c8eadd44-da30-4e31-98e1-2ea66334d2cd/telemeter-client/0.log" May 21 16:12:17.593315 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.593295 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d97cb4675-95dzf_c8eadd44-da30-4e31-98e1-2ea66334d2cd/reload/0.log" May 21 16:12:17.614733 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.614707 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d97cb4675-95dzf_c8eadd44-da30-4e31-98e1-2ea66334d2cd/kube-rbac-proxy/0.log" May 21 16:12:17.652854 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.652836 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b69644bf8-z99wc_7af67dba-6a80-40c7-89f2-64270442b92b/thanos-query/0.log" May 21 16:12:17.676999 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.676950 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b69644bf8-z99wc_7af67dba-6a80-40c7-89f2-64270442b92b/kube-rbac-proxy-web/0.log" May 21 16:12:17.695768 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.695747 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b69644bf8-z99wc_7af67dba-6a80-40c7-89f2-64270442b92b/kube-rbac-proxy/0.log" May 21 16:12:17.722592 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.722570 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b69644bf8-z99wc_7af67dba-6a80-40c7-89f2-64270442b92b/prom-label-proxy/0.log" May 21 16:12:17.741349 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.741333 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b69644bf8-z99wc_7af67dba-6a80-40c7-89f2-64270442b92b/kube-rbac-proxy-rules/0.log" May 21 16:12:17.760836 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:17.760818 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b69644bf8-z99wc_7af67dba-6a80-40c7-89f2-64270442b92b/kube-rbac-proxy-metrics/0.log" May 21 16:12:19.426129 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.426052 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/2.log" May 21 16:12:19.430352 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.430329 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hb7mh_9e588f33-6073-438c-9a8b-cb75bdf7a38f/console-operator/3.log" May 21 16:12:19.603857 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.603817 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8"] May 21 16:12:19.607724 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.607699 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.610177 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.610156 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-77nn9\"/\"kube-root-ca.crt\"" May 21 16:12:19.610307 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.610161 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-77nn9\"/\"openshift-service-ca.crt\"" May 21 16:12:19.611043 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.611025 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-77nn9\"/\"default-dockercfg-svt54\"" May 21 16:12:19.616767 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.616748 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8"] May 21 16:12:19.723309 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.723243 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq77n\" (UniqueName: \"kubernetes.io/projected/08b247e2-a0b2-43f2-a681-28fcc587210a-kube-api-access-gq77n\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.723309 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.723276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-lib-modules\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.723309 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.723297 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-podres\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.723487 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.723313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-proc\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.723487 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.723390 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-sys\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824161 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824137 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-sys\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824272 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824226 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gq77n\" (UniqueName: \"kubernetes.io/projected/08b247e2-a0b2-43f2-a681-28fcc587210a-kube-api-access-gq77n\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824272 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824246 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-lib-modules\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824272 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824257 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-sys\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824370 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824264 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-podres\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824370 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824337 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-proc\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824435 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824385 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-podres\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824435 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824385 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-lib-modules\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.824435 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.824421 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08b247e2-a0b2-43f2-a681-28fcc587210a-proc\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.832344 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.832321 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq77n\" (UniqueName: \"kubernetes.io/projected/08b247e2-a0b2-43f2-a681-28fcc587210a-kube-api-access-gq77n\") pod \"perf-node-gather-daemonset-89jv8\" (UID: \"08b247e2-a0b2-43f2-a681-28fcc587210a\") " pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:19.918838 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:19.918811 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:20.048461 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:20.048439 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8"] May 21 16:12:20.050378 ip-10-0-129-52 kubenswrapper[2556]: W0521 16:12:20.050351 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod08b247e2_a0b2_43f2_a681_28fcc587210a.slice/crio-682b4023b3dc8819445c146f7e31e1ce52dc024e85281c7a5c9be1807004720c WatchSource:0}: Error finding container 682b4023b3dc8819445c146f7e31e1ce52dc024e85281c7a5c9be1807004720c: Status 404 returned error can't find the container with id 682b4023b3dc8819445c146f7e31e1ce52dc024e85281c7a5c9be1807004720c May 21 16:12:20.051896 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:20.051879 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:12:20.138467 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:20.138437 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" event={"ID":"08b247e2-a0b2-43f2-a681-28fcc587210a","Type":"ContainerStarted","Data":"e79e59ebacf45089a0002fb8dcadfba5b436e7bd5f0895d37b5a4ac8a7d3ec77"} May 21 16:12:20.138571 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:20.138472 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" event={"ID":"08b247e2-a0b2-43f2-a681-28fcc587210a","Type":"ContainerStarted","Data":"682b4023b3dc8819445c146f7e31e1ce52dc024e85281c7a5c9be1807004720c"} May 21 16:12:20.138571 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:20.138521 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:20.154935 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:20.154866 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" podStartSLOduration=1.154855459 podStartE2EDuration="1.154855459s" podCreationTimestamp="2026-05-21 16:12:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:12:20.153536671 +0000 UTC m=+2050.898209859" watchObservedRunningTime="2026-05-21 16:12:20.154855459 +0000 UTC m=+2050.899528646" May 21 16:12:21.346888 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:21.346850 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j6cnb_a40b4ecc-e278-48c4-bbb4-69346bfde543/dns/0.log" May 21 16:12:21.366727 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:21.366695 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j6cnb_a40b4ecc-e278-48c4-bbb4-69346bfde543/kube-rbac-proxy/0.log" May 21 16:12:21.518425 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:21.518400 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x976d_a925a804-0977-4537-af01-3193b0e87ac8/dns-node-resolver/0.log" May 21 16:12:21.994697 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:21.994670 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dj9r4_cc3131c6-aa28-4f44-89eb-6f1c6bf0918c/node-ca/0.log" May 21 16:12:22.996769 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:22.996741 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89947cdcb-x2jl2_c54ada04-080f-48b6-914e-babe3139928c/kube-auth-proxy/0.log" May 21 16:12:23.115602 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:23.115564 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-5bctx_75f426d4-7f51-4254-9ae1-c4562265735c/payload-processing/0.log" May 21 16:12:23.682598 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:23.682572 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2xdp_8889c4ae-38a1-493a-9edb-afe43dce4b4c/serve-healthcheck-canary/0.log" May 21 16:12:24.106195 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:24.106169 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-pwpzw_a6e980e0-35d2-48ec-a1a1-c385cf825793/insights-operator/0.log" May 21 16:12:24.106692 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:24.106472 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-pwpzw_a6e980e0-35d2-48ec-a1a1-c385cf825793/insights-operator/1.log" May 21 16:12:24.187588 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:24.187567 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n62hc_df43819b-2cc5-4790-b411-173db7cb6c16/kube-rbac-proxy/0.log" May 21 16:12:24.206756 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:24.206738 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n62hc_df43819b-2cc5-4790-b411-173db7cb6c16/exporter/0.log" May 21 16:12:24.228120 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:24.228100 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n62hc_df43819b-2cc5-4790-b411-173db7cb6c16/extractor/0.log" May 21 16:12:26.153756 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:26.153722 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-77nn9/perf-node-gather-daemonset-89jv8" May 21 16:12:26.410568 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:26.410488 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fcb49cc88-cw7l8_b421aa16-8001-4bef-bdc0-b0faf33e16d6/manager/0.log" May 21 16:12:27.581562 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:27.581534 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76499b6586-k582z_a2162b28-adaf-4c4d-ae33-d1abe08be83d/manager/0.log" May 21 16:12:27.603491 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:27.603467 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-sbxww_cb5b6b62-6664-4de1-86bd-9922bdd0ed9f/openshift-lws-operator/0.log" May 21 16:12:33.528090 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:33.528059 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9gn9g_7257125a-9c7c-4337-a076-edad273a3907/kube-multus/0.log" May 21 16:12:34.009509 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.009439 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmlvx_f990b6d8-ab00-4194-93eb-1902e6f87a24/kube-multus-additional-cni-plugins/0.log" May 21 16:12:34.050082 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.050056 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmlvx_f990b6d8-ab00-4194-93eb-1902e6f87a24/egress-router-binary-copy/0.log" May 21 16:12:34.080479 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.080457 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmlvx_f990b6d8-ab00-4194-93eb-1902e6f87a24/cni-plugins/0.log" May 21 16:12:34.115159 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.115138 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmlvx_f990b6d8-ab00-4194-93eb-1902e6f87a24/bond-cni-plugin/0.log" May 21 16:12:34.146057 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.146036 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmlvx_f990b6d8-ab00-4194-93eb-1902e6f87a24/routeoverride-cni/0.log" May 21 16:12:34.178151 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.178136 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmlvx_f990b6d8-ab00-4194-93eb-1902e6f87a24/whereabouts-cni-bincopy/0.log" May 21 16:12:34.213904 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.213887 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xmlvx_f990b6d8-ab00-4194-93eb-1902e6f87a24/whereabouts-cni/0.log" May 21 16:12:34.321968 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.321952 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k8ngt_3762df41-6506-4248-a95a-369c904c6404/network-metrics-daemon/0.log" May 21 16:12:34.352219 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:34.352198 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k8ngt_3762df41-6506-4248-a95a-369c904c6404/kube-rbac-proxy/0.log" May 21 16:12:35.986109 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:35.986078 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-controller/0.log" May 21 16:12:36.006246 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:36.006223 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/0.log" May 21 16:12:36.016123 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:36.016103 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovn-acl-logging/1.log" May 21 16:12:36.035986 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:36.035970 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/kube-rbac-proxy-node/0.log" May 21 16:12:36.055457 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:36.055433 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/kube-rbac-proxy-ovn-metrics/0.log" May 21 16:12:36.074684 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:36.074662 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/northd/0.log" May 21 16:12:36.094388 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:36.094365 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/nbdb/0.log" May 21 16:12:36.113869 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:36.113852 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/sbdb/0.log" May 21 16:12:36.208842 ip-10-0-129-52 kubenswrapper[2556]: I0521 16:12:36.208818 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9w2m_4315fe49-5816-45ab-b892-55c089d2f273/ovnkube-controller/0.log"