May 25 01:00:17.412759 ip-10-0-128-11 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 25 01:00:17.412771 ip-10-0-128-11 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 25 01:00:17.412780 ip-10-0-128-11 systemd[1]: kubelet.service: Failed with result 'resources'. May 25 01:00:17.413190 ip-10-0-128-11 systemd[1]: Failed to start Kubernetes Kubelet. May 25 01:00:27.480076 ip-10-0-128-11 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 25 01:00:27.480099 ip-10-0-128-11 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot baa7ffa181eb47a6aeac0d04c479ca1c -- May 25 01:02:36.796576 ip-10-0-128-11 systemd[1]: Starting Kubernetes Kubelet... May 25 01:02:37.270743 ip-10-0-128-11 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 01:02:37.270743 ip-10-0-128-11 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 25 01:02:37.270743 ip-10-0-128-11 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 01:02:37.270743 ip-10-0-128-11 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 25 01:02:37.270743 ip-10-0-128-11 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 01:02:37.274516 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.274420 2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 25 01:02:37.277233 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277205 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:37.277233 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277233 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277236 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277239 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277242 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277245 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277248 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277251 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277254 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277256 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277262 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277266 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277269 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277272 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277280 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277283 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277286 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277288 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277291 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277293 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:37.277298 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277296 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277299 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277302 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277305 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277308 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277310 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277313 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277316 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277320 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277323 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277325 2576 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277328 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277330 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277333 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277336 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277339 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277347 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277350 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277352 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:37.277743 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277355 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277357 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277359 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277362 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277365 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277367 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277369 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277372 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277374 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277377 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277379 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277381 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277384 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277386 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277389 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277392 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277395 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277397 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277400 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277403 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:37.278205 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277405 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277408 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277410 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277413 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277415 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277417 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277420 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277423 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277425 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277428 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277431 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277434 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277437 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277440 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277442 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277445 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277447 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277449 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277452 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277454 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:37.278718 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277457 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277459 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277461 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277464 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277466 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277468 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277471 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277870 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277876 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277878 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277881 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277884 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277887 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277889 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277892 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277895 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277897 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277900 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277902 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277905 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:37.279248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277907 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277910 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277912 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277915 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277917 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277920 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277922 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277925 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277927 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277930 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277932 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277934 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277937 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277939 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277942 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277944 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277946 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277949 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277951 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:37.279721 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277955 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277957 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277960 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277962 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277965 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277967 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277970 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277972 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277975 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277977 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277979 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277981 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277984 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277987 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277990 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277993 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277995 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.277998 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278001 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278004 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:37.280191 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278006 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278009 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278011 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278013 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278016 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278018 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278021 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278023 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278025 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278028 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278032 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278036 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278040 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278043 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278046 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278048 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278051 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278053 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278056 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:37.280694 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278058 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278061 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278063 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278065 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278068 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278070 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278072 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278076 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278079 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278082 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278085 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278088 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278091 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278093 2576 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.278096 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279185 2576 flags.go:64] FLAG: --address="0.0.0.0" May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279198 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279204 2576 flags.go:64] FLAG: --anonymous-auth="true" May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279223 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279227 2576 flags.go:64] FLAG: --authentication-token-webhook="false" May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279231 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 25 01:02:37.281161 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279235 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279240 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279243 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279246 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279250 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279253 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279256 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279260 2576 flags.go:64] FLAG: --cgroup-root="" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279263 2576 flags.go:64] FLAG: --cgroups-per-qos="true" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279265 2576 flags.go:64] FLAG: --client-ca-file="" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279268 2576 flags.go:64] FLAG: --cloud-config="" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279271 2576 flags.go:64] FLAG: --cloud-provider="external" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279274 2576 flags.go:64] FLAG: --cluster-dns="[]" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279279 2576 flags.go:64] FLAG: --cluster-domain="" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279282 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279285 2576 flags.go:64] FLAG: --config-dir="" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279288 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279292 2576 flags.go:64] FLAG: --container-log-max-files="5" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279295 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279299 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279302 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279306 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279309 2576 flags.go:64] FLAG: --contention-profiling="false" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279312 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" May 25 01:02:37.281682 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279315 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279318 2576 flags.go:64] FLAG: --cpu-manager-policy="none" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279321 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279325 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279328 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279331 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279333 2576 flags.go:64] FLAG: --enable-load-reader="false" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279336 2576 flags.go:64] FLAG: --enable-server="true" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279339 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279343 2576 flags.go:64] FLAG: --event-burst="100" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279347 2576 flags.go:64] FLAG: --event-qps="50" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279350 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279353 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279357 2576 flags.go:64] FLAG: --eviction-hard="" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279360 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279363 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279366 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279369 2576 flags.go:64] FLAG: --eviction-soft="" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279372 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279375 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279378 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279381 2576 flags.go:64] FLAG: --experimental-mounter-path="" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279384 2576 flags.go:64] FLAG: --fail-cgroupv1="false" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279387 2576 flags.go:64] FLAG: --fail-swap-on="true" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279389 2576 flags.go:64] FLAG: --feature-gates="" May 25 01:02:37.282286 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279393 2576 flags.go:64] FLAG: --file-check-frequency="20s" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279396 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279399 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279403 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279406 2576 flags.go:64] FLAG: --healthz-port="10248" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279409 2576 flags.go:64] FLAG: --help="false" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279411 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-11.ec2.internal" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279414 2576 flags.go:64] FLAG: --housekeeping-interval="10s" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279417 2576 flags.go:64] FLAG: --http-check-frequency="20s" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279420 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279424 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279427 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279430 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279433 2576 flags.go:64] FLAG: --image-service-endpoint="" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279436 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279438 2576 flags.go:64] FLAG: --kube-api-burst="100" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279441 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279444 2576 flags.go:64] FLAG: --kube-api-qps="50" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279447 2576 flags.go:64] FLAG: --kube-reserved="" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279450 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279453 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279457 2576 flags.go:64] FLAG: --kubelet-cgroups="" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279459 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279462 2576 flags.go:64] FLAG: --lock-file="" May 25 01:02:37.282894 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279465 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279468 2576 flags.go:64] FLAG: --log-flush-frequency="5s" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279471 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279476 2576 flags.go:64] FLAG: --log-json-split-stream="false" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279479 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279482 2576 flags.go:64] FLAG: --log-text-split-stream="false" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279485 2576 flags.go:64] FLAG: --logging-format="text" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279487 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279491 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279493 2576 flags.go:64] FLAG: --manifest-url="" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279496 2576 flags.go:64] FLAG: --manifest-url-header="" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279500 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279504 2576 flags.go:64] FLAG: --max-open-files="1000000" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279508 2576 flags.go:64] FLAG: --max-pods="110" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279511 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279514 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279517 2576 flags.go:64] FLAG: --memory-manager-policy="None" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279520 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279523 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279526 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279529 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279535 2576 flags.go:64] FLAG: --node-status-max-images="50" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279538 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279541 2576 flags.go:64] FLAG: --oom-score-adj="-999" May 25 01:02:37.283498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279544 2576 flags.go:64] FLAG: --pod-cidr="" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279546 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279552 2576 flags.go:64] FLAG: --pod-manifest-path="" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279555 2576 flags.go:64] FLAG: --pod-max-pids="-1" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279558 2576 flags.go:64] FLAG: --pods-per-core="0" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279561 2576 flags.go:64] FLAG: --port="10250" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279564 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279566 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f99bb192284466e" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279570 2576 flags.go:64] FLAG: --qos-reserved="" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279572 2576 flags.go:64] FLAG: --read-only-port="10255" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279575 2576 flags.go:64] FLAG: --register-node="true" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279578 2576 flags.go:64] FLAG: --register-schedulable="true" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279580 2576 flags.go:64] FLAG: --register-with-taints="" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279584 2576 flags.go:64] FLAG: --registry-burst="10" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279586 2576 flags.go:64] FLAG: --registry-qps="5" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279589 2576 flags.go:64] FLAG: --reserved-cpus="" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279592 2576 flags.go:64] FLAG: --reserved-memory="" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279596 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279599 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279602 2576 flags.go:64] FLAG: --rotate-certificates="false" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279604 2576 flags.go:64] FLAG: --rotate-server-certificates="false" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279610 2576 flags.go:64] FLAG: --runonce="false" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279614 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279617 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279619 2576 flags.go:64] FLAG: --seccomp-default="false" May 25 01:02:37.284098 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279622 2576 flags.go:64] FLAG: --serialize-image-pulls="true" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279625 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279628 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279631 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279634 2576 flags.go:64] FLAG: --storage-driver-password="root" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279636 2576 flags.go:64] FLAG: --storage-driver-secure="false" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279639 2576 flags.go:64] FLAG: --storage-driver-table="stats" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279642 2576 flags.go:64] FLAG: --storage-driver-user="root" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279645 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279648 2576 flags.go:64] FLAG: --sync-frequency="1m0s" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279650 2576 flags.go:64] FLAG: --system-cgroups="" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279653 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279658 2576 flags.go:64] FLAG: --system-reserved-cgroup="" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279661 2576 flags.go:64] FLAG: --tls-cert-file="" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279664 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279669 2576 flags.go:64] FLAG: --tls-min-version="" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279672 2576 flags.go:64] FLAG: --tls-private-key-file="" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279675 2576 flags.go:64] FLAG: --topology-manager-policy="none" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279677 2576 flags.go:64] FLAG: --topology-manager-policy-options="" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279680 2576 flags.go:64] FLAG: --topology-manager-scope="container" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279683 2576 flags.go:64] FLAG: --v="2" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279687 2576 flags.go:64] FLAG: --version="false" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279692 2576 flags.go:64] FLAG: --vmodule="" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279696 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.279699 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 25 01:02:37.284707 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279818 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279822 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279825 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279828 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279832 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279834 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279837 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279839 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279842 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279845 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279848 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279850 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279853 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279855 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279858 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279861 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279870 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279872 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279875 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279877 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:37.285351 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279880 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279883 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279885 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279888 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279890 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279893 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279895 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279898 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279900 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279903 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279905 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279908 2576 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279910 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279913 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279915 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279918 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279920 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279923 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279926 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279928 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:37.285848 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279931 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279933 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279936 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279938 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279941 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279943 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279946 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279948 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279952 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279955 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279957 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279960 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279962 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279965 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279967 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279969 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279972 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279974 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279976 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279979 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:37.286355 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279981 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279984 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279987 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279989 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279991 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279995 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.279998 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280002 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280005 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280009 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280012 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280015 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280020 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280022 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280025 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280027 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280030 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280032 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280034 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:37.286844 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280037 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280042 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280044 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280047 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280049 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280051 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.280054 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.280062 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.286495 2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.286605 2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286653 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286658 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286663 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286667 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286670 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:37.287382 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286674 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286677 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286680 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286683 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286685 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286688 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286691 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286694 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286698 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286700 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286703 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286707 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286710 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286713 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286715 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286718 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286721 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286723 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286726 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:37.287761 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286728 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286731 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286733 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286736 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286738 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286740 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286743 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286747 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286750 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286752 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286755 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286757 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286759 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286762 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286764 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286766 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286769 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286771 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286773 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286776 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:37.288330 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286778 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286780 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286783 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286785 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286787 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286790 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286793 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286795 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286797 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286800 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286802 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286804 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286807 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286809 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286812 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286815 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286817 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286820 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286823 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:37.288820 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286826 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286830 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286833 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286835 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286838 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286841 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286843 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286846 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286848 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286851 2576 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286854 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286856 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286859 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286862 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286864 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286866 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286869 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286871 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286874 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286876 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:37.289297 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286879 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286881 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286883 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.286888 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286987 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286992 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286995 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.286997 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287000 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287003 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287006 2576 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287008 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287011 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287014 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287017 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:37.289779 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287019 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287022 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287024 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287027 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287029 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287032 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287034 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287037 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287039 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287042 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287044 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287047 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287049 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287051 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287054 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287056 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287058 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287061 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287063 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287065 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:37.290146 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287068 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287070 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287073 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287075 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287078 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287080 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287083 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287086 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287088 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287091 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287094 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287097 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287107 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287109 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287112 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287115 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287117 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287120 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287122 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287124 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:37.290653 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287127 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287129 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287132 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287135 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287137 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287139 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287142 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287144 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287147 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287149 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287152 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287154 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287157 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287159 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287162 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287165 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287167 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287169 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287172 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287175 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:37.291150 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287177 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287180 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287183 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287185 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287188 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287192 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287195 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287198 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287201 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287203 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287206 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287225 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287227 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287230 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:37.287232 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:37.291667 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.287237 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 01:02:37.292032 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.287928 2576 server.go:962] "Client rotation is on, will bootstrap in background" May 25 01:02:37.292032 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.290005 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 25 01:02:37.292032 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.291114 2576 server.go:1019] "Starting client certificate rotation" May 25 01:02:37.292032 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.291231 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 01:02:37.292135 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.292050 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 01:02:37.320477 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.320455 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 01:02:37.322159 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.322134 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 01:02:37.338346 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.338316 2576 log.go:25] "Validated CRI v1 runtime API" May 25 01:02:37.343962 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.343938 2576 log.go:25] "Validated CRI v1 image API" May 25 01:02:37.345321 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.345307 2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 25 01:02:37.351359 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.351338 2576 fs.go:135] Filesystem UUIDs: map[20cd549d-29dc-4e67-b3dc-dadb08e5dfeb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b90b2fdc-4083-4757-af44-01285c3faed5:/dev/nvme0n1p4] May 25 01:02:37.351419 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.351359 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 25 01:02:37.354928 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.354909 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 01:02:37.356049 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.355946 2576 manager.go:217] Machine: {Timestamp:2026-05-25 01:02:37.355464194 +0000 UTC m=+0.430524029 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099689 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de1f76881775c3e375c910c664fad SystemUUID:ec2de1f7-6881-775c-3e37-5c910c664fad BootID:baa7ffa1-81eb-47a6-aeac-0d04c479ca1c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6a:ac:1f:c5:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6a:ac:1f:c5:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:70:f9:a2:1d:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 25 01:02:37.357429 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.357417 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 25 01:02:37.357558 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.357545 2576 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 25 01:02:37.359357 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.359331 2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 25 01:02:37.359498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.359360 2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-11.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 25 01:02:37.359540 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.359508 2576 topology_manager.go:138] "Creating topology manager with none policy" May 25 01:02:37.359540 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.359516 2576 container_manager_linux.go:306] "Creating device plugin manager" May 25 01:02:37.359540 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.359523 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 01:02:37.359540 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.359536 2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 01:02:37.360703 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.360692 2576 state_mem.go:36] "Initialized new in-memory state store" May 25 01:02:37.360811 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.360802 2576 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 25 01:02:37.363276 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.363267 2576 kubelet.go:491] "Attempting to sync node with API server" May 25 01:02:37.363317 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.363281 2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 25 01:02:37.363317 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.363294 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 25 01:02:37.363317 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.363303 2576 kubelet.go:397] "Adding apiserver pod source" May 25 01:02:37.363317 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.363311 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 25 01:02:37.364438 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.364425 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 01:02:37.364487 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.364445 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 01:02:37.367908 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.367878 2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 25 01:02:37.370689 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.370662 2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 25 01:02:37.371611 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371598 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 25 01:02:37.371663 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371616 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 25 01:02:37.371663 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371623 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 25 01:02:37.371663 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371628 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 25 01:02:37.371663 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371637 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 25 01:02:37.371663 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371643 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 25 01:02:37.371663 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371649 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 25 01:02:37.371663 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371659 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 25 01:02:37.371856 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371667 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 25 01:02:37.371856 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371673 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 25 01:02:37.371856 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.371682 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 25 01:02:37.372943 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.372933 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 25 01:02:37.373997 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.373972 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 25 01:02:37.374054 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.374003 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 25 01:02:37.377102 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.377078 2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-11.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 25 01:02:37.377226 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.377124 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 25 01:02:37.377226 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.377172 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 25 01:02:37.378124 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.378108 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9mm5" May 25 01:02:37.378370 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.378356 2576 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 25 01:02:37.378410 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.378394 2576 server.go:1295] "Started kubelet" May 25 01:02:37.378528 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.378455 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 25 01:02:37.378528 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.378469 2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 25 01:02:37.378647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.378548 2576 server_v1.go:47] "podresources" method="list" useActivePods=true May 25 01:02:37.379223 ip-10-0-128-11 systemd[1]: Started Kubernetes Kubelet. May 25 01:02:37.380041 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.380026 2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 25 01:02:37.380542 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.380530 2576 server.go:317] "Adding debug handlers to kubelet server" May 25 01:02:37.387545 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.387524 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 25 01:02:37.387679 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.386691 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-11.ec2.internal.18b2a94e7f9dfca6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-11.ec2.internal,UID:ip-10-0-128-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-11.ec2.internal,},FirstTimestamp:2026-05-25 01:02:37.378370726 +0000 UTC m=+0.453430562,LastTimestamp:2026-05-25 01:02:37.378370726 +0000 UTC m=+0.453430562,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-11.ec2.internal,}" May 25 01:02:37.388063 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.388046 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 25 01:02:37.388138 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.388130 2576 volume_manager.go:295] "The desired_state_of_world populator starts" May 25 01:02:37.388190 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.388140 2576 volume_manager.go:297] "Starting Kubelet Volume Manager" May 25 01:02:37.388292 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.388276 2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 25 01:02:37.388357 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.388343 2576 reconstruct.go:97] "Volume reconstruction finished" May 25 01:02:37.388357 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.388357 2576 reconciler.go:26] "Reconciler: start to sync state" May 25 01:02:37.389097 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.389078 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9mm5" May 25 01:02:37.389311 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.389293 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:37.389497 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.389471 2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 25 01:02:37.389972 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.389948 2576 factory.go:55] Registering systemd factory May 25 01:02:37.389972 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.389965 2576 factory.go:223] Registration of the systemd container factory successfully May 25 01:02:37.390401 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.390383 2576 factory.go:153] Registering CRI-O factory May 25 01:02:37.390401 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.390402 2576 factory.go:223] Registration of the crio container factory successfully May 25 01:02:37.390527 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.390454 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 25 01:02:37.390527 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.390478 2576 factory.go:103] Registering Raw factory May 25 01:02:37.390527 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.390493 2576 manager.go:1196] Started watching for new ooms in manager May 25 01:02:37.390856 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.390831 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 25 01:02:37.390930 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.390917 2576 manager.go:319] Starting recovery of all containers May 25 01:02:37.390985 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.390929 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 25 01:02:37.401843 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.401823 2576 manager.go:324] Recovery completed May 25 01:02:37.406688 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.406674 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:37.408447 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.408432 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:37.408497 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.408460 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:37.408497 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.408471 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:37.408904 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.408891 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" May 25 01:02:37.408904 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.408902 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 25 01:02:37.408990 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.408918 2576 state_mem.go:36] "Initialized new in-memory state store" May 25 01:02:37.411912 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.411899 2576 policy_none.go:49] "None policy: Start" May 25 01:02:37.411969 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.411916 2576 memory_manager.go:186] "Starting memorymanager" policy="None" May 25 01:02:37.411969 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.411927 2576 state_mem.go:35] "Initializing new in-memory state store" May 25 01:02:37.465853 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.465831 2576 manager.go:341] "Starting Device Plugin manager" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.465875 2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.465889 2576 server.go:85] "Starting device plugin registration server" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.466162 2576 eviction_manager.go:189] "Eviction manager: starting control loop" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.466176 2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.466285 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.466358 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.466364 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.467150 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 25 01:02:37.482701 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.467192 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:37.535579 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.535509 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 25 01:02:37.536880 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.536865 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 25 01:02:37.536986 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.536888 2576 status_manager.go:230] "Starting to sync pod status with apiserver" May 25 01:02:37.536986 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.536910 2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 25 01:02:37.536986 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.536919 2576 kubelet.go:2451] "Starting kubelet main sync loop" May 25 01:02:37.537108 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.537022 2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 25 01:02:37.542970 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.542951 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:37.566898 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.566881 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:37.567719 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.567701 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:37.567814 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.567726 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:37.567814 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.567737 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:37.567814 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.567759 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-11.ec2.internal" May 25 01:02:37.576526 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.576510 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-11.ec2.internal" May 25 01:02:37.576623 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.576535 2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-11.ec2.internal\": node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:37.589979 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.589964 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:37.637723 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.637701 2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal"] May 25 01:02:37.637802 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.637797 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:37.639466 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.639452 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:37.639548 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.639477 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:37.639548 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.639488 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:37.641744 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.641731 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:37.641920 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.641906 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:37.641970 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.641935 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:37.642444 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.642426 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:37.642444 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.642426 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:37.642616 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.642463 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:37.642616 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.642463 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:37.642616 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.642477 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:37.642616 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.642486 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:37.644689 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.644672 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" May 25 01:02:37.644780 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.644704 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:37.645349 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.645332 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:37.645420 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.645364 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:37.645420 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.645379 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:37.663783 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.663760 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-11.ec2.internal\" not found" node="ip-10-0-128-11.ec2.internal" May 25 01:02:37.667080 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.667065 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-11.ec2.internal\" not found" node="ip-10-0-128-11.ec2.internal" May 25 01:02:37.690047 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.690024 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:37.690128 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.690095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e16b9c530ef9165231efe472fc3ff294-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal\" (UID: \"e16b9c530ef9165231efe472fc3ff294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:37.690128 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.690116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e16b9c530ef9165231efe472fc3ff294-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal\" (UID: \"e16b9c530ef9165231efe472fc3ff294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:37.690243 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.690133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cef790bf704935fd6f0c648e0b097c0c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-11.ec2.internal\" (UID: \"cef790bf704935fd6f0c648e0b097c0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" May 25 01:02:37.790311 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.790245 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:37.790311 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.790301 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cef790bf704935fd6f0c648e0b097c0c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-11.ec2.internal\" (UID: \"cef790bf704935fd6f0c648e0b097c0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" May 25 01:02:37.790464 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.790326 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e16b9c530ef9165231efe472fc3ff294-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal\" (UID: \"e16b9c530ef9165231efe472fc3ff294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:37.790464 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.790346 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e16b9c530ef9165231efe472fc3ff294-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal\" (UID: \"e16b9c530ef9165231efe472fc3ff294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:37.790464 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.790377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e16b9c530ef9165231efe472fc3ff294-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal\" (UID: \"e16b9c530ef9165231efe472fc3ff294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:37.790464 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.790404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cef790bf704935fd6f0c648e0b097c0c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-11.ec2.internal\" (UID: \"cef790bf704935fd6f0c648e0b097c0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" May 25 01:02:37.790464 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.790411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e16b9c530ef9165231efe472fc3ff294-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal\" (UID: \"e16b9c530ef9165231efe472fc3ff294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:37.890745 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.890715 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:37.965915 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.965861 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:37.969731 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:37.969715 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" May 25 01:02:37.990954 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:37.990931 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:38.091377 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:38.091290 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:38.191736 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:38.191700 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:38.291232 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.291195 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 25 01:02:38.291917 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.291381 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 01:02:38.292257 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:38.292233 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:38.388464 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.388397 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 25 01:02:38.391609 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.391583 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 00:57:37 +0000 UTC" deadline="2028-02-05 11:40:44.508798582 +0000 UTC" May 25 01:02:38.391686 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.391609 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14914h38m6.117192147s" May 25 01:02:38.392680 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:38.392662 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:38.397890 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.397870 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 01:02:38.409094 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.409076 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:38.420488 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.420467 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kz9tk" May 25 01:02:38.428833 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.428818 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kz9tk" May 25 01:02:38.493061 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:38.493023 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:38.543461 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.543266 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:38.551942 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:38.551914 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16b9c530ef9165231efe472fc3ff294.slice/crio-b1425c3202a0411e1748e13839f954fc76c78412344341201499d5e9f5741f0b WatchSource:0}: Error finding container b1425c3202a0411e1748e13839f954fc76c78412344341201499d5e9f5741f0b: Status 404 returned error can't find the container with id b1425c3202a0411e1748e13839f954fc76c78412344341201499d5e9f5741f0b May 25 01:02:38.552173 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:38.552154 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef790bf704935fd6f0c648e0b097c0c.slice/crio-795ee0d0a12f2f5c8ebdd43da2e3174844c82caf2719ca3ad6dcfd0e6459f4ab WatchSource:0}: Error finding container 795ee0d0a12f2f5c8ebdd43da2e3174844c82caf2719ca3ad6dcfd0e6459f4ab: Status 404 returned error can't find the container with id 795ee0d0a12f2f5c8ebdd43da2e3174844c82caf2719ca3ad6dcfd0e6459f4ab May 25 01:02:38.556323 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.556306 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 01:02:38.593280 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:38.593253 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:38.693701 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:38.693629 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-11.ec2.internal\" not found" May 25 01:02:38.749852 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.749821 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:38.789297 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.789255 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" May 25 01:02:38.806372 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.806336 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 01:02:38.807319 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.807307 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" May 25 01:02:38.816793 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:38.816780 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 01:02:39.363947 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.363872 2576 apiserver.go:52] "Watching apiserver" May 25 01:02:39.365763 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.365742 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:39.370658 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.370636 2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 25 01:02:39.371044 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.371016 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-l7mf9","openshift-image-registry/node-ca-kqxcg","openshift-multus/multus-additional-cni-plugins-w8f62","openshift-multus/multus-kdn9g","openshift-network-operator/iptables-alerter-gr8cn","kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal","openshift-multus/network-metrics-daemon-b4pxg","openshift-network-diagnostics/network-check-target-s4sqq","openshift-ovn-kubernetes/ovnkube-node-t5l7k","kube-system/konnectivity-agent-8fpl8","openshift-cluster-node-tuning-operator/tuned-9tdfv"] May 25 01:02:39.373536 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.373514 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.375651 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.375634 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.376462 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.376441 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 25 01:02:39.376565 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.376464 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 25 01:02:39.376655 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.376632 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 25 01:02:39.376714 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.376699 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jj4rp\"" May 25 01:02:39.378158 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.377998 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 25 01:02:39.378553 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.378533 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 25 01:02:39.378659 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.378558 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zfwsz\"" May 25 01:02:39.378659 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.378637 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 25 01:02:39.380393 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.380376 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.382517 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.382470 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kdn9g" May 25 01:02:39.383052 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.383034 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 25 01:02:39.383218 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.383196 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 25 01:02:39.383338 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.383296 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 25 01:02:39.383338 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.383303 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5ksw6\"" May 25 01:02:39.383438 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.383352 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 25 01:02:39.383438 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.383407 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 25 01:02:39.384620 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.384603 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 25 01:02:39.384708 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.384607 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.384873 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.384854 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f5rvz\"" May 25 01:02:39.384970 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.384873 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.386978 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.386958 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:39.387068 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:39.387028 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:39.387187 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.387170 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gqppm\"" May 25 01:02:39.387282 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.387271 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 25 01:02:39.387339 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.387278 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 25 01:02:39.387474 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.387455 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 25 01:02:39.387574 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.387490 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 25 01:02:39.387574 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.387523 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 25 01:02:39.387680 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.387603 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m64g6\"" May 25 01:02:39.389839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.389760 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:39.389983 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:39.389955 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:39.392680 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.392658 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.395649 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.395628 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggrbc\"" May 25 01:02:39.395904 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.395880 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 25 01:02:39.395984 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.395913 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 25 01:02:39.396042 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396020 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396145 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396227 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396263 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-socket-dir-parent\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-cni-multus\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9khmf\" (UniqueName: \"kubernetes.io/projected/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-kube-api-access-9khmf\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3189d30-4fd7-4b96-8241-d79fdc007377-host\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3189d30-4fd7-4b96-8241-d79fdc007377-serviceca\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-kubelet\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-cni-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.396839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-daemon-config\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-etc-kubernetes\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37f2f933-7033-41c6-9545-0988d7ec6ef6-iptables-alerter-script\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vltbj\" (UniqueName: \"kubernetes.io/projected/37f2f933-7033-41c6-9545-0988d7ec6ef6-kube-api-access-vltbj\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxc78\" (UniqueName: \"kubernetes.io/projected/f3189d30-4fd7-4b96-8241-d79fdc007377-kube-api-access-hxc78\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cni-binary-copy\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.396963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-hostroot\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-system-cni-dir\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cnibin\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-tmp-dir\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszzn\" (UniqueName: \"kubernetes.io/projected/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-kube-api-access-vszzn\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr2xh\" (UniqueName: \"kubernetes.io/projected/3f49e520-69c0-4518-917d-9b40ce19c4ea-kube-api-access-sr2xh\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:39.397267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-os-release\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-cni-binary-copy\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-device-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-hosts-file\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-netns\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhhq\" (UniqueName: \"kubernetes.io/projected/39dda70d-df4a-4aac-a731-89fe77f15eeb-kube-api-access-sjhhq\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdzqw\" (UniqueName: \"kubernetes.io/projected/c4cacf21-ff59-4e12-8f9b-130673bfc29f-kube-api-access-fdzqw\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-cnibin\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-os-release\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-k8s-cni-cncf-io\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.397764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-cni-bin\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.398320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397730 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.398320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397741 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8fpl8" May 25 01:02:39.398320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-conf-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.398320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-multus-certs\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.398320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37f2f933-7033-41c6-9545-0988d7ec6ef6-host-slash\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.398320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.397853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-system-cni-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.400112 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.400078 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 25 01:02:39.400238 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.400136 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-npnrp\"" May 25 01:02:39.400361 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.400244 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 25 01:02:39.400361 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.400353 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lt7vw\"" May 25 01:02:39.400468 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.400416 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 25 01:02:39.400523 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.400479 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 25 01:02:39.429623 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.429598 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:38 +0000 UTC" deadline="2028-02-08 13:45:55.279876132 +0000 UTC" May 25 01:02:39.429623 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.429621 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14988h43m15.850257376s" May 25 01:02:39.488945 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.488915 2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 25 01:02:39.498975 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.498945 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-cni-binary-copy\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499116 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.498989 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-device-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.499116 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499019 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.499116 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499047 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-hosts-file\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.499116 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-tuned\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.499116 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-log-socket\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499113 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-device-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499185 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-cnibin\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499122 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-cnibin\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499242 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-systemd-units\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-etc-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499310 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-os-release\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-node-log\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-modprobe-d\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-var-lib-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.499407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499401 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-k8s-cni-cncf-io\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499425 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-conf-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499450 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-multus-certs\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499472 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37f2f933-7033-41c6-9545-0988d7ec6ef6-host-slash\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499496 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3189d30-4fd7-4b96-8241-d79fdc007377-host\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499520 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3189d30-4fd7-4b96-8241-d79fdc007377-serviceca\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499547 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-system-cni-dir\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499577 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-system-cni-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499597 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-socket-dir-parent\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499617 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9khmf\" (UniqueName: \"kubernetes.io/projected/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-kube-api-access-9khmf\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499642 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499668 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cnibin\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-k8s-cni-cncf-io\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499694 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-slash\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.499889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-ovnkube-script-lib\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-os-release\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499787 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-daemon-config\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-cni-binary-copy\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499812 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-etc-kubernetes\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499837 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37f2f933-7033-41c6-9545-0988d7ec6ef6-iptables-alerter-script\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-hosts-file\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499862 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-tmp-dir\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499907 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vszzn\" (UniqueName: \"kubernetes.io/projected/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-kube-api-access-vszzn\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-etc-kubernetes\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-ovn\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.499996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-conf-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-tmp-dir\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500413 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-hostroot\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-system-cni-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-multus-certs\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-daemon-config\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37f2f933-7033-41c6-9545-0988d7ec6ef6-host-slash\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.500573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3189d30-4fd7-4b96-8241-d79fdc007377-host\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-socket-dir-parent\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37f2f933-7033-41c6-9545-0988d7ec6ef6-iptables-alerter-script\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-system-cni-dir\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cnibin\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500823 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-hostroot\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-run-netns\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3189d30-4fd7-4b96-8241-d79fdc007377-serviceca\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4cacf21-ff59-4e12-8f9b-130673bfc29f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.500993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-run\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-lib-modules\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-var-lib-kubelet\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501092 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-os-release\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.501114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-host\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501127 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-netns\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501144 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhhq\" (UniqueName: \"kubernetes.io/projected/39dda70d-df4a-4aac-a731-89fe77f15eeb-kube-api-access-sjhhq\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501196 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501231 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdzqw\" (UniqueName: \"kubernetes.io/projected/c4cacf21-ff59-4e12-8f9b-130673bfc29f-kube-api-access-fdzqw\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f55b4ba-337f-4abf-8533-3ca933aa0426-tmp\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501280 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-ovnkube-config\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-os-release\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-run-netns\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4-konnectivity-ca\") pod \"konnectivity-agent-8fpl8\" (UID: \"bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4\") " pod="kube-system/konnectivity-agent-8fpl8" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-kubelet\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-cni-netd\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4-agent-certs\") pod \"konnectivity-agent-8fpl8\" (UID: \"bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4\") " pod="kube-system/konnectivity-agent-8fpl8" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-kubernetes\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.501804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501709 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501754 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:39.501825 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501883 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-cni-bin\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:39.501910 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs podName:3f49e520-69c0-4518-917d-9b40ce19c4ea nodeName:}" failed. No retries permitted until 2026-05-25 01:02:40.001870853 +0000 UTC m=+3.076930698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs") pod "network-metrics-daemon-b4pxg" (UID: "3f49e520-69c0-4518-917d-9b40ce19c4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501934 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-cni-bin\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-cni-bin\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.501988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysconfig\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502020 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-cni-multus\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-cni-multus\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502088 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502124 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cni-binary-copy\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twr7l\" (UniqueName: \"kubernetes.io/projected/8d257155-006f-422f-a108-6143220e0ca1-kube-api-access-twr7l\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysctl-conf\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.502554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-systemd\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502262 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-kubelet\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502288 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-cni-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502313 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vltbj\" (UniqueName: \"kubernetes.io/projected/37f2f933-7033-41c6-9545-0988d7ec6ef6-kube-api-access-vltbj\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502338 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxc78\" (UniqueName: \"kubernetes.io/projected/f3189d30-4fd7-4b96-8241-d79fdc007377-kube-api-access-hxc78\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d257155-006f-422f-a108-6143220e0ca1-ovn-node-metrics-cert\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8njf\" (UniqueName: \"kubernetes.io/projected/6f55b4ba-337f-4abf-8533-3ca933aa0426-kube-api-access-z8njf\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-systemd\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-env-overrides\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysctl-d\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-sys\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502546 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sr2xh\" (UniqueName: \"kubernetes.io/projected/3f49e520-69c0-4518-917d-9b40ce19c4ea-kube-api-access-sr2xh\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502586 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4cacf21-ff59-4e12-8f9b-130673bfc29f-cni-binary-copy\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502228 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39dda70d-df4a-4aac-a731-89fe77f15eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-host-var-lib-kubelet\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.503230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.502803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-multus-cni-dir\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.513036 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.512997 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 25 01:02:39.513141 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:39.513055 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:39.513141 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:39.513077 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:39.513141 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:39.513090 2576 projected.go:194] Error preparing data for projected volume kube-api-access-lzmg7 for pod openshift-network-diagnostics/network-check-target-s4sqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:39.513278 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:39.513149 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7 podName:4c1d0c44-3976-45a8-be1a-410e9225fc42 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:40.013136283 +0000 UTC m=+3.088196125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lzmg7" (UniqueName: "kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7") pod "network-check-target-s4sqq" (UID: "4c1d0c44-3976-45a8-be1a-410e9225fc42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:39.516447 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.516424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszzn\" (UniqueName: \"kubernetes.io/projected/ffe78edd-189b-4a93-90cc-5f2c97d9a6cd-kube-api-access-vszzn\") pod \"node-resolver-l7mf9\" (UID: \"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd\") " pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.518059 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.518036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9khmf\" (UniqueName: \"kubernetes.io/projected/727e87f7-0bbf-41c3-8e71-5f5b7be641fa-kube-api-access-9khmf\") pod \"multus-kdn9g\" (UID: \"727e87f7-0bbf-41c3-8e71-5f5b7be641fa\") " pod="openshift-multus/multus-kdn9g" May 25 01:02:39.526445 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.526419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vltbj\" (UniqueName: \"kubernetes.io/projected/37f2f933-7033-41c6-9545-0988d7ec6ef6-kube-api-access-vltbj\") pod \"iptables-alerter-gr8cn\" (UID: \"37f2f933-7033-41c6-9545-0988d7ec6ef6\") " pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.531060 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.531036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxc78\" (UniqueName: \"kubernetes.io/projected/f3189d30-4fd7-4b96-8241-d79fdc007377-kube-api-access-hxc78\") pod \"node-ca-kqxcg\" (UID: \"f3189d30-4fd7-4b96-8241-d79fdc007377\") " pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.533110 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.533087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdzqw\" (UniqueName: \"kubernetes.io/projected/c4cacf21-ff59-4e12-8f9b-130673bfc29f-kube-api-access-fdzqw\") pod \"multus-additional-cni-plugins-w8f62\" (UID: \"c4cacf21-ff59-4e12-8f9b-130673bfc29f\") " pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.533794 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.533772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhhq\" (UniqueName: \"kubernetes.io/projected/39dda70d-df4a-4aac-a731-89fe77f15eeb-kube-api-access-sjhhq\") pod \"aws-ebs-csi-driver-node-zlnkg\" (UID: \"39dda70d-df4a-4aac-a731-89fe77f15eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.533794 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.533787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr2xh\" (UniqueName: \"kubernetes.io/projected/3f49e520-69c0-4518-917d-9b40ce19c4ea-kube-api-access-sr2xh\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:39.541236 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.541177 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" event={"ID":"cef790bf704935fd6f0c648e0b097c0c","Type":"ContainerStarted","Data":"795ee0d0a12f2f5c8ebdd43da2e3174844c82caf2719ca3ad6dcfd0e6459f4ab"} May 25 01:02:39.542192 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.542166 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" event={"ID":"e16b9c530ef9165231efe472fc3ff294","Type":"ContainerStarted","Data":"b1425c3202a0411e1748e13839f954fc76c78412344341201499d5e9f5741f0b"} May 25 01:02:39.603407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603371 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-ovn\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603413 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-run-netns\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603619 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603441 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603619 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603460 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-run\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603619 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603485 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-lib-modules\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603619 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603509 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-var-lib-kubelet\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603619 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603533 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-host\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603619 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603560 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f55b4ba-337f-4abf-8533-3ca933aa0426-tmp\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603619 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603586 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-ovnkube-config\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603619 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603608 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4-konnectivity-ca\") pod \"konnectivity-agent-8fpl8\" (UID: \"bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4\") " pod="kube-system/konnectivity-agent-8fpl8" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603636 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-kubelet\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603659 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-cni-netd\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603685 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4-agent-certs\") pod \"konnectivity-agent-8fpl8\" (UID: \"bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4\") " pod="kube-system/konnectivity-agent-8fpl8" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603710 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-kubernetes\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603734 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603768 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-cni-bin\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603798 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysconfig\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603828 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twr7l\" (UniqueName: \"kubernetes.io/projected/8d257155-006f-422f-a108-6143220e0ca1-kube-api-access-twr7l\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603851 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysctl-conf\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603871 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-systemd\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603903 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.603942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603923 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d257155-006f-422f-a108-6143220e0ca1-ovn-node-metrics-cert\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603952 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8njf\" (UniqueName: \"kubernetes.io/projected/6f55b4ba-337f-4abf-8533-3ca933aa0426-kube-api-access-z8njf\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.603976 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-systemd\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604000 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-env-overrides\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604016 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysctl-d\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604031 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-sys\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604066 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-tuned\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604091 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-log-socket\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604118 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-systemd-units\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604135 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-etc-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604156 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-node-log\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604186 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-modprobe-d\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604229 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-var-lib-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604285 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-slash\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604449 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604309 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-ovnkube-script-lib\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.604975 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.604940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-ovnkube-script-lib\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.605029 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605012 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-ovn\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.605079 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605042 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-run-netns\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.605116 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.605159 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-run\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.605254 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-lib-modules\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.605376 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-var-lib-kubelet\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.605376 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-host\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-systemd-units\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-log-socket\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-var-lib-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-kubernetes\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-run-systemd\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-etc-openvswitch\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-slash\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605811 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-node-log\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-sys\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-modprobe-d\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-kubelet\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606013 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.605962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-cni-netd\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606124 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysctl-conf\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysconfig\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d257155-006f-422f-a108-6143220e0ca1-host-cni-bin\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-systemd\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-sysctl-d\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4-konnectivity-ca\") pod \"konnectivity-agent-8fpl8\" (UID: \"bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4\") " pod="kube-system/konnectivity-agent-8fpl8" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-env-overrides\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.606756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.606608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d257155-006f-422f-a108-6143220e0ca1-ovnkube-config\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.607935 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.607912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f55b4ba-337f-4abf-8533-3ca933aa0426-tmp\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.608080 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.608058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d257155-006f-422f-a108-6143220e0ca1-ovn-node-metrics-cert\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.608817 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.608795 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f55b4ba-337f-4abf-8533-3ca933aa0426-etc-tuned\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.608909 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.608802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4-agent-certs\") pod \"konnectivity-agent-8fpl8\" (UID: \"bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4\") " pod="kube-system/konnectivity-agent-8fpl8" May 25 01:02:39.614708 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.614649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twr7l\" (UniqueName: \"kubernetes.io/projected/8d257155-006f-422f-a108-6143220e0ca1-kube-api-access-twr7l\") pod \"ovnkube-node-t5l7k\" (UID: \"8d257155-006f-422f-a108-6143220e0ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.614708 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.614698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8njf\" (UniqueName: \"kubernetes.io/projected/6f55b4ba-337f-4abf-8533-3ca933aa0426-kube-api-access-z8njf\") pod \"tuned-9tdfv\" (UID: \"6f55b4ba-337f-4abf-8533-3ca933aa0426\") " pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.686633 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.686593 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" May 25 01:02:39.696655 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.696630 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqxcg" May 25 01:02:39.703322 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.703301 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w8f62" May 25 01:02:39.708155 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.708138 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kdn9g" May 25 01:02:39.715075 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.715049 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gr8cn" May 25 01:02:39.721651 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.721631 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l7mf9" May 25 01:02:39.728307 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.728285 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:02:39.734908 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.734879 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" May 25 01:02:39.740556 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:39.740536 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8fpl8" May 25 01:02:40.008418 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.008336 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:40.008569 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:40.008511 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:40.008642 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:40.008594 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs podName:3f49e520-69c0-4518-917d-9b40ce19c4ea nodeName:}" failed. No retries permitted until 2026-05-25 01:02:41.008572648 +0000 UTC m=+4.083632471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs") pod "network-metrics-daemon-b4pxg" (UID: "3f49e520-69c0-4518-917d-9b40ce19c4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:40.109139 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.109102 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:40.109363 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:40.109323 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:40.109363 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:40.109349 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:40.109363 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:40.109362 2576 projected.go:194] Error preparing data for projected volume kube-api-access-lzmg7 for pod openshift-network-diagnostics/network-check-target-s4sqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:40.109527 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:40.109434 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7 podName:4c1d0c44-3976-45a8-be1a-410e9225fc42 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:41.109413287 +0000 UTC m=+4.184473127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzmg7" (UniqueName: "kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7") pod "network-check-target-s4sqq" (UID: "4c1d0c44-3976-45a8-be1a-410e9225fc42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:40.121757 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.121727 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f2f933_7033_41c6_9545_0988d7ec6ef6.slice/crio-1fff771716e7616c5553fe34d51191e757453abac017642182cfb51e39ae6c3e WatchSource:0}: Error finding container 1fff771716e7616c5553fe34d51191e757453abac017642182cfb51e39ae6c3e: Status 404 returned error can't find the container with id 1fff771716e7616c5553fe34d51191e757453abac017642182cfb51e39ae6c3e May 25 01:02:40.124735 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.124706 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3189d30_4fd7_4b96_8241_d79fdc007377.slice/crio-ce63e2a21b5753b89bb04d4b0ceeff19da04040caf83ec9ea8549a0e2d8d6b07 WatchSource:0}: Error finding container ce63e2a21b5753b89bb04d4b0ceeff19da04040caf83ec9ea8549a0e2d8d6b07: Status 404 returned error can't find the container with id ce63e2a21b5753b89bb04d4b0ceeff19da04040caf83ec9ea8549a0e2d8d6b07 May 25 01:02:40.125712 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.125686 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe62eec_4ce7_4fd0_88f1_9319e7dbefe4.slice/crio-c0a35b9e7bce3b170be3c0cbb225dfd90aa5bc23fb5caa0fc9ba851973415c65 WatchSource:0}: Error finding container c0a35b9e7bce3b170be3c0cbb225dfd90aa5bc23fb5caa0fc9ba851973415c65: Status 404 returned error can't find the container with id c0a35b9e7bce3b170be3c0cbb225dfd90aa5bc23fb5caa0fc9ba851973415c65 May 25 01:02:40.126901 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.126878 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4cacf21_ff59_4e12_8f9b_130673bfc29f.slice/crio-29f3bcb08a1f592b288ad86d1582a4d26dc0b9014b7219b5ab966e8aa92385a3 WatchSource:0}: Error finding container 29f3bcb08a1f592b288ad86d1582a4d26dc0b9014b7219b5ab966e8aa92385a3: Status 404 returned error can't find the container with id 29f3bcb08a1f592b288ad86d1582a4d26dc0b9014b7219b5ab966e8aa92385a3 May 25 01:02:40.127590 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.127566 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39dda70d_df4a_4aac_a731_89fe77f15eeb.slice/crio-113e5f923b7565390eaaeaceea0033743e1784d6771afda34be153f1ae9329aa WatchSource:0}: Error finding container 113e5f923b7565390eaaeaceea0033743e1784d6771afda34be153f1ae9329aa: Status 404 returned error can't find the container with id 113e5f923b7565390eaaeaceea0033743e1784d6771afda34be153f1ae9329aa May 25 01:02:40.128521 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.128501 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe78edd_189b_4a93_90cc_5f2c97d9a6cd.slice/crio-8aad2b0f9d7d32946f101eb8081355132a58b085fdf254ccfa847df0f4ae9c1e WatchSource:0}: Error finding container 8aad2b0f9d7d32946f101eb8081355132a58b085fdf254ccfa847df0f4ae9c1e: Status 404 returned error can't find the container with id 8aad2b0f9d7d32946f101eb8081355132a58b085fdf254ccfa847df0f4ae9c1e May 25 01:02:40.129160 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.129031 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f55b4ba_337f_4abf_8533_3ca933aa0426.slice/crio-93a47433a55b777ad65ae8bad9634b3762d1ef38c01c497636c599c5fd53eee9 WatchSource:0}: Error finding container 93a47433a55b777ad65ae8bad9634b3762d1ef38c01c497636c599c5fd53eee9: Status 404 returned error can't find the container with id 93a47433a55b777ad65ae8bad9634b3762d1ef38c01c497636c599c5fd53eee9 May 25 01:02:40.131138 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.131118 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727e87f7_0bbf_41c3_8e71_5f5b7be641fa.slice/crio-79665c0d63ea6dbc08a832770d9f11c784dc8d9d6697cb52984e21a0e28c4e86 WatchSource:0}: Error finding container 79665c0d63ea6dbc08a832770d9f11c784dc8d9d6697cb52984e21a0e28c4e86: Status 404 returned error can't find the container with id 79665c0d63ea6dbc08a832770d9f11c784dc8d9d6697cb52984e21a0e28c4e86 May 25 01:02:40.132248 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:02:40.132201 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d257155_006f_422f_a108_6143220e0ca1.slice/crio-4446cbfc663a0de082993ec7c3b269773c96fd007968061792b5861e295061c9 WatchSource:0}: Error finding container 4446cbfc663a0de082993ec7c3b269773c96fd007968061792b5861e295061c9: Status 404 returned error can't find the container with id 4446cbfc663a0de082993ec7c3b269773c96fd007968061792b5861e295061c9 May 25 01:02:40.430316 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.430285 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:38 +0000 UTC" deadline="2027-11-20 00:48:58.491486051 +0000 UTC" May 25 01:02:40.430316 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.430316 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13055h46m18.061173671s" May 25 01:02:40.538154 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.538115 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:40.538322 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:40.538262 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:40.550441 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.550403 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqxcg" event={"ID":"f3189d30-4fd7-4b96-8241-d79fdc007377","Type":"ContainerStarted","Data":"ce63e2a21b5753b89bb04d4b0ceeff19da04040caf83ec9ea8549a0e2d8d6b07"} May 25 01:02:40.555034 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.554970 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8fpl8" event={"ID":"bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4","Type":"ContainerStarted","Data":"c0a35b9e7bce3b170be3c0cbb225dfd90aa5bc23fb5caa0fc9ba851973415c65"} May 25 01:02:40.560891 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.560858 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gr8cn" event={"ID":"37f2f933-7033-41c6-9545-0988d7ec6ef6","Type":"ContainerStarted","Data":"1fff771716e7616c5553fe34d51191e757453abac017642182cfb51e39ae6c3e"} May 25 01:02:40.569132 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.569100 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" event={"ID":"cef790bf704935fd6f0c648e0b097c0c","Type":"ContainerStarted","Data":"f99a37e0b16c596a3da76c6663a2c044e7769d6e7d3c913dca0d2dc26ea8b102"} May 25 01:02:40.572946 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.572888 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" event={"ID":"39dda70d-df4a-4aac-a731-89fe77f15eeb","Type":"ContainerStarted","Data":"113e5f923b7565390eaaeaceea0033743e1784d6771afda34be153f1ae9329aa"} May 25 01:02:40.580468 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.580440 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerStarted","Data":"29f3bcb08a1f592b288ad86d1582a4d26dc0b9014b7219b5ab966e8aa92385a3"} May 25 01:02:40.585018 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.584982 2576 generic.go:358] "Generic (PLEG): container finished" podID="e16b9c530ef9165231efe472fc3ff294" containerID="388cb0fa6351539d9664e1f02cee9c780d57de99eb593b7ad3ab282c4c73fd68" exitCode=0 May 25 01:02:40.585184 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.585105 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" event={"ID":"e16b9c530ef9165231efe472fc3ff294","Type":"ContainerDied","Data":"388cb0fa6351539d9664e1f02cee9c780d57de99eb593b7ad3ab282c4c73fd68"} May 25 01:02:40.591309 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.591255 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"4446cbfc663a0de082993ec7c3b269773c96fd007968061792b5861e295061c9"} May 25 01:02:40.600310 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.599940 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-11.ec2.internal" podStartSLOduration=2.59992455 podStartE2EDuration="2.59992455s" podCreationTimestamp="2026-05-25 01:02:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:40.585080703 +0000 UTC m=+3.660140545" watchObservedRunningTime="2026-05-25 01:02:40.59992455 +0000 UTC m=+3.674984396" May 25 01:02:40.603737 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.603707 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" event={"ID":"6f55b4ba-337f-4abf-8533-3ca933aa0426","Type":"ContainerStarted","Data":"93a47433a55b777ad65ae8bad9634b3762d1ef38c01c497636c599c5fd53eee9"} May 25 01:02:40.612759 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.612732 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kdn9g" event={"ID":"727e87f7-0bbf-41c3-8e71-5f5b7be641fa","Type":"ContainerStarted","Data":"79665c0d63ea6dbc08a832770d9f11c784dc8d9d6697cb52984e21a0e28c4e86"} May 25 01:02:40.632230 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:40.632151 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l7mf9" event={"ID":"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd","Type":"ContainerStarted","Data":"8aad2b0f9d7d32946f101eb8081355132a58b085fdf254ccfa847df0f4ae9c1e"} May 25 01:02:41.016744 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:41.016656 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:41.016900 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:41.016845 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:41.016968 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:41.016906 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs podName:3f49e520-69c0-4518-917d-9b40ce19c4ea nodeName:}" failed. No retries permitted until 2026-05-25 01:02:43.016888366 +0000 UTC m=+6.091948193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs") pod "network-metrics-daemon-b4pxg" (UID: "3f49e520-69c0-4518-917d-9b40ce19c4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:41.117764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:41.117723 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:41.117931 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:41.117887 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:41.117931 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:41.117905 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:41.117931 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:41.117918 2576 projected.go:194] Error preparing data for projected volume kube-api-access-lzmg7 for pod openshift-network-diagnostics/network-check-target-s4sqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:41.118073 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:41.117977 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7 podName:4c1d0c44-3976-45a8-be1a-410e9225fc42 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:43.11795659 +0000 UTC m=+6.193016432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzmg7" (UniqueName: "kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7") pod "network-check-target-s4sqq" (UID: "4c1d0c44-3976-45a8-be1a-410e9225fc42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:41.541826 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:41.541175 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:41.546230 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:41.542313 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:41.645729 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:41.645647 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" event={"ID":"e16b9c530ef9165231efe472fc3ff294","Type":"ContainerStarted","Data":"55b2e7704675259227f5ecf25c15e72c10ffd5cf871eae19f472ffd0f49790c3"} May 25 01:02:42.538053 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:42.538017 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:42.538270 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:42.538150 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:43.034191 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:43.034148 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:43.034656 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:43.034358 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:43.034656 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:43.034425 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs podName:3f49e520-69c0-4518-917d-9b40ce19c4ea nodeName:}" failed. No retries permitted until 2026-05-25 01:02:47.034406685 +0000 UTC m=+10.109466515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs") pod "network-metrics-daemon-b4pxg" (UID: "3f49e520-69c0-4518-917d-9b40ce19c4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:43.134792 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:43.134758 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:43.134984 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:43.134914 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:43.134984 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:43.134935 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:43.134984 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:43.134947 2576 projected.go:194] Error preparing data for projected volume kube-api-access-lzmg7 for pod openshift-network-diagnostics/network-check-target-s4sqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:43.135143 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:43.135007 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7 podName:4c1d0c44-3976-45a8-be1a-410e9225fc42 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:47.134988028 +0000 UTC m=+10.210047854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzmg7" (UniqueName: "kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7") pod "network-check-target-s4sqq" (UID: "4c1d0c44-3976-45a8-be1a-410e9225fc42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:43.538229 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:43.538175 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:43.538419 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:43.538328 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:44.537118 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:44.537081 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:44.537587 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:44.537242 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:45.539433 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:45.539165 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:45.539843 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:45.539543 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:46.537146 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:46.537114 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:46.537347 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:46.537306 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:47.066877 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:47.066840 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:47.067355 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:47.067016 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:47.067355 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:47.067092 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs podName:3f49e520-69c0-4518-917d-9b40ce19c4ea nodeName:}" failed. No retries permitted until 2026-05-25 01:02:55.067070434 +0000 UTC m=+18.142130258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs") pod "network-metrics-daemon-b4pxg" (UID: "3f49e520-69c0-4518-917d-9b40ce19c4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:47.167942 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:47.167909 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:47.168085 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:47.168028 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:47.168085 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:47.168040 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:47.168085 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:47.168049 2576 projected.go:194] Error preparing data for projected volume kube-api-access-lzmg7 for pod openshift-network-diagnostics/network-check-target-s4sqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:47.168205 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:47.168091 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7 podName:4c1d0c44-3976-45a8-be1a-410e9225fc42 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:55.168077741 +0000 UTC m=+18.243137568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzmg7" (UniqueName: "kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7") pod "network-check-target-s4sqq" (UID: "4c1d0c44-3976-45a8-be1a-410e9225fc42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:47.539532 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:47.538991 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:47.539532 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:47.539133 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:48.538097 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:48.538009 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:48.538555 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:48.538154 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:49.537888 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:49.537857 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:49.538076 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:49.538005 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:50.537602 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:50.537566 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:50.537978 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:50.537679 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:51.537632 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:51.537596 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:51.538054 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:51.537718 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:52.538030 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:52.538003 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:52.538430 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:52.538101 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:53.537898 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:53.537865 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:53.538048 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:53.538014 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:54.537521 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:54.537478 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:54.537928 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:54.537636 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:55.124063 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:55.123978 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:55.124229 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:55.124111 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:55.124229 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:55.124179 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs podName:3f49e520-69c0-4518-917d-9b40ce19c4ea nodeName:}" failed. No retries permitted until 2026-05-25 01:03:11.124160409 +0000 UTC m=+34.199220238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs") pod "network-metrics-daemon-b4pxg" (UID: "3f49e520-69c0-4518-917d-9b40ce19c4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:55.225324 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:55.225240 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:55.225485 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:55.225407 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:55.225485 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:55.225427 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:55.225485 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:55.225436 2576 projected.go:194] Error preparing data for projected volume kube-api-access-lzmg7 for pod openshift-network-diagnostics/network-check-target-s4sqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:55.225583 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:55.225489 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7 podName:4c1d0c44-3976-45a8-be1a-410e9225fc42 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:11.225475703 +0000 UTC m=+34.300535531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzmg7" (UniqueName: "kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7") pod "network-check-target-s4sqq" (UID: "4c1d0c44-3976-45a8-be1a-410e9225fc42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:55.540647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:55.540577 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:55.541069 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:55.540701 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:56.537537 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:56.537503 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:56.537763 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:56.537641 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:57.540603 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:57.540575 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:57.540955 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:57.540714 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:58.537453 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:58.537429 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:02:58.537568 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:58.537527 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:02:58.676744 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:58.676714 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqxcg" event={"ID":"f3189d30-4fd7-4b96-8241-d79fdc007377","Type":"ContainerStarted","Data":"c05913f740cc78a7d2a2ac09a00e93840d9ae40a4e64f9384f99e6a9b32de029"} May 25 01:02:58.678833 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:58.678800 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8fpl8" event={"ID":"bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4","Type":"ContainerStarted","Data":"44a002049bded81a3c53b945bd7dc8359ef5972cc0cbb62fc827fff9f69739fa"} May 25 01:02:59.540388 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.540194 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:02:59.540550 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:02:59.540478 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:02:59.681381 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.681337 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l7mf9" event={"ID":"ffe78edd-189b-4a93-90cc-5f2c97d9a6cd","Type":"ContainerStarted","Data":"17d58b914b651414c66e5eff08fd3914283cef1000507c52c7d1e3b6aba0a00e"} May 25 01:02:59.682628 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.682604 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" event={"ID":"39dda70d-df4a-4aac-a731-89fe77f15eeb","Type":"ContainerStarted","Data":"11abc7183bc7a8647d2e628a07fc0d6805e6e498ed74d945b1b29f04eb8697b1"} May 25 01:02:59.683807 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.683782 2576 generic.go:358] "Generic (PLEG): container finished" podID="c4cacf21-ff59-4e12-8f9b-130673bfc29f" containerID="a6165a46597043fad31a565324a9d9cfb81f8e4072e6c54642068e07d5938988" exitCode=0 May 25 01:02:59.683890 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.683853 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerDied","Data":"a6165a46597043fad31a565324a9d9cfb81f8e4072e6c54642068e07d5938988"} May 25 01:02:59.696675 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.696635 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-11.ec2.internal" podStartSLOduration=21.696623272 podStartE2EDuration="21.696623272s" podCreationTimestamp="2026-05-25 01:02:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:41.659393557 +0000 UTC m=+4.734453403" watchObservedRunningTime="2026-05-25 01:02:59.696623272 +0000 UTC m=+22.771683116" May 25 01:02:59.696950 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.696930 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-l7mf9" podStartSLOduration=4.346461966 podStartE2EDuration="22.69692483s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.155450594 +0000 UTC m=+3.230510420" lastFinishedPulling="2026-05-25 01:02:58.505913461 +0000 UTC m=+21.580973284" observedRunningTime="2026-05-25 01:02:59.696325073 +0000 UTC m=+22.771384919" watchObservedRunningTime="2026-05-25 01:02:59.69692483 +0000 UTC m=+22.771984675" May 25 01:02:59.700022 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.700001 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"8b7a19110fb008d90fc76955028826f7e873f33ad9f85a83c304198e7ea3de5c"} May 25 01:02:59.700096 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.700027 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"eac5abd3a355c78e1101d81399adaf066e75ffae4d6df49c06b8296efd166e36"} May 25 01:02:59.700096 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.700037 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"dda822a364a66eae303fa68cb53145118017e72fa30fe1a47ec21740daeab154"} May 25 01:02:59.700096 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.700046 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"1379c0abb0d432a1effdd72c7faab8b897d2f62699fee101d47fe19eda5e8517"} May 25 01:02:59.700096 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.700057 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"6f723244e99a0630bdbbd5876b1ed6ca8eb7b24b2661ef7576e4a05ab38467f2"} May 25 01:02:59.700096 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.700069 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"2b04f4c719446600bd085585568ee1074dc45bd8eb54693da2c12bdcf4dafaab"} May 25 01:02:59.701249 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.701226 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" event={"ID":"6f55b4ba-337f-4abf-8533-3ca933aa0426","Type":"ContainerStarted","Data":"b289ad402ae8e929a04ef876b52d9773279d812d748c40350e63b46a6a2198c8"} May 25 01:02:59.702387 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.702367 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kdn9g" event={"ID":"727e87f7-0bbf-41c3-8e71-5f5b7be641fa","Type":"ContainerStarted","Data":"49fccaa33673f113fc8bdcad26486283a93618c4262856c161161fe2200853de"} May 25 01:02:59.734389 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.734341 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9tdfv" podStartSLOduration=4.382529465 podStartE2EDuration="22.734327013s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.155635651 +0000 UTC m=+3.230695478" lastFinishedPulling="2026-05-25 01:02:58.507433185 +0000 UTC m=+21.582493026" observedRunningTime="2026-05-25 01:02:59.733816638 +0000 UTC m=+22.808876484" watchObservedRunningTime="2026-05-25 01:02:59.734327013 +0000 UTC m=+22.809386874" May 25 01:02:59.748789 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.748744 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8fpl8" podStartSLOduration=7.88989247 podStartE2EDuration="22.748731944s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.128880248 +0000 UTC m=+3.203940085" lastFinishedPulling="2026-05-25 01:02:54.987719733 +0000 UTC m=+18.062779559" observedRunningTime="2026-05-25 01:02:59.74818744 +0000 UTC m=+22.823247284" watchObservedRunningTime="2026-05-25 01:02:59.748731944 +0000 UTC m=+22.823791789" May 25 01:02:59.772120 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.771960 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kqxcg" podStartSLOduration=7.9105307289999995 podStartE2EDuration="22.771945929s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.126300387 +0000 UTC m=+3.201360213" lastFinishedPulling="2026-05-25 01:02:54.987715576 +0000 UTC m=+18.062775413" observedRunningTime="2026-05-25 01:02:59.771909739 +0000 UTC m=+22.846969584" watchObservedRunningTime="2026-05-25 01:02:59.771945929 +0000 UTC m=+22.847005773" May 25 01:02:59.790095 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.790056 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-kdn9g" podStartSLOduration=4.147118806 podStartE2EDuration="22.790040676s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.155735738 +0000 UTC m=+3.230795575" lastFinishedPulling="2026-05-25 01:02:58.798657617 +0000 UTC m=+21.873717445" observedRunningTime="2026-05-25 01:02:59.789702282 +0000 UTC m=+22.864762126" watchObservedRunningTime="2026-05-25 01:02:59.790040676 +0000 UTC m=+22.865100521" May 25 01:02:59.953205 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:02:59.953183 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 25 01:03:00.480046 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.479895 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T01:02:59.953199343Z","UUID":"1ed4a571-8e48-410b-9e27-b8e75cee40a0","Handler":null,"Name":"","Endpoint":""} May 25 01:03:00.482917 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.482895 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 25 01:03:00.483082 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.482936 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 25 01:03:00.537705 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.537678 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:00.537860 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:00.537788 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:03:00.687435 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.687407 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8fpl8" May 25 01:03:00.687933 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.687908 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8fpl8" May 25 01:03:00.706093 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.706058 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gr8cn" event={"ID":"37f2f933-7033-41c6-9545-0988d7ec6ef6","Type":"ContainerStarted","Data":"ac2456b960162ba27963f2d71c1f6c38e295912a1d3dc2ef6385c9b6c795acec"} May 25 01:03:00.708420 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.708389 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" event={"ID":"39dda70d-df4a-4aac-a731-89fe77f15eeb","Type":"ContainerStarted","Data":"f071d312c75d80c6154fcf6252393dc5594ae3876bdcae666267e8438bd6c668"} May 25 01:03:00.728510 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:00.728458 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gr8cn" podStartSLOduration=5.346693217 podStartE2EDuration="23.728440471s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.124233533 +0000 UTC m=+3.199293358" lastFinishedPulling="2026-05-25 01:02:58.505980782 +0000 UTC m=+21.581040612" observedRunningTime="2026-05-25 01:03:00.727619839 +0000 UTC m=+23.802679686" watchObservedRunningTime="2026-05-25 01:03:00.728440471 +0000 UTC m=+23.803500317" May 25 01:03:01.262479 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:01.262394 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8fpl8" May 25 01:03:01.262973 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:01.262952 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8fpl8" May 25 01:03:01.540389 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:01.540311 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:01.540544 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:01.540426 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:03:01.712659 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:01.712620 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" event={"ID":"39dda70d-df4a-4aac-a731-89fe77f15eeb","Type":"ContainerStarted","Data":"206402690a6278a54b0d41b8c94d9358628068bdf40dfc2a18eb0bd6a335fcf6"} May 25 01:03:01.715879 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:01.715849 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"9df2131e77d738c744ff261ffb30bb370149928fdeccfaee8035f2be4e3d7437"} May 25 01:03:01.731716 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:01.731671 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlnkg" podStartSLOduration=3.848590841 podStartE2EDuration="24.731656348s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.130371386 +0000 UTC m=+3.205431212" lastFinishedPulling="2026-05-25 01:03:01.013436882 +0000 UTC m=+24.088496719" observedRunningTime="2026-05-25 01:03:01.731279741 +0000 UTC m=+24.806339585" watchObservedRunningTime="2026-05-25 01:03:01.731656348 +0000 UTC m=+24.806716196" May 25 01:03:02.537906 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:02.537873 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:02.538060 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:02.537983 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:03:03.537399 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:03.537367 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:03.538004 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:03.537507 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:03:04.537511 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:04.537335 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:04.537885 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:04.537583 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:03:04.721780 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:04.721748 2576 generic.go:358] "Generic (PLEG): container finished" podID="c4cacf21-ff59-4e12-8f9b-130673bfc29f" containerID="ff497d4972552eba3188c12561011c518fb38d77f7203255f7859e43a747563a" exitCode=0 May 25 01:03:04.721954 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:04.721832 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerDied","Data":"ff497d4972552eba3188c12561011c518fb38d77f7203255f7859e43a747563a"} May 25 01:03:04.725372 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:04.725250 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" event={"ID":"8d257155-006f-422f-a108-6143220e0ca1","Type":"ContainerStarted","Data":"e51d0b57a81b79aed3b8c02b4ef152a42122ed8236dcc4f8b5d0a2411c39a0e0"} May 25 01:03:04.725580 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:04.725563 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:03:04.725635 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:04.725587 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:03:04.741333 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:04.741309 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:03:05.538123 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.538094 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:05.538730 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:05.538203 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:03:05.729797 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.729647 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerStarted","Data":"5fa950d0953db46fff3d4e10ae61d1f2bd6c0518b0797eb99b88e478b4cd20f6"} May 25 01:03:05.730147 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.730121 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:03:05.750756 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.750736 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:03:05.786685 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.786632 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" podStartSLOduration=10.188178989 podStartE2EDuration="28.786617614s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.155734453 +0000 UTC m=+3.230794276" lastFinishedPulling="2026-05-25 01:02:58.754173076 +0000 UTC m=+21.829232901" observedRunningTime="2026-05-25 01:03:04.790701429 +0000 UTC m=+27.865761274" watchObservedRunningTime="2026-05-25 01:03:05.786617614 +0000 UTC m=+28.861677459" May 25 01:03:05.937408 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.937378 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4pxg"] May 25 01:03:05.937562 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.937492 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:05.937623 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:05.937586 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:03:05.939991 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.939968 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s4sqq"] May 25 01:03:05.940117 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:05.940055 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:05.940163 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:05.940130 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:03:06.733376 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:06.733339 2576 generic.go:358] "Generic (PLEG): container finished" podID="c4cacf21-ff59-4e12-8f9b-130673bfc29f" containerID="5fa950d0953db46fff3d4e10ae61d1f2bd6c0518b0797eb99b88e478b4cd20f6" exitCode=0 May 25 01:03:06.734053 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:06.733463 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerDied","Data":"5fa950d0953db46fff3d4e10ae61d1f2bd6c0518b0797eb99b88e478b4cd20f6"} May 25 01:03:07.538923 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:07.538891 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:07.539100 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:07.539022 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:03:07.539171 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:07.539093 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:07.539279 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:07.539255 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:03:08.738287 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:08.738247 2576 generic.go:358] "Generic (PLEG): container finished" podID="c4cacf21-ff59-4e12-8f9b-130673bfc29f" containerID="fa699ab38dbf6933d418f5038d453d6202c1edd2a3b04b3a43c11c30f8bde510" exitCode=0 May 25 01:03:08.738843 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:08.738304 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerDied","Data":"fa699ab38dbf6933d418f5038d453d6202c1edd2a3b04b3a43c11c30f8bde510"} May 25 01:03:09.538050 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:09.538020 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:09.538236 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:09.538128 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:03:09.538236 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:09.538197 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:09.538367 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:09.538322 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:03:11.140400 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.140360 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:11.140867 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.140525 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:03:11.140867 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.140605 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs podName:3f49e520-69c0-4518-917d-9b40ce19c4ea nodeName:}" failed. No retries permitted until 2026-05-25 01:03:43.140586011 +0000 UTC m=+66.215645847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs") pod "network-metrics-daemon-b4pxg" (UID: "3f49e520-69c0-4518-917d-9b40ce19c4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:03:11.241232 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.241183 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:11.241395 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.241361 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:03:11.241395 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.241383 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:03:11.241395 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.241396 2576 projected.go:194] Error preparing data for projected volume kube-api-access-lzmg7 for pod openshift-network-diagnostics/network-check-target-s4sqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:03:11.241540 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.241460 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7 podName:4c1d0c44-3976-45a8-be1a-410e9225fc42 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:43.241442007 +0000 UTC m=+66.316501847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzmg7" (UniqueName: "kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7") pod "network-check-target-s4sqq" (UID: "4c1d0c44-3976-45a8-be1a-410e9225fc42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:03:11.537789 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.537704 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:11.537953 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.537829 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4sqq" podUID="4c1d0c44-3976-45a8-be1a-410e9225fc42" May 25 01:03:11.538015 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.537964 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:11.538086 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.538063 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4pxg" podUID="3f49e520-69c0-4518-917d-9b40ce19c4ea" May 25 01:03:11.727982 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.727955 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-11.ec2.internal" event="NodeReady" May 25 01:03:11.728167 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.728103 2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 25 01:03:11.773176 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.773144 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tbrtc"] May 25 01:03:11.776677 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.776648 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fzm75"] May 25 01:03:11.776839 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.776819 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.779477 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.779455 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 25 01:03:11.779611 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.779591 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bftwk\"" May 25 01:03:11.779705 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.779685 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 25 01:03:11.780509 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.780487 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:11.782778 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.782759 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rtn5\"" May 25 01:03:11.783094 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.783069 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 25 01:03:11.783250 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.783112 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 25 01:03:11.783250 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.783152 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 25 01:03:11.786652 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.786517 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tbrtc"] May 25 01:03:11.788889 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.788819 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fzm75"] May 25 01:03:11.846372 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.846346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4b945e3-319a-43c7-b993-89eb18d5e1e4-config-volume\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.846550 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.846381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.846550 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.846436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4b945e3-319a-43c7-b993-89eb18d5e1e4-tmp-dir\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.846550 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.846465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hj5d\" (UniqueName: \"kubernetes.io/projected/c4b945e3-319a-43c7-b993-89eb18d5e1e4-kube-api-access-2hj5d\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.846667 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.846549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqfpn\" (UniqueName: \"kubernetes.io/projected/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-kube-api-access-qqfpn\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:11.846667 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.846576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:11.947915 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.947873 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4b945e3-319a-43c7-b993-89eb18d5e1e4-config-volume\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.947915 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.947919 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.948166 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.947957 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4b945e3-319a-43c7-b993-89eb18d5e1e4-tmp-dir\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.948166 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.947985 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hj5d\" (UniqueName: \"kubernetes.io/projected/c4b945e3-319a-43c7-b993-89eb18d5e1e4-kube-api-access-2hj5d\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.948166 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.948017 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqfpn\" (UniqueName: \"kubernetes.io/projected/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-kube-api-access-qqfpn\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:11.948166 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.948052 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:11.948378 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.948189 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:11.948378 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.948231 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:11.948378 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.948273 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert podName:2a0f2312-f21f-44b0-9f83-32d57e6aa1fe nodeName:}" failed. No retries permitted until 2026-05-25 01:03:12.448251236 +0000 UTC m=+35.523311062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert") pod "ingress-canary-fzm75" (UID: "2a0f2312-f21f-44b0-9f83-32d57e6aa1fe") : secret "canary-serving-cert" not found May 25 01:03:11.948378 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:11.948298 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls podName:c4b945e3-319a-43c7-b993-89eb18d5e1e4 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:12.448281857 +0000 UTC m=+35.523341680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls") pod "dns-default-tbrtc" (UID: "c4b945e3-319a-43c7-b993-89eb18d5e1e4") : secret "dns-default-metrics-tls" not found May 25 01:03:11.948575 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.948418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4b945e3-319a-43c7-b993-89eb18d5e1e4-tmp-dir\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.948612 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.948591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4b945e3-319a-43c7-b993-89eb18d5e1e4-config-volume\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.960290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.960075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hj5d\" (UniqueName: \"kubernetes.io/projected/c4b945e3-319a-43c7-b993-89eb18d5e1e4-kube-api-access-2hj5d\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:11.960445 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:11.960149 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqfpn\" (UniqueName: \"kubernetes.io/projected/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-kube-api-access-qqfpn\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:12.452544 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:12.452509 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:12.452990 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:12.452576 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:12.452990 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:12.452679 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:12.452990 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:12.452683 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:12.452990 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:12.452762 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls podName:c4b945e3-319a-43c7-b993-89eb18d5e1e4 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:13.452741494 +0000 UTC m=+36.527801337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls") pod "dns-default-tbrtc" (UID: "c4b945e3-319a-43c7-b993-89eb18d5e1e4") : secret "dns-default-metrics-tls" not found May 25 01:03:12.452990 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:12.452783 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert podName:2a0f2312-f21f-44b0-9f83-32d57e6aa1fe nodeName:}" failed. No retries permitted until 2026-05-25 01:03:13.452772982 +0000 UTC m=+36.527832806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert") pod "ingress-canary-fzm75" (UID: "2a0f2312-f21f-44b0-9f83-32d57e6aa1fe") : secret "canary-serving-cert" not found May 25 01:03:13.460868 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.460834 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:13.461335 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.460905 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:13.461335 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:13.460989 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:13.461335 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:13.461012 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:13.461335 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:13.461052 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert podName:2a0f2312-f21f-44b0-9f83-32d57e6aa1fe nodeName:}" failed. No retries permitted until 2026-05-25 01:03:15.461035108 +0000 UTC m=+38.536094930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert") pod "ingress-canary-fzm75" (UID: "2a0f2312-f21f-44b0-9f83-32d57e6aa1fe") : secret "canary-serving-cert" not found May 25 01:03:13.461335 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:13.461086 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls podName:c4b945e3-319a-43c7-b993-89eb18d5e1e4 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:15.461076631 +0000 UTC m=+38.536136454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls") pod "dns-default-tbrtc" (UID: "c4b945e3-319a-43c7-b993-89eb18d5e1e4") : secret "dns-default-metrics-tls" not found May 25 01:03:13.539495 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.539273 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:13.539736 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.539287 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:13.544273 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.544241 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2dmfc\"" May 25 01:03:13.544273 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.544260 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 01:03:13.544486 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.544277 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 01:03:13.544486 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.544342 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-657vv\"" May 25 01:03:13.544597 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:13.544505 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 01:03:14.754177 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:14.754137 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerStarted","Data":"1c4334d69f1ba147f62db8177651ab5a8d713b31e366e5a0a74de54cbf9b16d2"} May 25 01:03:15.476665 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:15.476628 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:15.476813 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:15.476685 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:15.476813 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:15.476770 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:15.476813 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:15.476784 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:15.476905 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:15.476833 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert podName:2a0f2312-f21f-44b0-9f83-32d57e6aa1fe nodeName:}" failed. No retries permitted until 2026-05-25 01:03:19.476816368 +0000 UTC m=+42.551876191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert") pod "ingress-canary-fzm75" (UID: "2a0f2312-f21f-44b0-9f83-32d57e6aa1fe") : secret "canary-serving-cert" not found May 25 01:03:15.476905 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:15.476847 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls podName:c4b945e3-319a-43c7-b993-89eb18d5e1e4 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:19.476840522 +0000 UTC m=+42.551900345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls") pod "dns-default-tbrtc" (UID: "c4b945e3-319a-43c7-b993-89eb18d5e1e4") : secret "dns-default-metrics-tls" not found May 25 01:03:15.758106 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:15.758050 2576 generic.go:358] "Generic (PLEG): container finished" podID="c4cacf21-ff59-4e12-8f9b-130673bfc29f" containerID="1c4334d69f1ba147f62db8177651ab5a8d713b31e366e5a0a74de54cbf9b16d2" exitCode=0 May 25 01:03:15.758499 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:15.758130 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerDied","Data":"1c4334d69f1ba147f62db8177651ab5a8d713b31e366e5a0a74de54cbf9b16d2"} May 25 01:03:16.762589 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:16.762553 2576 generic.go:358] "Generic (PLEG): container finished" podID="c4cacf21-ff59-4e12-8f9b-130673bfc29f" containerID="198e88a3b1a10c923520455c7c75a01678e84ac14890c778e51d9ebcec7152e5" exitCode=0 May 25 01:03:16.763059 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:16.762606 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerDied","Data":"198e88a3b1a10c923520455c7c75a01678e84ac14890c778e51d9ebcec7152e5"} May 25 01:03:17.770390 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:17.770359 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8f62" event={"ID":"c4cacf21-ff59-4e12-8f9b-130673bfc29f","Type":"ContainerStarted","Data":"0752b70fd7f13459ab391b9e84cb3074ae3c625971b436a02b1bb90bb37f6395"} May 25 01:03:17.795269 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:17.795203 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w8f62" podStartSLOduration=6.393260849 podStartE2EDuration="40.795190804s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:02:40.129873619 +0000 UTC m=+3.204933441" lastFinishedPulling="2026-05-25 01:03:14.531803573 +0000 UTC m=+37.606863396" observedRunningTime="2026-05-25 01:03:17.794658504 +0000 UTC m=+40.869718349" watchObservedRunningTime="2026-05-25 01:03:17.795190804 +0000 UTC m=+40.870250648" May 25 01:03:19.501596 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:19.501554 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:19.502015 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:19.501621 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:19.502015 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:19.501689 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:19.502015 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:19.501713 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:19.502015 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:19.501760 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert podName:2a0f2312-f21f-44b0-9f83-32d57e6aa1fe nodeName:}" failed. No retries permitted until 2026-05-25 01:03:27.501745328 +0000 UTC m=+50.576805151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert") pod "ingress-canary-fzm75" (UID: "2a0f2312-f21f-44b0-9f83-32d57e6aa1fe") : secret "canary-serving-cert" not found May 25 01:03:19.502015 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:19.501774 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls podName:c4b945e3-319a-43c7-b993-89eb18d5e1e4 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:27.501767994 +0000 UTC m=+50.576827817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls") pod "dns-default-tbrtc" (UID: "c4b945e3-319a-43c7-b993-89eb18d5e1e4") : secret "dns-default-metrics-tls" not found May 25 01:03:27.557594 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:27.557559 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:27.558054 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:27.557615 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:27.558054 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:27.557685 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:27.558054 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:27.557689 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:27.558054 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:27.557743 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls podName:c4b945e3-319a-43c7-b993-89eb18d5e1e4 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:43.557725805 +0000 UTC m=+66.632785628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls") pod "dns-default-tbrtc" (UID: "c4b945e3-319a-43c7-b993-89eb18d5e1e4") : secret "dns-default-metrics-tls" not found May 25 01:03:27.558054 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:27.557756 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert podName:2a0f2312-f21f-44b0-9f83-32d57e6aa1fe nodeName:}" failed. No retries permitted until 2026-05-25 01:03:43.557750336 +0000 UTC m=+66.632810158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert") pod "ingress-canary-fzm75" (UID: "2a0f2312-f21f-44b0-9f83-32d57e6aa1fe") : secret "canary-serving-cert" not found May 25 01:03:37.754415 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:37.754385 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5l7k" May 25 01:03:43.168867 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.168824 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:03:43.171768 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.171749 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 01:03:43.179168 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:43.179147 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 01:03:43.179271 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:43.179244 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs podName:3f49e520-69c0-4518-917d-9b40ce19c4ea nodeName:}" failed. No retries permitted until 2026-05-25 01:04:47.179196786 +0000 UTC m=+130.254256631 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs") pod "network-metrics-daemon-b4pxg" (UID: "3f49e520-69c0-4518-917d-9b40ce19c4ea") : secret "metrics-daemon-secret" not found May 25 01:03:43.269647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.269609 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:43.272655 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.272638 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 01:03:43.282497 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.282476 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 01:03:43.294768 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.294738 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzmg7\" (UniqueName: \"kubernetes.io/projected/4c1d0c44-3976-45a8-be1a-410e9225fc42-kube-api-access-lzmg7\") pod \"network-check-target-s4sqq\" (UID: \"4c1d0c44-3976-45a8-be1a-410e9225fc42\") " pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:43.560069 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.559977 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2dmfc\"" May 25 01:03:43.567294 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.567277 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:43.572101 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.572074 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:03:43.572244 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.572122 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:03:43.572310 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:43.572254 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:43.572310 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:43.572254 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:43.572416 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:43.572312 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls podName:c4b945e3-319a-43c7-b993-89eb18d5e1e4 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:15.572298791 +0000 UTC m=+98.647358614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls") pod "dns-default-tbrtc" (UID: "c4b945e3-319a-43c7-b993-89eb18d5e1e4") : secret "dns-default-metrics-tls" not found May 25 01:03:43.572416 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:03:43.572326 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert podName:2a0f2312-f21f-44b0-9f83-32d57e6aa1fe nodeName:}" failed. No retries permitted until 2026-05-25 01:04:15.572320506 +0000 UTC m=+98.647380330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert") pod "ingress-canary-fzm75" (UID: "2a0f2312-f21f-44b0-9f83-32d57e6aa1fe") : secret "canary-serving-cert" not found May 25 01:03:43.760429 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.760397 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s4sqq"] May 25 01:03:43.763774 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:03:43.763747 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1d0c44_3976_45a8_be1a_410e9225fc42.slice/crio-fb19cc78d1d2ab0bb4b77fe23a97e6b3808efc6b523484bb0ba5ef8f59c1eb9e WatchSource:0}: Error finding container fb19cc78d1d2ab0bb4b77fe23a97e6b3808efc6b523484bb0ba5ef8f59c1eb9e: Status 404 returned error can't find the container with id fb19cc78d1d2ab0bb4b77fe23a97e6b3808efc6b523484bb0ba5ef8f59c1eb9e May 25 01:03:43.818867 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:43.818797 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s4sqq" event={"ID":"4c1d0c44-3976-45a8-be1a-410e9225fc42","Type":"ContainerStarted","Data":"fb19cc78d1d2ab0bb4b77fe23a97e6b3808efc6b523484bb0ba5ef8f59c1eb9e"} May 25 01:03:46.825632 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:46.825593 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s4sqq" event={"ID":"4c1d0c44-3976-45a8-be1a-410e9225fc42","Type":"ContainerStarted","Data":"89300d21029c0ebace78e81766a254cc18aea26fcff55b0850d0edb3f7d5e8df"} May 25 01:03:46.826031 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:46.825719 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:03:46.842324 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:03:46.842269 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s4sqq" podStartSLOduration=66.992605589 podStartE2EDuration="1m9.84225267s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:03:43.765684682 +0000 UTC m=+66.840744510" lastFinishedPulling="2026-05-25 01:03:46.615331758 +0000 UTC m=+69.690391591" observedRunningTime="2026-05-25 01:03:46.842170482 +0000 UTC m=+69.917230327" watchObservedRunningTime="2026-05-25 01:03:46.84225267 +0000 UTC m=+69.917312516" May 25 01:04:15.587553 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:15.587450 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:04:15.587553 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:15.587516 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:04:15.587970 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:15.587597 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:04:15.587970 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:15.587604 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:04:15.587970 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:15.587647 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert podName:2a0f2312-f21f-44b0-9f83-32d57e6aa1fe nodeName:}" failed. No retries permitted until 2026-05-25 01:05:19.587631816 +0000 UTC m=+162.662691639 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert") pod "ingress-canary-fzm75" (UID: "2a0f2312-f21f-44b0-9f83-32d57e6aa1fe") : secret "canary-serving-cert" not found May 25 01:04:15.587970 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:15.587668 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls podName:c4b945e3-319a-43c7-b993-89eb18d5e1e4 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:19.58765301 +0000 UTC m=+162.662712836 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls") pod "dns-default-tbrtc" (UID: "c4b945e3-319a-43c7-b993-89eb18d5e1e4") : secret "dns-default-metrics-tls" not found May 25 01:04:17.830113 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:17.830084 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s4sqq" May 25 01:04:22.214670 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.214632 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62"] May 25 01:04:22.217606 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.217585 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.220532 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.220507 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 25 01:04:22.220633 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.220559 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 25 01:04:22.223126 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.223102 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lgxv8\"" May 25 01:04:22.223257 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.223183 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 25 01:04:22.223257 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.223107 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 25 01:04:22.228025 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.228002 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62"] May 25 01:04:22.232403 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.232344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.232403 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.232393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19db15d4-5a51-4c96-bc95-54ea1a403781-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.232557 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.232509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kspf\" (UniqueName: \"kubernetes.io/projected/19db15d4-5a51-4c96-bc95-54ea1a403781-kube-api-access-7kspf\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.325094 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.325054 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l"] May 25 01:04:22.327353 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.327322 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d"] May 25 01:04:22.327496 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.327475 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.329342 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.329325 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.330023 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.330003 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58855d54cc-8cnjj"] May 25 01:04:22.330099 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.330076 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hjbwm\"" May 25 01:04:22.330492 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.330475 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 25 01:04:22.330583 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.330526 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 25 01:04:22.330787 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.330773 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 25 01:04:22.331270 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.331251 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 25 01:04:22.331499 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.331478 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 25 01:04:22.332003 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.331983 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.332083 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.332038 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 25 01:04:22.332083 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.332047 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5bdvt\"" May 25 01:04:22.332477 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.332462 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 25 01:04:22.332727 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.332711 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.332764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.332741 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19db15d4-5a51-4c96-bc95-54ea1a403781-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.332817 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.332781 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kspf\" (UniqueName: \"kubernetes.io/projected/19db15d4-5a51-4c96-bc95-54ea1a403781-kube-api-access-7kspf\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.332854 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.332838 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 25 01:04:22.332899 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:22.332855 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 01:04:22.332933 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:22.332907 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls podName:19db15d4-5a51-4c96-bc95-54ea1a403781 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:22.832890336 +0000 UTC m=+105.907950160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vqs62" (UID: "19db15d4-5a51-4c96-bc95-54ea1a403781") : secret "cluster-monitoring-operator-tls" not found May 25 01:04:22.333678 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.333649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19db15d4-5a51-4c96-bc95-54ea1a403781-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.334451 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.334436 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jl9qq\"" May 25 01:04:22.334548 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.334523 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 25 01:04:22.334791 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.334776 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 25 01:04:22.334828 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.334776 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 25 01:04:22.340914 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.340891 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l"] May 25 01:04:22.346068 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.346046 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 25 01:04:22.346250 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.346233 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d"] May 25 01:04:22.353243 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.353189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kspf\" (UniqueName: \"kubernetes.io/projected/19db15d4-5a51-4c96-bc95-54ea1a403781-kube-api-access-7kspf\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.353367 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.353243 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58855d54cc-8cnjj"] May 25 01:04:22.434132 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-bound-sa-token\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.434304 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4691b477-b0e3-414f-a1df-201263a494f6-ca-trust-extracted\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.434304 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-config\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.434304 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-registry-certificates\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.434304 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ac23afe-892e-4a94-ac11-791cfdf7549a-config\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.434304 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffxxs\" (UniqueName: \"kubernetes.io/projected/3ac23afe-892e-4a94-ac11-791cfdf7549a-kube-api-access-ffxxs\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.434304 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-trusted-ca\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.434304 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-serving-cert\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.434304 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-image-registry-private-configuration\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.434553 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-installation-pull-secrets\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.434553 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjlph\" (UniqueName: \"kubernetes.io/projected/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-kube-api-access-cjlph\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.434553 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ac23afe-892e-4a94-ac11-791cfdf7549a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.434553 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.434553 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.434454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbjbt\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-kube-api-access-tbjbt\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.535772 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.535702 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbjbt\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-kube-api-access-tbjbt\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.535772 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.535743 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-bound-sa-token\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.535914 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.535790 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4691b477-b0e3-414f-a1df-201263a494f6-ca-trust-extracted\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.535914 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.535809 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-config\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.535914 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.535827 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-registry-certificates\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.535914 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.535853 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ac23afe-892e-4a94-ac11-791cfdf7549a-config\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.535914 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.535889 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffxxs\" (UniqueName: \"kubernetes.io/projected/3ac23afe-892e-4a94-ac11-791cfdf7549a-kube-api-access-ffxxs\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.535914 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.535913 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-trusted-ca\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.536255 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536201 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-serving-cert\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.536339 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536279 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-image-registry-private-configuration\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.536339 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536318 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-installation-pull-secrets\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.536431 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536372 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjlph\" (UniqueName: \"kubernetes.io/projected/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-kube-api-access-cjlph\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.536431 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536403 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ac23afe-892e-4a94-ac11-791cfdf7549a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.536431 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4691b477-b0e3-414f-a1df-201263a494f6-ca-trust-extracted\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.536574 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536434 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.536644 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ac23afe-892e-4a94-ac11-791cfdf7549a-config\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.536699 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-registry-certificates\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.536755 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:22.536728 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:04:22.536755 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:22.536745 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58855d54cc-8cnjj: secret "image-registry-tls" not found May 25 01:04:22.536864 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.536839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-config\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.536928 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:22.536852 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls podName:4691b477-b0e3-414f-a1df-201263a494f6 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:23.03683175 +0000 UTC m=+106.111891584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls") pod "image-registry-58855d54cc-8cnjj" (UID: "4691b477-b0e3-414f-a1df-201263a494f6") : secret "image-registry-tls" not found May 25 01:04:22.537795 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.537766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-trusted-ca\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.539008 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.538988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ac23afe-892e-4a94-ac11-791cfdf7549a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.539008 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.538997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-serving-cert\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.539165 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.539086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-image-registry-private-configuration\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.539245 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.539179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-installation-pull-secrets\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.547901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.547867 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-bound-sa-token\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.548021 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.548001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjlph\" (UniqueName: \"kubernetes.io/projected/e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8-kube-api-access-cjlph\") pod \"service-ca-operator-57b5b68b8-2px7l\" (UID: \"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.548531 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.548512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffxxs\" (UniqueName: \"kubernetes.io/projected/3ac23afe-892e-4a94-ac11-791cfdf7549a-kube-api-access-ffxxs\") pod \"kube-storage-version-migrator-operator-565644f49-kb87d\" (UID: \"3ac23afe-892e-4a94-ac11-791cfdf7549a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.548938 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.548917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbjbt\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-kube-api-access-tbjbt\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:22.639250 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.639227 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" May 25 01:04:22.647846 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.647824 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" May 25 01:04:22.769946 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.769918 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l"] May 25 01:04:22.773545 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:22.773506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4fcd704_3ca3_447a_abd6_f5c3bfdf3ab8.slice/crio-60e4155bf5b1f5ec9d71a4d7f33cc9793d64bfd4a5749725aa6d7d3dd63d9f12 WatchSource:0}: Error finding container 60e4155bf5b1f5ec9d71a4d7f33cc9793d64bfd4a5749725aa6d7d3dd63d9f12: Status 404 returned error can't find the container with id 60e4155bf5b1f5ec9d71a4d7f33cc9793d64bfd4a5749725aa6d7d3dd63d9f12 May 25 01:04:22.783244 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.783202 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d"] May 25 01:04:22.785569 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:22.785550 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac23afe_892e_4a94_ac11_791cfdf7549a.slice/crio-fbc9e3df72252762c1339fedb8762eee86a87233a75d23a5565340c9e062498d WatchSource:0}: Error finding container fbc9e3df72252762c1339fedb8762eee86a87233a75d23a5565340c9e062498d: Status 404 returned error can't find the container with id fbc9e3df72252762c1339fedb8762eee86a87233a75d23a5565340c9e062498d May 25 01:04:22.838729 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.838706 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:22.838861 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:22.838844 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 01:04:22.838924 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:22.838915 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls podName:19db15d4-5a51-4c96-bc95-54ea1a403781 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:23.838896172 +0000 UTC m=+106.913955999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vqs62" (UID: "19db15d4-5a51-4c96-bc95-54ea1a403781") : secret "cluster-monitoring-operator-tls" not found May 25 01:04:22.896082 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.896056 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" event={"ID":"3ac23afe-892e-4a94-ac11-791cfdf7549a","Type":"ContainerStarted","Data":"fbc9e3df72252762c1339fedb8762eee86a87233a75d23a5565340c9e062498d"} May 25 01:04:22.897081 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:22.897050 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" event={"ID":"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8","Type":"ContainerStarted","Data":"60e4155bf5b1f5ec9d71a4d7f33cc9793d64bfd4a5749725aa6d7d3dd63d9f12"} May 25 01:04:23.039520 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:23.039432 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:23.039661 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:23.039578 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:04:23.039661 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:23.039599 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58855d54cc-8cnjj: secret "image-registry-tls" not found May 25 01:04:23.039661 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:23.039654 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls podName:4691b477-b0e3-414f-a1df-201263a494f6 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:24.039637531 +0000 UTC m=+107.114697358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls") pod "image-registry-58855d54cc-8cnjj" (UID: "4691b477-b0e3-414f-a1df-201263a494f6") : secret "image-registry-tls" not found May 25 01:04:23.845303 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:23.845261 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:23.845689 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:23.845421 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 01:04:23.845689 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:23.845491 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls podName:19db15d4-5a51-4c96-bc95-54ea1a403781 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:25.845474097 +0000 UTC m=+108.920533922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vqs62" (UID: "19db15d4-5a51-4c96-bc95-54ea1a403781") : secret "cluster-monitoring-operator-tls" not found May 25 01:04:24.047391 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:24.047349 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:24.047563 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:24.047522 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:04:24.047563 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:24.047545 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58855d54cc-8cnjj: secret "image-registry-tls" not found May 25 01:04:24.047678 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:24.047616 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls podName:4691b477-b0e3-414f-a1df-201263a494f6 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:26.047593677 +0000 UTC m=+109.122653508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls") pod "image-registry-58855d54cc-8cnjj" (UID: "4691b477-b0e3-414f-a1df-201263a494f6") : secret "image-registry-tls" not found May 25 01:04:25.862838 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:25.862737 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:25.863343 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:25.862921 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 01:04:25.863343 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:25.863012 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls podName:19db15d4-5a51-4c96-bc95-54ea1a403781 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:29.862985901 +0000 UTC m=+112.938045739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vqs62" (UID: "19db15d4-5a51-4c96-bc95-54ea1a403781") : secret "cluster-monitoring-operator-tls" not found May 25 01:04:25.904863 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:25.904834 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" event={"ID":"3ac23afe-892e-4a94-ac11-791cfdf7549a","Type":"ContainerStarted","Data":"ae0b8ff5f95f6db3f7167b1810a6a73c1619f459494414d11f5216a2069826f0"} May 25 01:04:25.906266 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:25.906237 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" event={"ID":"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8","Type":"ContainerStarted","Data":"47018d28f06324bd15b5e6b288be62efcccf63bef4cf151e18752aa4fbd0a627"} May 25 01:04:25.927689 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:25.927643 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" podStartSLOduration=1.234249839 podStartE2EDuration="3.927631022s" podCreationTimestamp="2026-05-25 01:04:22 +0000 UTC" firstStartedPulling="2026-05-25 01:04:22.787283667 +0000 UTC m=+105.862343490" lastFinishedPulling="2026-05-25 01:04:25.48066485 +0000 UTC m=+108.555724673" observedRunningTime="2026-05-25 01:04:25.926995313 +0000 UTC m=+109.002055160" watchObservedRunningTime="2026-05-25 01:04:25.927631022 +0000 UTC m=+109.002690867" May 25 01:04:25.951128 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:25.951082 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" podStartSLOduration=1.247851267 podStartE2EDuration="3.951069541s" podCreationTimestamp="2026-05-25 01:04:22 +0000 UTC" firstStartedPulling="2026-05-25 01:04:22.775136309 +0000 UTC m=+105.850196136" lastFinishedPulling="2026-05-25 01:04:25.478354582 +0000 UTC m=+108.553414410" observedRunningTime="2026-05-25 01:04:25.950466658 +0000 UTC m=+109.025526504" watchObservedRunningTime="2026-05-25 01:04:25.951069541 +0000 UTC m=+109.026129388" May 25 01:04:26.065318 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:26.065278 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:26.065466 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:26.065390 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:04:26.065466 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:26.065401 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58855d54cc-8cnjj: secret "image-registry-tls" not found May 25 01:04:26.065466 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:26.065451 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls podName:4691b477-b0e3-414f-a1df-201263a494f6 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:30.065437701 +0000 UTC m=+113.140497524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls") pod "image-registry-58855d54cc-8cnjj" (UID: "4691b477-b0e3-414f-a1df-201263a494f6") : secret "image-registry-tls" not found May 25 01:04:28.081330 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:28.081302 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7mf9_ffe78edd-189b-4a93-90cc-5f2c97d9a6cd/dns-node-resolver/0.log" May 25 01:04:29.478461 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.478432 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqxcg_f3189d30-4fd7-4b96-8241-d79fdc007377/node-ca/0.log" May 25 01:04:29.893513 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.893484 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:29.893684 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:29.893599 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 01:04:29.893684 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:29.893658 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls podName:19db15d4-5a51-4c96-bc95-54ea1a403781 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:37.893641484 +0000 UTC m=+120.968701327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vqs62" (UID: "19db15d4-5a51-4c96-bc95-54ea1a403781") : secret "cluster-monitoring-operator-tls" not found May 25 01:04:29.918401 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.918369 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ft9bp"] May 25 01:04:29.922458 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.922441 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:29.925290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.925264 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 25 01:04:29.925397 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.925263 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 25 01:04:29.925397 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.925325 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dz7lc\"" May 25 01:04:29.926320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.926301 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 25 01:04:29.926376 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.926352 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 25 01:04:29.931181 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.931151 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ft9bp"] May 25 01:04:29.994029 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.994001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8s6\" (UniqueName: \"kubernetes.io/projected/352b30b6-482e-4ade-a905-0979129fbec9-kube-api-access-cc8s6\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:29.994029 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.994031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/352b30b6-482e-4ade-a905-0979129fbec9-signing-cabundle\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:29.994194 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:29.994070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/352b30b6-482e-4ade-a905-0979129fbec9-signing-key\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:30.095328 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.095288 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8s6\" (UniqueName: \"kubernetes.io/projected/352b30b6-482e-4ade-a905-0979129fbec9-kube-api-access-cc8s6\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:30.095328 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.095329 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/352b30b6-482e-4ade-a905-0979129fbec9-signing-cabundle\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:30.095557 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.095380 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/352b30b6-482e-4ade-a905-0979129fbec9-signing-key\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:30.095557 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.095419 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:30.095557 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:30.095517 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:04:30.095557 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:30.095530 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58855d54cc-8cnjj: secret "image-registry-tls" not found May 25 01:04:30.095737 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:30.095589 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls podName:4691b477-b0e3-414f-a1df-201263a494f6 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:38.095573009 +0000 UTC m=+121.170632837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls") pod "image-registry-58855d54cc-8cnjj" (UID: "4691b477-b0e3-414f-a1df-201263a494f6") : secret "image-registry-tls" not found May 25 01:04:30.096058 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.096036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/352b30b6-482e-4ade-a905-0979129fbec9-signing-cabundle\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:30.097975 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.097952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/352b30b6-482e-4ade-a905-0979129fbec9-signing-key\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:30.105281 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.105259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8s6\" (UniqueName: \"kubernetes.io/projected/352b30b6-482e-4ade-a905-0979129fbec9-kube-api-access-cc8s6\") pod \"service-ca-67d667c7d-ft9bp\" (UID: \"352b30b6-482e-4ade-a905-0979129fbec9\") " pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:30.234973 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.234888 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" May 25 01:04:30.361810 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.361777 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ft9bp"] May 25 01:04:30.365861 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:30.365831 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352b30b6_482e_4ade_a905_0979129fbec9.slice/crio-e661c78f0a84eda9c6cd14f7f30019ef916f93546b3405249d252483a9603ab9 WatchSource:0}: Error finding container e661c78f0a84eda9c6cd14f7f30019ef916f93546b3405249d252483a9603ab9: Status 404 returned error can't find the container with id e661c78f0a84eda9c6cd14f7f30019ef916f93546b3405249d252483a9603ab9 May 25 01:04:30.917581 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.917543 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" event={"ID":"352b30b6-482e-4ade-a905-0979129fbec9","Type":"ContainerStarted","Data":"06be83df9548a0c12b0a5ec330bc9984c37a577e8c25ee019c7e9612bd7a7490"} May 25 01:04:30.917581 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.917582 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" event={"ID":"352b30b6-482e-4ade-a905-0979129fbec9","Type":"ContainerStarted","Data":"e661c78f0a84eda9c6cd14f7f30019ef916f93546b3405249d252483a9603ab9"} May 25 01:04:30.941917 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:30.941869 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-ft9bp" podStartSLOduration=1.941854367 podStartE2EDuration="1.941854367s" podCreationTimestamp="2026-05-25 01:04:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:04:30.940320676 +0000 UTC m=+114.015380520" watchObservedRunningTime="2026-05-25 01:04:30.941854367 +0000 UTC m=+114.016914212" May 25 01:04:37.960459 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:37.960408 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:37.960811 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:37.960552 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 01:04:37.960811 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:04:37.960615 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls podName:19db15d4-5a51-4c96-bc95-54ea1a403781 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:53.960598995 +0000 UTC m=+137.035658818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vqs62" (UID: "19db15d4-5a51-4c96-bc95-54ea1a403781") : secret "cluster-monitoring-operator-tls" not found May 25 01:04:38.161761 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.161725 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:38.164250 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.164201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"image-registry-58855d54cc-8cnjj\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:38.256424 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.256344 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jl9qq\"" May 25 01:04:38.264577 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.264550 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:38.389314 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.389282 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58855d54cc-8cnjj"] May 25 01:04:38.393300 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:38.393270 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4691b477_b0e3_414f_a1df_201263a494f6.slice/crio-0f13fba94835048f1fabce170f36beefcf3c0df35f8159f80a6f0f41ca26a317 WatchSource:0}: Error finding container 0f13fba94835048f1fabce170f36beefcf3c0df35f8159f80a6f0f41ca26a317: Status 404 returned error can't find the container with id 0f13fba94835048f1fabce170f36beefcf3c0df35f8159f80a6f0f41ca26a317 May 25 01:04:38.937819 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.937785 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" event={"ID":"4691b477-b0e3-414f-a1df-201263a494f6","Type":"ContainerStarted","Data":"8689ae6e20fef48ea369e32dd2d23b3ef48999d99a2d5bc9009e24655801ddf8"} May 25 01:04:38.937819 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.937822 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" event={"ID":"4691b477-b0e3-414f-a1df-201263a494f6","Type":"ContainerStarted","Data":"0f13fba94835048f1fabce170f36beefcf3c0df35f8159f80a6f0f41ca26a317"} May 25 01:04:38.938065 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.937922 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:04:38.959460 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:38.959411 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" podStartSLOduration=16.959394265 podStartE2EDuration="16.959394265s" podCreationTimestamp="2026-05-25 01:04:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:04:38.95896857 +0000 UTC m=+122.034028416" watchObservedRunningTime="2026-05-25 01:04:38.959394265 +0000 UTC m=+122.034454113" May 25 01:04:47.236573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:47.236523 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:04:47.238972 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:47.238940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f49e520-69c0-4518-917d-9b40ce19c4ea-metrics-certs\") pod \"network-metrics-daemon-b4pxg\" (UID: \"3f49e520-69c0-4518-917d-9b40ce19c4ea\") " pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:04:47.454123 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:47.454093 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-657vv\"" May 25 01:04:47.462295 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:47.462268 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4pxg" May 25 01:04:47.589482 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:47.589448 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4pxg"] May 25 01:04:47.592634 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:47.592610 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f49e520_69c0_4518_917d_9b40ce19c4ea.slice/crio-8add306a9a61c905bad6b76b4c0f980746c6d4b3ddd77042ce70e6e7a90505aa WatchSource:0}: Error finding container 8add306a9a61c905bad6b76b4c0f980746c6d4b3ddd77042ce70e6e7a90505aa: Status 404 returned error can't find the container with id 8add306a9a61c905bad6b76b4c0f980746c6d4b3ddd77042ce70e6e7a90505aa May 25 01:04:47.955222 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:47.955172 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4pxg" event={"ID":"3f49e520-69c0-4518-917d-9b40ce19c4ea","Type":"ContainerStarted","Data":"8add306a9a61c905bad6b76b4c0f980746c6d4b3ddd77042ce70e6e7a90505aa"} May 25 01:04:48.959694 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:48.959604 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4pxg" event={"ID":"3f49e520-69c0-4518-917d-9b40ce19c4ea","Type":"ContainerStarted","Data":"01562d3c1208129bc3b37e9b1c81b0bea69d14de958bb4149b3d53ff15b905f4"} May 25 01:04:48.959694 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:48.959650 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4pxg" event={"ID":"3f49e520-69c0-4518-917d-9b40ce19c4ea","Type":"ContainerStarted","Data":"5949e24f9cf1e577b1c286a9310f46f5084a7618a3f8e0bf5ef62acd0b87c16d"} May 25 01:04:48.980444 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:48.980386 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b4pxg" podStartSLOduration=130.86846119 podStartE2EDuration="2m11.980372166s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:04:47.594959063 +0000 UTC m=+130.670018886" lastFinishedPulling="2026-05-25 01:04:48.706870024 +0000 UTC m=+131.781929862" observedRunningTime="2026-05-25 01:04:48.979555137 +0000 UTC m=+132.054614986" watchObservedRunningTime="2026-05-25 01:04:48.980372166 +0000 UTC m=+132.055432010" May 25 01:04:49.866888 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.866852 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ddk6t"] May 25 01:04:49.869914 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.869896 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:49.872683 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.872661 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 25 01:04:49.873651 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.873627 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sv4c5\"" May 25 01:04:49.873749 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.873681 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 25 01:04:49.873749 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.873720 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 25 01:04:49.873749 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.873742 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 25 01:04:49.883883 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.883863 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ddk6t"] May 25 01:04:49.889763 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.889743 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58855d54cc-8cnjj"] May 25 01:04:49.959960 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.959928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-data-volume\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:49.960453 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.959970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:49.960453 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.960030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:49.960453 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.960057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv78k\" (UniqueName: \"kubernetes.io/projected/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-kube-api-access-qv78k\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:49.960453 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.960188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-crio-socket\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:49.961485 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.961466 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b7f5bdb8b-x27lw"] May 25 01:04:49.964508 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.964490 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:49.979631 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:49.979606 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7f5bdb8b-x27lw"] May 25 01:04:50.061288 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-bound-sa-token\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.061288 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061291 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-crio-socket\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.061484 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hxcc\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-kube-api-access-5hxcc\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.061484 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-image-registry-private-configuration\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.061484 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-crio-socket\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.061484 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-registry-certificates\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.061484 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061481 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-data-volume\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.061676 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061505 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.061676 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061565 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.061676 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061589 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv78k\" (UniqueName: \"kubernetes.io/projected/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-kube-api-access-qv78k\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.061676 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-trusted-ca\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.061869 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-ca-trust-extracted\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.061869 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-data-volume\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.061869 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-installation-pull-secrets\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.062008 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.061903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-registry-tls\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.062061 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.062048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.064048 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.064026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.072025 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.072000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv78k\" (UniqueName: \"kubernetes.io/projected/48ff4b7e-8cf5-4ca0-9c00-006d04b81532-kube-api-access-qv78k\") pod \"insights-runtime-extractor-ddk6t\" (UID: \"48ff4b7e-8cf5-4ca0-9c00-006d04b81532\") " pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.162750 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.162713 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-bound-sa-token\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.162750 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.162754 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxcc\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-kube-api-access-5hxcc\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.163005 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.162783 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-image-registry-private-configuration\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.163005 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.162811 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-registry-certificates\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.163005 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.162898 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-trusted-ca\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.163005 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.162923 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-ca-trust-extracted\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.163005 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.162951 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-installation-pull-secrets\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.163005 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.162998 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-registry-tls\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.163477 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.163446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-ca-trust-extracted\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.164028 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.164005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-registry-certificates\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.164103 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.164080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-trusted-ca\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.165616 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.165582 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-image-registry-private-configuration\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.165616 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.165600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-registry-tls\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.165744 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.165626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-installation-pull-secrets\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.172674 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.172650 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-bound-sa-token\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.173153 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.173129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hxcc\" (UniqueName: \"kubernetes.io/projected/4226d4cf-0139-4ce3-8bec-5cb54a6f6e47-kube-api-access-5hxcc\") pod \"image-registry-b7f5bdb8b-x27lw\" (UID: \"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47\") " pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.179040 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.179026 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ddk6t" May 25 01:04:50.273048 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.273016 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.306507 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.306474 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ddk6t"] May 25 01:04:50.310390 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:50.309621 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ff4b7e_8cf5_4ca0_9c00_006d04b81532.slice/crio-82da913fc48e31fec9282045a99b7f3a6b01f98e384a5e60f7345b66555e6036 WatchSource:0}: Error finding container 82da913fc48e31fec9282045a99b7f3a6b01f98e384a5e60f7345b66555e6036: Status 404 returned error can't find the container with id 82da913fc48e31fec9282045a99b7f3a6b01f98e384a5e60f7345b66555e6036 May 25 01:04:50.405506 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.405471 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7f5bdb8b-x27lw"] May 25 01:04:50.408892 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:50.408863 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4226d4cf_0139_4ce3_8bec_5cb54a6f6e47.slice/crio-d669c1c0772b0897ea30e5315412b2a44a20438550beaa281d76aa8f482cb9d7 WatchSource:0}: Error finding container d669c1c0772b0897ea30e5315412b2a44a20438550beaa281d76aa8f482cb9d7: Status 404 returned error can't find the container with id d669c1c0772b0897ea30e5315412b2a44a20438550beaa281d76aa8f482cb9d7 May 25 01:04:50.967067 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.967029 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" event={"ID":"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47","Type":"ContainerStarted","Data":"5ae75c2d5929726bd7963af441e96693d14274e26a428d58dd3c17533b48307c"} May 25 01:04:50.967067 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.967074 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" event={"ID":"4226d4cf-0139-4ce3-8bec-5cb54a6f6e47","Type":"ContainerStarted","Data":"d669c1c0772b0897ea30e5315412b2a44a20438550beaa281d76aa8f482cb9d7"} May 25 01:04:50.967566 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.967170 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:04:50.968348 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.968327 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ddk6t" event={"ID":"48ff4b7e-8cf5-4ca0-9c00-006d04b81532","Type":"ContainerStarted","Data":"7baa3c37febc8b5f8a92eeff071729d8bb82ee52bc7150ef93c7a6d7f3d62435"} May 25 01:04:50.968348 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.968349 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ddk6t" event={"ID":"48ff4b7e-8cf5-4ca0-9c00-006d04b81532","Type":"ContainerStarted","Data":"82da913fc48e31fec9282045a99b7f3a6b01f98e384a5e60f7345b66555e6036"} May 25 01:04:50.991074 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:50.990927 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" podStartSLOduration=1.99090938 podStartE2EDuration="1.99090938s" podCreationTimestamp="2026-05-25 01:04:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:04:50.989389231 +0000 UTC m=+134.064449079" watchObservedRunningTime="2026-05-25 01:04:50.99090938 +0000 UTC m=+134.065969226" May 25 01:04:51.973265 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:51.973224 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ddk6t" event={"ID":"48ff4b7e-8cf5-4ca0-9c00-006d04b81532","Type":"ContainerStarted","Data":"da6d774c225561d01d79cd366363e1a3cb0280ab6690eb0786365d8a06c05345"} May 25 01:04:52.979679 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:52.979645 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ddk6t" event={"ID":"48ff4b7e-8cf5-4ca0-9c00-006d04b81532","Type":"ContainerStarted","Data":"5d920984b7287b38dde764ba090b0d4ebd23d6f0598c57722a6745d0fa515282"} May 25 01:04:53.001421 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:53.001359 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ddk6t" podStartSLOduration=2.188162413 podStartE2EDuration="4.001338807s" podCreationTimestamp="2026-05-25 01:04:49 +0000 UTC" firstStartedPulling="2026-05-25 01:04:50.383203954 +0000 UTC m=+133.458263778" lastFinishedPulling="2026-05-25 01:04:52.196380347 +0000 UTC m=+135.271440172" observedRunningTime="2026-05-25 01:04:52.999943645 +0000 UTC m=+136.075003490" watchObservedRunningTime="2026-05-25 01:04:53.001338807 +0000 UTC m=+136.076398653" May 25 01:04:53.992863 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:53.992831 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:53.995401 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:53.995382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19db15d4-5a51-4c96-bc95-54ea1a403781-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vqs62\" (UID: \"19db15d4-5a51-4c96-bc95-54ea1a403781\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:54.029464 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:54.029441 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lgxv8\"" May 25 01:04:54.036878 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:54.036861 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" May 25 01:04:54.183863 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:54.183831 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62"] May 25 01:04:54.187947 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:54.187907 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19db15d4_5a51_4c96_bc95_54ea1a403781.slice/crio-c92892f9eab90b5cb6b2352003b34b34c76f6428212653f94ad2c664ae95af77 WatchSource:0}: Error finding container c92892f9eab90b5cb6b2352003b34b34c76f6428212653f94ad2c664ae95af77: Status 404 returned error can't find the container with id c92892f9eab90b5cb6b2352003b34b34c76f6428212653f94ad2c664ae95af77 May 25 01:04:54.985984 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:54.985943 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" event={"ID":"19db15d4-5a51-4c96-bc95-54ea1a403781","Type":"ContainerStarted","Data":"c92892f9eab90b5cb6b2352003b34b34c76f6428212653f94ad2c664ae95af77"} May 25 01:04:55.994200 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:55.994158 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" event={"ID":"19db15d4-5a51-4c96-bc95-54ea1a403781","Type":"ContainerStarted","Data":"4d77b05515e6d53236a003817d42c6de82b1e1389e7793e8cff7cd2a08d1c7ba"} May 25 01:04:56.012411 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:56.012356 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vqs62" podStartSLOduration=32.591800326 podStartE2EDuration="34.012338235s" podCreationTimestamp="2026-05-25 01:04:22 +0000 UTC" firstStartedPulling="2026-05-25 01:04:54.189795915 +0000 UTC m=+137.264855745" lastFinishedPulling="2026-05-25 01:04:55.610333831 +0000 UTC m=+138.685393654" observedRunningTime="2026-05-25 01:04:56.012012606 +0000 UTC m=+139.087072453" watchObservedRunningTime="2026-05-25 01:04:56.012338235 +0000 UTC m=+139.087398085" May 25 01:04:59.205311 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.205270 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8"] May 25 01:04:59.210181 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.210158 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.213949 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.213929 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 25 01:04:59.214066 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.213951 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 25 01:04:59.214066 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.213929 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 25 01:04:59.214066 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.213929 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hqxwr\"" May 25 01:04:59.220723 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.220704 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8"] May 25 01:04:59.338994 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.338955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95c4n\" (UniqueName: \"kubernetes.io/projected/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-kube-api-access-95c4n\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.338994 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.338991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.339263 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.339010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.339263 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.339035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.440498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.440456 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95c4n\" (UniqueName: \"kubernetes.io/projected/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-kube-api-access-95c4n\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.440498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.440504 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.440764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.440523 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.440764 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.440548 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.441369 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.441347 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.443182 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.443154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.443276 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.443151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.449172 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.449154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95c4n\" (UniqueName: \"kubernetes.io/projected/a88a0f02-c9c5-474c-9f36-6dfc3b1a5629-kube-api-access-95c4n\") pod \"prometheus-operator-7779bbdd78-q5kz8\" (UID: \"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.519027 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.518965 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" May 25 01:04:59.652798 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.652759 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8"] May 25 01:04:59.655541 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:04:59.655517 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88a0f02_c9c5_474c_9f36_6dfc3b1a5629.slice/crio-194890da6376e6533d00485c805fad77073ea6ec1fa6fd6de887224da6526bde WatchSource:0}: Error finding container 194890da6376e6533d00485c805fad77073ea6ec1fa6fd6de887224da6526bde: Status 404 returned error can't find the container with id 194890da6376e6533d00485c805fad77073ea6ec1fa6fd6de887224da6526bde May 25 01:04:59.894609 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.894573 2576 patch_prober.go:28] interesting pod/image-registry-58855d54cc-8cnjj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 01:04:59.894779 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:04:59.894634 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" podUID="4691b477-b0e3-414f-a1df-201263a494f6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 01:05:00.007869 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:00.007831 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" event={"ID":"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629","Type":"ContainerStarted","Data":"194890da6376e6533d00485c805fad77073ea6ec1fa6fd6de887224da6526bde"} May 25 01:05:01.012358 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:01.012259 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" event={"ID":"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629","Type":"ContainerStarted","Data":"2aca10e9c341ab29530265bddb39546dd63e07fd5f876c09295c861d5f51a165"} May 25 01:05:01.012358 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:01.012304 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" event={"ID":"a88a0f02-c9c5-474c-9f36-6dfc3b1a5629","Type":"ContainerStarted","Data":"78f39c39742075485d88612848cba65ef33b3be71cbbb62c913920e541f7c0e5"} May 25 01:05:01.031896 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:01.031849 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q5kz8" podStartSLOduration=1.028345834 podStartE2EDuration="2.031834986s" podCreationTimestamp="2026-05-25 01:04:59 +0000 UTC" firstStartedPulling="2026-05-25 01:04:59.657392017 +0000 UTC m=+142.732451853" lastFinishedPulling="2026-05-25 01:05:00.660881181 +0000 UTC m=+143.735941005" observedRunningTime="2026-05-25 01:05:01.031204281 +0000 UTC m=+144.106264126" watchObservedRunningTime="2026-05-25 01:05:01.031834986 +0000 UTC m=+144.106894830" May 25 01:05:02.558130 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.558083 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mhgjh"] May 25 01:05:02.561610 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.561588 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.564394 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.564367 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 25 01:05:02.564512 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.564381 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 25 01:05:02.564690 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.564666 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 25 01:05:02.564796 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.564724 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-npnnj\"" May 25 01:05:02.669137 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.669338 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-sys\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.669338 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3880859a-fd88-4ef1-9e2e-579b84b426b6-metrics-client-ca\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.669338 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-wtmp\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.669338 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-textfile\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.669511 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-tls\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.669511 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6thhj\" (UniqueName: \"kubernetes.io/projected/3880859a-fd88-4ef1-9e2e-579b84b426b6-kube-api-access-6thhj\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.669511 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.669511 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.669446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-root\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.770712 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770675 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-root\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.770901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770742 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.770901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770777 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-sys\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.770901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-root\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.770901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770838 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3880859a-fd88-4ef1-9e2e-579b84b426b6-metrics-client-ca\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.770901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770876 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-sys\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.770901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770884 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-wtmp\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.771195 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770919 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-textfile\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.771195 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.770942 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-tls\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.771195 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.771021 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6thhj\" (UniqueName: \"kubernetes.io/projected/3880859a-fd88-4ef1-9e2e-579b84b426b6-kube-api-access-6thhj\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.771195 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.771056 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.771195 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.771090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-wtmp\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.771448 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.771427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-textfile\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.771705 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.771683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.771786 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.771771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3880859a-fd88-4ef1-9e2e-579b84b426b6-metrics-client-ca\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.773812 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.773794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.773901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.773885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3880859a-fd88-4ef1-9e2e-579b84b426b6-node-exporter-tls\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.782154 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.782126 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6thhj\" (UniqueName: \"kubernetes.io/projected/3880859a-fd88-4ef1-9e2e-579b84b426b6-kube-api-access-6thhj\") pod \"node-exporter-mhgjh\" (UID: \"3880859a-fd88-4ef1-9e2e-579b84b426b6\") " pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.872256 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:02.872226 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mhgjh" May 25 01:05:02.880104 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:05:02.880079 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3880859a_fd88_4ef1_9e2e_579b84b426b6.slice/crio-19d836b1e6eaf110def55cfedcc865ef83e5766cf7d68ea0f0bac78622227d02 WatchSource:0}: Error finding container 19d836b1e6eaf110def55cfedcc865ef83e5766cf7d68ea0f0bac78622227d02: Status 404 returned error can't find the container with id 19d836b1e6eaf110def55cfedcc865ef83e5766cf7d68ea0f0bac78622227d02 May 25 01:05:03.017812 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:03.017775 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhgjh" event={"ID":"3880859a-fd88-4ef1-9e2e-579b84b426b6","Type":"ContainerStarted","Data":"19d836b1e6eaf110def55cfedcc865ef83e5766cf7d68ea0f0bac78622227d02"} May 25 01:05:04.025480 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:04.025392 2576 generic.go:358] "Generic (PLEG): container finished" podID="3880859a-fd88-4ef1-9e2e-579b84b426b6" containerID="76208c9b6582f63bb4e1bd4cd6091e56c8ae14f071cb9c0cc0305f87803323e8" exitCode=0 May 25 01:05:04.025480 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:04.025438 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhgjh" event={"ID":"3880859a-fd88-4ef1-9e2e-579b84b426b6","Type":"ContainerDied","Data":"76208c9b6582f63bb4e1bd4cd6091e56c8ae14f071cb9c0cc0305f87803323e8"} May 25 01:05:05.029506 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.029472 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhgjh" event={"ID":"3880859a-fd88-4ef1-9e2e-579b84b426b6","Type":"ContainerStarted","Data":"e29303b0ac428759efc1a7c89a9cc4b3ae2860295786a6a23c184a4a72f4ab1f"} May 25 01:05:05.029506 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.029506 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhgjh" event={"ID":"3880859a-fd88-4ef1-9e2e-579b84b426b6","Type":"ContainerStarted","Data":"52f96307fad91b6a845b47a9456e8551ed4116ae2d663f1aea6b794ee4406d8f"} May 25 01:05:05.051809 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.051758 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mhgjh" podStartSLOduration=2.163712008 podStartE2EDuration="3.05174422s" podCreationTimestamp="2026-05-25 01:05:02 +0000 UTC" firstStartedPulling="2026-05-25 01:05:02.88192193 +0000 UTC m=+145.956981753" lastFinishedPulling="2026-05-25 01:05:03.769953941 +0000 UTC m=+146.845013965" observedRunningTime="2026-05-25 01:05:05.05049137 +0000 UTC m=+148.125551228" watchObservedRunningTime="2026-05-25 01:05:05.05174422 +0000 UTC m=+148.126804067" May 25 01:05:05.654581 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.654537 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g"] May 25 01:05:05.658340 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.658307 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.661589 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.661561 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 25 01:05:05.661726 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.661591 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 25 01:05:05.661726 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.661645 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5qs03opl152bq\"" May 25 01:05:05.661832 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.661824 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fjgmw\"" May 25 01:05:05.661881 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.661855 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 25 01:05:05.662762 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.662739 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 25 01:05:05.663086 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.663065 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 25 01:05:05.672777 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.672754 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g"] May 25 01:05:05.696546 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.696518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2135d6fe-9c7b-4560-9422-59c651c73272-metrics-client-ca\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.696637 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.696566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4lv\" (UniqueName: \"kubernetes.io/projected/2135d6fe-9c7b-4560-9422-59c651c73272-kube-api-access-7q4lv\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.696689 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.696642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.696722 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.696691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.696754 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.696721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-tls\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.696789 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.696757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.696828 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.696782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.696877 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.696834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-grpc-tls\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.797136 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.797095 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.797358 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.797150 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.797358 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.797182 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-tls\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.797358 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.797242 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.797358 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.797269 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.797529 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.797443 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-grpc-tls\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.797583 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.797559 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2135d6fe-9c7b-4560-9422-59c651c73272-metrics-client-ca\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.797639 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.797606 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4lv\" (UniqueName: \"kubernetes.io/projected/2135d6fe-9c7b-4560-9422-59c651c73272-kube-api-access-7q4lv\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.798653 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.798613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2135d6fe-9c7b-4560-9422-59c651c73272-metrics-client-ca\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.800143 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.800117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-tls\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.800374 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.800349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.800493 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.800398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.800552 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.800507 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.801188 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.801170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-grpc-tls\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.801280 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.801192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2135d6fe-9c7b-4560-9422-59c651c73272-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.806549 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.806523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4lv\" (UniqueName: \"kubernetes.io/projected/2135d6fe-9c7b-4560-9422-59c651c73272-kube-api-access-7q4lv\") pod \"thanos-querier-7c8b644b7c-hkj8g\" (UID: \"2135d6fe-9c7b-4560-9422-59c651c73272\") " pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:05.969271 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:05.969152 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:06.099033 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:06.098999 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g"] May 25 01:05:06.102325 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:05:06.102297 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2135d6fe_9c7b_4560_9422_59c651c73272.slice/crio-484e16279874f56b8c3a904283f5f3d34168e38251fbc47442122d059e27af6a WatchSource:0}: Error finding container 484e16279874f56b8c3a904283f5f3d34168e38251fbc47442122d059e27af6a: Status 404 returned error can't find the container with id 484e16279874f56b8c3a904283f5f3d34168e38251fbc47442122d059e27af6a May 25 01:05:07.038690 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.038629 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" event={"ID":"2135d6fe-9c7b-4560-9422-59c651c73272","Type":"ContainerStarted","Data":"484e16279874f56b8c3a904283f5f3d34168e38251fbc47442122d059e27af6a"} May 25 01:05:07.339520 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.339443 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp"] May 25 01:05:07.342963 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.342943 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" May 25 01:05:07.345555 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.345468 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 25 01:05:07.345829 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.345805 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-55zd7\"" May 25 01:05:07.354073 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.354043 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp"] May 25 01:05:07.408910 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.408818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b76f1987-8d4b-4d0b-a7f5-4911827a8149-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-z5xwp\" (UID: \"b76f1987-8d4b-4d0b-a7f5-4911827a8149\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" May 25 01:05:07.509896 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.509861 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b76f1987-8d4b-4d0b-a7f5-4911827a8149-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-z5xwp\" (UID: \"b76f1987-8d4b-4d0b-a7f5-4911827a8149\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" May 25 01:05:07.513027 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.512998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b76f1987-8d4b-4d0b-a7f5-4911827a8149-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-z5xwp\" (UID: \"b76f1987-8d4b-4d0b-a7f5-4911827a8149\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" May 25 01:05:07.656554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.656520 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" May 25 01:05:07.796314 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.796284 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68b6687d65-mf82h"] May 25 01:05:07.799523 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.799501 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.802946 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.802926 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 25 01:05:07.803227 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.803164 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 25 01:05:07.803227 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.803176 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 25 01:05:07.803227 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.803194 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 25 01:05:07.803479 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.803272 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 25 01:05:07.803479 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.803345 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rp4lb\"" May 25 01:05:07.809436 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.809416 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp"] May 25 01:05:07.809528 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.809444 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 25 01:05:07.812526 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.812488 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68b6687d65-mf82h"] May 25 01:05:07.813181 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.813156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-federate-client-tls\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.813347 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:05:07.813324 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76f1987_8d4b_4d0b_a7f5_4911827a8149.slice/crio-bb3875ff8673dcc0303437acf6740d0ec8e5abd2bb8c69f84280cfffcdbe0b10 WatchSource:0}: Error finding container bb3875ff8673dcc0303437acf6740d0ec8e5abd2bb8c69f84280cfffcdbe0b10: Status 404 returned error can't find the container with id bb3875ff8673dcc0303437acf6740d0ec8e5abd2bb8c69f84280cfffcdbe0b10 May 25 01:05:07.813484 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.813334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-serving-certs-ca-bundle\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.813484 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.813445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.813650 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.813497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjhhc\" (UniqueName: \"kubernetes.io/projected/8ce76847-c8e1-4170-9cd2-457fa5278c76-kube-api-access-rjhhc\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.813650 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.813539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-secret-telemeter-client\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.813650 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.813581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-metrics-client-ca\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.813650 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.813619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-telemeter-client-tls\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.813837 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.813650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.914057 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.913985 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-federate-client-tls\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.914057 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.914028 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-serving-certs-ca-bundle\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.914267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.914076 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.914267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.914118 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjhhc\" (UniqueName: \"kubernetes.io/projected/8ce76847-c8e1-4170-9cd2-457fa5278c76-kube-api-access-rjhhc\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.914267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.914156 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-secret-telemeter-client\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.914267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.914194 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-metrics-client-ca\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.914267 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.914262 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-telemeter-client-tls\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.914510 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.914294 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.915089 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.914963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-metrics-client-ca\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.915089 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.915033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-serving-certs-ca-bundle\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.915089 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.915133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce76847-c8e1-4170-9cd2-457fa5278c76-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.916900 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.916877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-secret-telemeter-client\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.917104 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.917079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-telemeter-client-tls\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.917248 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.917158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-federate-client-tls\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.917248 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.917179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce76847-c8e1-4170-9cd2-457fa5278c76-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:07.922122 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:07.922105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjhhc\" (UniqueName: \"kubernetes.io/projected/8ce76847-c8e1-4170-9cd2-457fa5278c76-kube-api-access-rjhhc\") pod \"telemeter-client-68b6687d65-mf82h\" (UID: \"8ce76847-c8e1-4170-9cd2-457fa5278c76\") " pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:08.043283 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.043250 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" event={"ID":"2135d6fe-9c7b-4560-9422-59c651c73272","Type":"ContainerStarted","Data":"a475015bf545689d359fe125c6eb49f02fdd62489b2ae443a67769094191c54c"} May 25 01:05:08.043283 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.043287 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" event={"ID":"2135d6fe-9c7b-4560-9422-59c651c73272","Type":"ContainerStarted","Data":"c79e05cee48b552f6171082823c5042f62224c014bb6a45b83c5e626ac4bc7af"} May 25 01:05:08.043464 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.043299 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" event={"ID":"2135d6fe-9c7b-4560-9422-59c651c73272","Type":"ContainerStarted","Data":"6dc9bcb673a77a3b16fec86b9291e1f44d153af3a84fcf872265ea73022aaba1"} May 25 01:05:08.044285 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.044261 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" event={"ID":"b76f1987-8d4b-4d0b-a7f5-4911827a8149","Type":"ContainerStarted","Data":"bb3875ff8673dcc0303437acf6740d0ec8e5abd2bb8c69f84280cfffcdbe0b10"} May 25 01:05:08.110531 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.110507 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" May 25 01:05:08.256571 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.256517 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68b6687d65-mf82h"] May 25 01:05:08.259690 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:05:08.259653 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce76847_c8e1_4170_9cd2_457fa5278c76.slice/crio-e4e7ce19e81ce5854c862adacb478e9182b2dccc37261bcc84eb61612ad65ac7 WatchSource:0}: Error finding container e4e7ce19e81ce5854c862adacb478e9182b2dccc37261bcc84eb61612ad65ac7: Status 404 returned error can't find the container with id e4e7ce19e81ce5854c862adacb478e9182b2dccc37261bcc84eb61612ad65ac7 May 25 01:05:08.822630 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.822593 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:05:08.829405 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.829378 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.833240 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.832287 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 01:05:08.833240 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.832463 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 01:05:08.833240 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.832573 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l5bq9\"" May 25 01:05:08.833240 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.832778 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 01:05:08.833240 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.832821 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 01:05:08.833240 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.833148 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 01:05:08.833724 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.833636 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 01:05:08.834181 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.833859 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 01:05:08.834181 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.833919 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 01:05:08.836573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.834470 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-coqroud9nr39g\"" May 25 01:05:08.837199 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.836975 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 01:05:08.837199 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.836996 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 01:05:08.837199 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.837030 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 01:05:08.837630 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.837573 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 01:05:08.846939 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.846862 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:05:08.850901 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.850654 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 01:05:08.922905 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.922865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923092 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.922935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923092 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923092 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5gpw\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-kube-api-access-w5gpw\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-config\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923664 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923664 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923664 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923664 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923664 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:08.923917 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:08.923685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025035 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025011 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025139 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025047 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025139 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025072 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025139 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025090 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025329 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025204 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025329 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025296 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025429 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025358 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025429 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025404 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025523 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025489 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025617 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025521 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025617 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025550 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025617 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025580 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5gpw\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-kube-api-access-w5gpw\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025771 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025617 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025771 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025653 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-config\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025771 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025675 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025771 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025696 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025771 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025726 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.025771 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025750 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.026059 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.025910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.026727 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.026701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.027128 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.027102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.028087 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.028058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.028849 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.028822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.029165 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.029137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.030131 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.030076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.030545 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.030521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.031647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.031619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.032382 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.032265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.032985 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.032578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.032985 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.032590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.032985 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.032809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.032985 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.032825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.033280 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.033264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.033323 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.033296 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-config\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.033900 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.033885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.039000 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.038957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5gpw\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-kube-api-access-w5gpw\") pod \"prometheus-k8s-0\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.050181 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.050148 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" event={"ID":"8ce76847-c8e1-4170-9cd2-457fa5278c76","Type":"ContainerStarted","Data":"e4e7ce19e81ce5854c862adacb478e9182b2dccc37261bcc84eb61612ad65ac7"} May 25 01:05:09.148244 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.148197 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:09.326524 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.325792 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:05:09.328601 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:05:09.328569 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e17dfaa_e70e_4344_81c0_741bdc321e76.slice/crio-cabe9c8093fbe40cf667c3e9a25367c9366088330c5495d00e2983eb4aa0aaf2 WatchSource:0}: Error finding container cabe9c8093fbe40cf667c3e9a25367c9366088330c5495d00e2983eb4aa0aaf2: Status 404 returned error can't find the container with id cabe9c8093fbe40cf667c3e9a25367c9366088330c5495d00e2983eb4aa0aaf2 May 25 01:05:09.894455 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.894421 2576 patch_prober.go:28] interesting pod/image-registry-58855d54cc-8cnjj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 01:05:09.894816 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:09.894484 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" podUID="4691b477-b0e3-414f-a1df-201263a494f6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 01:05:10.054296 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.054256 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerStarted","Data":"cabe9c8093fbe40cf667c3e9a25367c9366088330c5495d00e2983eb4aa0aaf2"} May 25 01:05:10.057693 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.057644 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" event={"ID":"2135d6fe-9c7b-4560-9422-59c651c73272","Type":"ContainerStarted","Data":"85d90febc7c289cb095dbf79005e2f4458e52b3718aff1e410118ecebb23bf54"} May 25 01:05:10.057693 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.057687 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" event={"ID":"2135d6fe-9c7b-4560-9422-59c651c73272","Type":"ContainerStarted","Data":"dc675aee7878a3770bc83112d10f09548d7b86062442e4d528c3506e2ea8a39e"} May 25 01:05:10.057886 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.057702 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" event={"ID":"2135d6fe-9c7b-4560-9422-59c651c73272","Type":"ContainerStarted","Data":"ba69be6e9c35ec4e77daf14463b08cd4cac5d9709050ed5e4b0809062ac6c39d"} May 25 01:05:10.058801 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.058778 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:10.060295 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.060265 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" event={"ID":"b76f1987-8d4b-4d0b-a7f5-4911827a8149","Type":"ContainerStarted","Data":"5ed47702cd93620e13e65f3c0512c7738766c0129b771b57032ac67307a8e4fa"} May 25 01:05:10.060742 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.060714 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" May 25 01:05:10.066063 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.066041 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" May 25 01:05:10.083097 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.081907 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" podStartSLOduration=2.193778274 podStartE2EDuration="5.081889834s" podCreationTimestamp="2026-05-25 01:05:05 +0000 UTC" firstStartedPulling="2026-05-25 01:05:06.104268941 +0000 UTC m=+149.179328764" lastFinishedPulling="2026-05-25 01:05:08.992380497 +0000 UTC m=+152.067440324" observedRunningTime="2026-05-25 01:05:10.080177192 +0000 UTC m=+153.155237040" watchObservedRunningTime="2026-05-25 01:05:10.081889834 +0000 UTC m=+153.156949680" May 25 01:05:10.096770 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.096715 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5xwp" podStartSLOduration=1.9179412999999998 podStartE2EDuration="3.096702595s" podCreationTimestamp="2026-05-25 01:05:07 +0000 UTC" firstStartedPulling="2026-05-25 01:05:07.816263046 +0000 UTC m=+150.891322871" lastFinishedPulling="2026-05-25 01:05:08.995024342 +0000 UTC m=+152.070084166" observedRunningTime="2026-05-25 01:05:10.096559142 +0000 UTC m=+153.171618988" watchObservedRunningTime="2026-05-25 01:05:10.096702595 +0000 UTC m=+153.171762439" May 25 01:05:10.277546 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.277506 2576 patch_prober.go:28] interesting pod/image-registry-b7f5bdb8b-x27lw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 01:05:10.277745 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:10.277568 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" podUID="4226d4cf-0139-4ce3-8bec-5cb54a6f6e47" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 01:05:11.065134 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:11.065037 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" event={"ID":"8ce76847-c8e1-4170-9cd2-457fa5278c76","Type":"ContainerStarted","Data":"da8f34e3304cf9b112b4184910ca89021fc2a53a0543072f4d7e23f95e15fc96"} May 25 01:05:11.065134 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:11.065085 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" event={"ID":"8ce76847-c8e1-4170-9cd2-457fa5278c76","Type":"ContainerStarted","Data":"7e0f2d7d0876d1061ceae02704d1a30d0a8827636eb8ddaf54cdcbe07e7f923e"} May 25 01:05:11.065134 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:11.065095 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" event={"ID":"8ce76847-c8e1-4170-9cd2-457fa5278c76","Type":"ContainerStarted","Data":"384c1304f6c85bd9d4aa7c48897c9235bb7ab1e5118f775ef39f7d111f5ce310"} May 25 01:05:11.066458 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:11.066436 2576 generic.go:358] "Generic (PLEG): container finished" podID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerID="258fba0560f7490b0c29aa5f0f2c2657440b941e9c542fecc7e11ae24b0d25f6" exitCode=0 May 25 01:05:11.066550 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:11.066528 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerDied","Data":"258fba0560f7490b0c29aa5f0f2c2657440b941e9c542fecc7e11ae24b0d25f6"} May 25 01:05:11.087592 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:11.087550 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68b6687d65-mf82h" podStartSLOduration=1.541558839 podStartE2EDuration="4.087534428s" podCreationTimestamp="2026-05-25 01:05:07 +0000 UTC" firstStartedPulling="2026-05-25 01:05:08.261824235 +0000 UTC m=+151.336884065" lastFinishedPulling="2026-05-25 01:05:10.807799831 +0000 UTC m=+153.882859654" observedRunningTime="2026-05-25 01:05:11.086669339 +0000 UTC m=+154.161729184" watchObservedRunningTime="2026-05-25 01:05:11.087534428 +0000 UTC m=+154.162594277" May 25 01:05:11.977690 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:11.977648 2576 patch_prober.go:28] interesting pod/image-registry-b7f5bdb8b-x27lw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 01:05:11.977881 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:11.977724 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" podUID="4226d4cf-0139-4ce3-8bec-5cb54a6f6e47" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 01:05:12.078731 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:12.078523 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c8b644b7c-hkj8g" May 25 01:05:14.789925 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:05:14.789878 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tbrtc" podUID="c4b945e3-319a-43c7-b993-89eb18d5e1e4" May 25 01:05:14.798022 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:05:14.797993 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fzm75" podUID="2a0f2312-f21f-44b0-9f83-32d57e6aa1fe" May 25 01:05:14.909288 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:14.909246 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" podUID="4691b477-b0e3-414f-a1df-201263a494f6" containerName="registry" containerID="cri-o://8689ae6e20fef48ea369e32dd2d23b3ef48999d99a2d5bc9009e24655801ddf8" gracePeriod=30 May 25 01:05:15.087192 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.087158 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerStarted","Data":"0d88c32abce9976416ab6df7acb37cf816e3592bcd80e392375347a1a833a43a"} May 25 01:05:15.087337 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.087203 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerStarted","Data":"170b66da4250bb3e7b1a750d6d6ac96c1418fd45edbc310b41ecfb294de502cc"} May 25 01:05:15.087337 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.087241 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerStarted","Data":"a24dc826afb634f7e87446cc894cf87128b31a9684a548de56bb11d1a0464be8"} May 25 01:05:15.087337 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.087254 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerStarted","Data":"28c89c61050a59a21fe3aef731c8bd9bfc432c346e62add24b7b725fdeff31d6"} May 25 01:05:15.087337 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.087265 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerStarted","Data":"44cf5281a678b436268dc890a97540125481d5565ecdd78e34c33191024beaa7"} May 25 01:05:15.087337 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.087277 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerStarted","Data":"ac186dd152cd1ca3bfa0917138621664a29e001de9248fb160dceeaeb3355596"} May 25 01:05:15.088588 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.088563 2576 generic.go:358] "Generic (PLEG): container finished" podID="4691b477-b0e3-414f-a1df-201263a494f6" containerID="8689ae6e20fef48ea369e32dd2d23b3ef48999d99a2d5bc9009e24655801ddf8" exitCode=0 May 25 01:05:15.088686 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.088638 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" event={"ID":"4691b477-b0e3-414f-a1df-201263a494f6","Type":"ContainerDied","Data":"8689ae6e20fef48ea369e32dd2d23b3ef48999d99a2d5bc9009e24655801ddf8"} May 25 01:05:15.088686 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.088661 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:05:15.088758 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.088683 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tbrtc" May 25 01:05:15.117815 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.117763 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.401456962 podStartE2EDuration="7.117748499s" podCreationTimestamp="2026-05-25 01:05:08 +0000 UTC" firstStartedPulling="2026-05-25 01:05:09.330874227 +0000 UTC m=+152.405934053" lastFinishedPulling="2026-05-25 01:05:14.047165764 +0000 UTC m=+157.122225590" observedRunningTime="2026-05-25 01:05:15.116363224 +0000 UTC m=+158.191423069" watchObservedRunningTime="2026-05-25 01:05:15.117748499 +0000 UTC m=+158.192808344" May 25 01:05:15.151740 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.151722 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:05:15.184828 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.184805 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbjbt\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-kube-api-access-tbjbt\") pod \"4691b477-b0e3-414f-a1df-201263a494f6\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " May 25 01:05:15.184967 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.184858 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") pod \"4691b477-b0e3-414f-a1df-201263a494f6\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " May 25 01:05:15.184967 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.184889 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-registry-certificates\") pod \"4691b477-b0e3-414f-a1df-201263a494f6\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " May 25 01:05:15.184967 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.184931 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-trusted-ca\") pod \"4691b477-b0e3-414f-a1df-201263a494f6\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " May 25 01:05:15.185118 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.184968 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-image-registry-private-configuration\") pod \"4691b477-b0e3-414f-a1df-201263a494f6\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " May 25 01:05:15.185118 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.185096 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-installation-pull-secrets\") pod \"4691b477-b0e3-414f-a1df-201263a494f6\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " May 25 01:05:15.185231 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.185156 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4691b477-b0e3-414f-a1df-201263a494f6-ca-trust-extracted\") pod \"4691b477-b0e3-414f-a1df-201263a494f6\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " May 25 01:05:15.185290 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.185245 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-bound-sa-token\") pod \"4691b477-b0e3-414f-a1df-201263a494f6\" (UID: \"4691b477-b0e3-414f-a1df-201263a494f6\") " May 25 01:05:15.185414 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.185390 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4691b477-b0e3-414f-a1df-201263a494f6" (UID: "4691b477-b0e3-414f-a1df-201263a494f6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:05:15.185604 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.185487 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4691b477-b0e3-414f-a1df-201263a494f6" (UID: "4691b477-b0e3-414f-a1df-201263a494f6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:05:15.187568 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.185914 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-registry-certificates\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:05:15.187568 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.185939 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4691b477-b0e3-414f-a1df-201263a494f6-trusted-ca\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:05:15.188168 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.187803 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4691b477-b0e3-414f-a1df-201263a494f6" (UID: "4691b477-b0e3-414f-a1df-201263a494f6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 01:05:15.188168 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.187801 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-kube-api-access-tbjbt" (OuterVolumeSpecName: "kube-api-access-tbjbt") pod "4691b477-b0e3-414f-a1df-201263a494f6" (UID: "4691b477-b0e3-414f-a1df-201263a494f6"). InnerVolumeSpecName "kube-api-access-tbjbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 01:05:15.188561 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.188536 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4691b477-b0e3-414f-a1df-201263a494f6" (UID: "4691b477-b0e3-414f-a1df-201263a494f6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:05:15.188802 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.188782 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4691b477-b0e3-414f-a1df-201263a494f6" (UID: "4691b477-b0e3-414f-a1df-201263a494f6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:05:15.188877 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.188839 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4691b477-b0e3-414f-a1df-201263a494f6" (UID: "4691b477-b0e3-414f-a1df-201263a494f6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 01:05:15.194998 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.194975 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4691b477-b0e3-414f-a1df-201263a494f6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4691b477-b0e3-414f-a1df-201263a494f6" (UID: "4691b477-b0e3-414f-a1df-201263a494f6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 01:05:15.286473 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.286436 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4691b477-b0e3-414f-a1df-201263a494f6-ca-trust-extracted\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:05:15.286473 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.286472 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-bound-sa-token\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:05:15.286473 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.286481 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbjbt\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-kube-api-access-tbjbt\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:05:15.286624 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.286491 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4691b477-b0e3-414f-a1df-201263a494f6-registry-tls\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:05:15.286624 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.286500 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-image-registry-private-configuration\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:05:15.286624 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:15.286511 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4691b477-b0e3-414f-a1df-201263a494f6-installation-pull-secrets\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:05:16.097729 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:16.097682 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" event={"ID":"4691b477-b0e3-414f-a1df-201263a494f6","Type":"ContainerDied","Data":"0f13fba94835048f1fabce170f36beefcf3c0df35f8159f80a6f0f41ca26a317"} May 25 01:05:16.098169 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:16.097739 2576 scope.go:117] "RemoveContainer" containerID="8689ae6e20fef48ea369e32dd2d23b3ef48999d99a2d5bc9009e24655801ddf8" May 25 01:05:16.098169 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:16.097737 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58855d54cc-8cnjj" May 25 01:05:16.118491 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:16.118464 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58855d54cc-8cnjj"] May 25 01:05:16.122735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:16.122710 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58855d54cc-8cnjj"] May 25 01:05:17.540972 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:17.540937 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4691b477-b0e3-414f-a1df-201263a494f6" path="/var/lib/kubelet/pods/4691b477-b0e3-414f-a1df-201263a494f6/volumes" May 25 01:05:19.149171 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.149137 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:05:19.623121 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.623085 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:05:19.623320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.623135 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:05:19.625617 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.625586 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4b945e3-319a-43c7-b993-89eb18d5e1e4-metrics-tls\") pod \"dns-default-tbrtc\" (UID: \"c4b945e3-319a-43c7-b993-89eb18d5e1e4\") " pod="openshift-dns/dns-default-tbrtc" May 25 01:05:19.625808 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.625787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f2312-f21f-44b0-9f83-32d57e6aa1fe-cert\") pod \"ingress-canary-fzm75\" (UID: \"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe\") " pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:05:19.892955 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.892874 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bftwk\"" May 25 01:05:19.893356 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.893337 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rtn5\"" May 25 01:05:19.900252 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.900232 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fzm75" May 25 01:05:19.900316 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:19.900282 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tbrtc" May 25 01:05:20.058431 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:20.058394 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fzm75"] May 25 01:05:20.062493 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:05:20.062464 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0f2312_f21f_44b0_9f83_32d57e6aa1fe.slice/crio-afc5ac9c47160198b43a064db6b8fd2959fb03214240327ea1ca894964f00c4f WatchSource:0}: Error finding container afc5ac9c47160198b43a064db6b8fd2959fb03214240327ea1ca894964f00c4f: Status 404 returned error can't find the container with id afc5ac9c47160198b43a064db6b8fd2959fb03214240327ea1ca894964f00c4f May 25 01:05:20.077928 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:20.077907 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tbrtc"] May 25 01:05:20.080189 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:05:20.080166 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b945e3_319a_43c7_b993_89eb18d5e1e4.slice/crio-b41ed606bd7ed450f5b3838170efcf7d08f66efd29074d593c84a4e01579759a WatchSource:0}: Error finding container b41ed606bd7ed450f5b3838170efcf7d08f66efd29074d593c84a4e01579759a: Status 404 returned error can't find the container with id b41ed606bd7ed450f5b3838170efcf7d08f66efd29074d593c84a4e01579759a May 25 01:05:20.110175 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:20.110142 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fzm75" event={"ID":"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe","Type":"ContainerStarted","Data":"afc5ac9c47160198b43a064db6b8fd2959fb03214240327ea1ca894964f00c4f"} May 25 01:05:20.111051 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:20.111032 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tbrtc" event={"ID":"c4b945e3-319a-43c7-b993-89eb18d5e1e4","Type":"ContainerStarted","Data":"b41ed606bd7ed450f5b3838170efcf7d08f66efd29074d593c84a4e01579759a"} May 25 01:05:20.277555 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:20.277469 2576 patch_prober.go:28] interesting pod/image-registry-b7f5bdb8b-x27lw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 01:05:20.277555 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:20.277522 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" podUID="4226d4cf-0139-4ce3-8bec-5cb54a6f6e47" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 01:05:21.977860 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:21.977834 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b7f5bdb8b-x27lw" May 25 01:05:22.119745 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:22.119701 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fzm75" event={"ID":"2a0f2312-f21f-44b0-9f83-32d57e6aa1fe","Type":"ContainerStarted","Data":"4deef0a4f67fbd44ddaae08ea1b70cd0939a8987d14ecb3048a5b1ac5ca4deca"} May 25 01:05:22.121470 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:22.121443 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tbrtc" event={"ID":"c4b945e3-319a-43c7-b993-89eb18d5e1e4","Type":"ContainerStarted","Data":"4a1042902567ec97ccf7b2d53a10fa5ce133672e623ab879a43d2df18ef5d56b"} May 25 01:05:22.121587 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:22.121474 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tbrtc" event={"ID":"c4b945e3-319a-43c7-b993-89eb18d5e1e4","Type":"ContainerStarted","Data":"337bc6921577bb7593d9630c99b443f5a452755057ccff5d7c21177e8a0e10ba"} May 25 01:05:22.121587 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:22.121579 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tbrtc" May 25 01:05:22.142878 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:22.142834 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fzm75" podStartSLOduration=129.28919269 podStartE2EDuration="2m11.142820911s" podCreationTimestamp="2026-05-25 01:03:11 +0000 UTC" firstStartedPulling="2026-05-25 01:05:20.064420794 +0000 UTC m=+163.139480621" lastFinishedPulling="2026-05-25 01:05:21.918049016 +0000 UTC m=+164.993108842" observedRunningTime="2026-05-25 01:05:22.142632102 +0000 UTC m=+165.217691946" watchObservedRunningTime="2026-05-25 01:05:22.142820911 +0000 UTC m=+165.217880757" May 25 01:05:22.167992 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:22.167880 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-tbrtc" podStartSLOduration=129.3354575 podStartE2EDuration="2m11.167862904s" podCreationTimestamp="2026-05-25 01:03:11 +0000 UTC" firstStartedPulling="2026-05-25 01:05:20.081880741 +0000 UTC m=+163.156940567" lastFinishedPulling="2026-05-25 01:05:21.914286145 +0000 UTC m=+164.989345971" observedRunningTime="2026-05-25 01:05:22.166894411 +0000 UTC m=+165.241954257" watchObservedRunningTime="2026-05-25 01:05:22.167862904 +0000 UTC m=+165.242922750" May 25 01:05:32.126576 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:32.126496 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tbrtc" May 25 01:05:37.168660 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:37.168622 2576 generic.go:358] "Generic (PLEG): container finished" podID="e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8" containerID="47018d28f06324bd15b5e6b288be62efcccf63bef4cf151e18752aa4fbd0a627" exitCode=0 May 25 01:05:37.169028 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:37.168704 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" event={"ID":"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8","Type":"ContainerDied","Data":"47018d28f06324bd15b5e6b288be62efcccf63bef4cf151e18752aa4fbd0a627"} May 25 01:05:37.169067 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:37.169050 2576 scope.go:117] "RemoveContainer" containerID="47018d28f06324bd15b5e6b288be62efcccf63bef4cf151e18752aa4fbd0a627" May 25 01:05:37.973374 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:37.973342 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tbrtc_c4b945e3-319a-43c7-b993-89eb18d5e1e4/dns/0.log" May 25 01:05:37.980017 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:37.979991 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tbrtc_c4b945e3-319a-43c7-b993-89eb18d5e1e4/kube-rbac-proxy/0.log" May 25 01:05:38.059308 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:38.059278 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7mf9_ffe78edd-189b-4a93-90cc-5f2c97d9a6cd/dns-node-resolver/0.log" May 25 01:05:38.172462 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:38.172431 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2px7l" event={"ID":"e4fcd704-3ca3-447a-abd6-f5c3bfdf3ab8","Type":"ContainerStarted","Data":"75a652bb125ef6334f6911d48c5185021357ce09ed31c58e387ce8170843123d"} May 25 01:05:46.197114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:46.197078 2576 generic.go:358] "Generic (PLEG): container finished" podID="3ac23afe-892e-4a94-ac11-791cfdf7549a" containerID="ae0b8ff5f95f6db3f7167b1810a6a73c1619f459494414d11f5216a2069826f0" exitCode=0 May 25 01:05:46.197566 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:46.197130 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" event={"ID":"3ac23afe-892e-4a94-ac11-791cfdf7549a","Type":"ContainerDied","Data":"ae0b8ff5f95f6db3f7167b1810a6a73c1619f459494414d11f5216a2069826f0"} May 25 01:05:46.197566 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:46.197422 2576 scope.go:117] "RemoveContainer" containerID="ae0b8ff5f95f6db3f7167b1810a6a73c1619f459494414d11f5216a2069826f0" May 25 01:05:47.202029 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:05:47.201989 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kb87d" event={"ID":"3ac23afe-892e-4a94-ac11-791cfdf7549a","Type":"ContainerStarted","Data":"3b22d29e8e8482903e8549b16935d9c362e17bfba353e4c850d39a5b28850680"} May 25 01:06:09.149177 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:09.149140 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:09.169686 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:09.169660 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:09.288928 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:09.288901 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:27.156017 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.155979 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:06:27.156601 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.156569 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0d88c32abce9976416ab6df7acb37cf816e3592bcd80e392375347a1a833a43a" gracePeriod=600 May 25 01:06:27.158068 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.158016 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="prometheus" containerID="cri-o://ac186dd152cd1ca3bfa0917138621664a29e001de9248fb160dceeaeb3355596" gracePeriod=600 May 25 01:06:27.158275 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.158077 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy-web" containerID="cri-o://a24dc826afb634f7e87446cc894cf87128b31a9684a548de56bb11d1a0464be8" gracePeriod=600 May 25 01:06:27.158403 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.158086 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="thanos-sidecar" containerID="cri-o://28c89c61050a59a21fe3aef731c8bd9bfc432c346e62add24b7b725fdeff31d6" gracePeriod=600 May 25 01:06:27.158472 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.158083 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy" containerID="cri-o://170b66da4250bb3e7b1a750d6d6ac96c1418fd45edbc310b41ecfb294de502cc" gracePeriod=600 May 25 01:06:27.158472 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.158137 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="config-reloader" containerID="cri-o://44cf5281a678b436268dc890a97540125481d5565ecdd78e34c33191024beaa7" gracePeriod=600 May 25 01:06:27.323071 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323033 2576 generic.go:358] "Generic (PLEG): container finished" podID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerID="0d88c32abce9976416ab6df7acb37cf816e3592bcd80e392375347a1a833a43a" exitCode=0 May 25 01:06:27.323071 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323059 2576 generic.go:358] "Generic (PLEG): container finished" podID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerID="170b66da4250bb3e7b1a750d6d6ac96c1418fd45edbc310b41ecfb294de502cc" exitCode=0 May 25 01:06:27.323071 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323065 2576 generic.go:358] "Generic (PLEG): container finished" podID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerID="a24dc826afb634f7e87446cc894cf87128b31a9684a548de56bb11d1a0464be8" exitCode=0 May 25 01:06:27.323071 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323071 2576 generic.go:358] "Generic (PLEG): container finished" podID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerID="28c89c61050a59a21fe3aef731c8bd9bfc432c346e62add24b7b725fdeff31d6" exitCode=0 May 25 01:06:27.323071 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323075 2576 generic.go:358] "Generic (PLEG): container finished" podID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerID="44cf5281a678b436268dc890a97540125481d5565ecdd78e34c33191024beaa7" exitCode=0 May 25 01:06:27.323071 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323081 2576 generic.go:358] "Generic (PLEG): container finished" podID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerID="ac186dd152cd1ca3bfa0917138621664a29e001de9248fb160dceeaeb3355596" exitCode=0 May 25 01:06:27.323559 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323099 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerDied","Data":"0d88c32abce9976416ab6df7acb37cf816e3592bcd80e392375347a1a833a43a"} May 25 01:06:27.323559 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323132 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerDied","Data":"170b66da4250bb3e7b1a750d6d6ac96c1418fd45edbc310b41ecfb294de502cc"} May 25 01:06:27.323559 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323144 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerDied","Data":"a24dc826afb634f7e87446cc894cf87128b31a9684a548de56bb11d1a0464be8"} May 25 01:06:27.323559 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323157 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerDied","Data":"28c89c61050a59a21fe3aef731c8bd9bfc432c346e62add24b7b725fdeff31d6"} May 25 01:06:27.323559 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323165 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerDied","Data":"44cf5281a678b436268dc890a97540125481d5565ecdd78e34c33191024beaa7"} May 25 01:06:27.323559 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.323173 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerDied","Data":"ac186dd152cd1ca3bfa0917138621664a29e001de9248fb160dceeaeb3355596"} May 25 01:06:27.404512 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.404488 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:27.504039 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.503946 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-db\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504039 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.503994 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-metrics-client-ca\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504039 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504025 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504344 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504049 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-thanos-prometheus-http-client-file\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504344 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504074 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-metrics-client-certs\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504344 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504099 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-grpc-tls\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504344 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504126 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-rulefiles-0\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504344 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504166 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-config\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504344 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504191 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-kube-rbac-proxy\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504344 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504249 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-tls\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504344 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504286 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-web-config\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504349 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-serving-certs-ca-bundle\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504374 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-tls-assets\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504397 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:06:27.504735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504414 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5gpw\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-kube-api-access-w5gpw\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504490 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-kubelet-serving-ca-bundle\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504533 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504564 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-config-out\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.504735 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504598 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-trusted-ca-bundle\") pod \"7e17dfaa-e70e-4344-81c0-741bdc321e76\" (UID: \"7e17dfaa-e70e-4344-81c0-741bdc321e76\") " May 25 01:06:27.505335 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.504866 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-metrics-client-ca\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.505393 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.505361 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:06:27.506200 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.505931 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:06:27.506338 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.506296 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:06:27.507830 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.507795 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 01:06:27.508795 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.508769 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.508898 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.508763 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:06:27.508898 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.508833 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.508898 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.508834 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-kube-api-access-w5gpw" (OuterVolumeSpecName: "kube-api-access-w5gpw") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "kube-api-access-w5gpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 01:06:27.508898 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.508897 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.509315 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.509142 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 01:06:27.509524 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.509500 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.509617 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.509586 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.509617 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.509598 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.509864 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.509847 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.510624 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.510600 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-config" (OuterVolumeSpecName: "config") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.510787 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.510765 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-config-out" (OuterVolumeSpecName: "config-out") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 01:06:27.523141 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.523114 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-web-config" (OuterVolumeSpecName: "web-config") pod "7e17dfaa-e70e-4344-81c0-741bdc321e76" (UID: "7e17dfaa-e70e-4344-81c0-741bdc321e76"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:06:27.605634 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605599 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-config-out\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605634 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605627 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605634 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605639 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-db\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605650 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605660 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605669 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-metrics-client-certs\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605678 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-grpc-tls\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605686 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605695 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-config\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605703 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-kube-rbac-proxy\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605712 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605720 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-web-config\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605728 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605737 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-tls-assets\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605745 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5gpw\" (UniqueName: \"kubernetes.io/projected/7e17dfaa-e70e-4344-81c0-741bdc321e76-kube-api-access-w5gpw\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605753 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e17dfaa-e70e-4344-81c0-741bdc321e76-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:27.605887 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:27.605763 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e17dfaa-e70e-4344-81c0-741bdc321e76-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-11.ec2.internal\" DevicePath \"\"" May 25 01:06:28.328083 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.328041 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e17dfaa-e70e-4344-81c0-741bdc321e76","Type":"ContainerDied","Data":"cabe9c8093fbe40cf667c3e9a25367c9366088330c5495d00e2983eb4aa0aaf2"} May 25 01:06:28.328083 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.328087 2576 scope.go:117] "RemoveContainer" containerID="0d88c32abce9976416ab6df7acb37cf816e3592bcd80e392375347a1a833a43a" May 25 01:06:28.328533 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.328134 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.338096 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.338018 2576 scope.go:117] "RemoveContainer" containerID="170b66da4250bb3e7b1a750d6d6ac96c1418fd45edbc310b41ecfb294de502cc" May 25 01:06:28.344890 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.344854 2576 scope.go:117] "RemoveContainer" containerID="a24dc826afb634f7e87446cc894cf87128b31a9684a548de56bb11d1a0464be8" May 25 01:06:28.350996 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.350973 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:06:28.352279 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.352261 2576 scope.go:117] "RemoveContainer" containerID="28c89c61050a59a21fe3aef731c8bd9bfc432c346e62add24b7b725fdeff31d6" May 25 01:06:28.354876 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.354859 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:06:28.359070 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.359055 2576 scope.go:117] "RemoveContainer" containerID="44cf5281a678b436268dc890a97540125481d5565ecdd78e34c33191024beaa7" May 25 01:06:28.365227 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.365193 2576 scope.go:117] "RemoveContainer" containerID="ac186dd152cd1ca3bfa0917138621664a29e001de9248fb160dceeaeb3355596" May 25 01:06:28.372157 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.372140 2576 scope.go:117] "RemoveContainer" containerID="258fba0560f7490b0c29aa5f0f2c2657440b941e9c542fecc7e11ae24b0d25f6" May 25 01:06:28.389451 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389426 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:06:28.389727 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389715 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="thanos-sidecar" May 25 01:06:28.389775 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389729 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="thanos-sidecar" May 25 01:06:28.389775 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389739 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy-thanos" May 25 01:06:28.389775 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389745 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy-thanos" May 25 01:06:28.389775 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389754 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy" May 25 01:06:28.389775 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389759 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy" May 25 01:06:28.389775 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389767 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="prometheus" May 25 01:06:28.389775 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389773 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="prometheus" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389781 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="config-reloader" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389786 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="config-reloader" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389793 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy-web" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389798 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy-web" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389805 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4691b477-b0e3-414f-a1df-201263a494f6" containerName="registry" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389810 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4691b477-b0e3-414f-a1df-201263a494f6" containerName="registry" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389816 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="init-config-reloader" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389821 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="init-config-reloader" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389860 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="config-reloader" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389867 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy-thanos" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389873 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="prometheus" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389882 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="thanos-sidecar" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389888 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy-web" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389894 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" containerName="kube-rbac-proxy" May 25 01:06:28.389968 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.389900 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="4691b477-b0e3-414f-a1df-201263a494f6" containerName="registry" May 25 01:06:28.394997 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.394981 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.398152 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.398131 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 01:06:28.398289 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.398175 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 01:06:28.398289 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.398185 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 01:06:28.398744 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.398724 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 01:06:28.398806 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.398763 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 01:06:28.398920 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.398898 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 01:06:28.399016 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.399001 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l5bq9\"" May 25 01:06:28.399143 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.399128 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 01:06:28.399201 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.399161 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 01:06:28.399300 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.399283 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-coqroud9nr39g\"" May 25 01:06:28.399576 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.399560 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 01:06:28.403002 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.402909 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 01:06:28.403188 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.403171 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 01:06:28.403345 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.403332 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 01:06:28.408300 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.408286 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 01:06:28.418895 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.418865 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:06:28.512294 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512294 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512294 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512294 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512582 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512582 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512582 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512582 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512582 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdsqv\" (UniqueName: \"kubernetes.io/projected/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-kube-api-access-hdsqv\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512582 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512582 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512837 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512837 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512837 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512837 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512837 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512837 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-config\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.512837 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.512727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613089 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613036 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613089 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613087 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613332 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613104 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613332 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613123 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613332 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613154 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613332 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613187 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613332 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613245 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613332 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613277 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdsqv\" (UniqueName: \"kubernetes.io/projected/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-kube-api-access-hdsqv\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613332 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613315 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613341 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613384 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613421 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613459 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613486 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613516 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613544 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-config\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613571 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.613647 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.613627 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.614293 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.614266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.614396 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.614353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.615002 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.614971 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.616592 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.616570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.616723 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.616646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.616821 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.616686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.617006 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.616921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.617246 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.617133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.617737 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.617710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.617893 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.617867 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.618130 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.618105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.618361 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.618291 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.618542 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.618521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.619259 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.619239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-config\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.619648 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.619623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.619939 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.619923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.620055 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.620041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.624250 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.624232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdsqv\" (UniqueName: \"kubernetes.io/projected/219cca1e-8c89-4ccb-9ad9-e61fcb7579a5-kube-api-access-hdsqv\") pod \"prometheus-k8s-0\" (UID: \"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.705381 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.705338 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:06:28.843873 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:28.843841 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 01:06:28.846237 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:06:28.846191 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219cca1e_8c89_4ccb_9ad9_e61fcb7579a5.slice/crio-646ef665f84c0b2f319ec04b176860e3ede1f5e68bbaf1b725176b95dbadde36 WatchSource:0}: Error finding container 646ef665f84c0b2f319ec04b176860e3ede1f5e68bbaf1b725176b95dbadde36: Status 404 returned error can't find the container with id 646ef665f84c0b2f319ec04b176860e3ede1f5e68bbaf1b725176b95dbadde36 May 25 01:06:29.333372 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:29.333336 2576 generic.go:358] "Generic (PLEG): container finished" podID="219cca1e-8c89-4ccb-9ad9-e61fcb7579a5" containerID="47cce2fa5eb54e2f675958cffdb779addb91556c1b19aa21e411f77526ea4ca1" exitCode=0 May 25 01:06:29.333857 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:29.333401 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5","Type":"ContainerDied","Data":"47cce2fa5eb54e2f675958cffdb779addb91556c1b19aa21e411f77526ea4ca1"} May 25 01:06:29.333857 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:29.333425 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5","Type":"ContainerStarted","Data":"646ef665f84c0b2f319ec04b176860e3ede1f5e68bbaf1b725176b95dbadde36"} May 25 01:06:29.549933 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:29.549897 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e17dfaa-e70e-4344-81c0-741bdc321e76" path="/var/lib/kubelet/pods/7e17dfaa-e70e-4344-81c0-741bdc321e76/volumes" May 25 01:06:30.340060 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:30.340029 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5","Type":"ContainerStarted","Data":"5250ca7b25110f55ea84310dde23e8a5c1ed2fe1893bdb16e9479b825276eaed"} May 25 01:06:30.340060 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:30.340063 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5","Type":"ContainerStarted","Data":"d685bdcac1c88403f55ce7fcee0019e6eb6dc6791a4f118bfeba146e240d5c5a"} May 25 01:06:30.340060 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:30.340073 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5","Type":"ContainerStarted","Data":"410b8016703ffdd18ed5ffd2817473ad97d75616afa95c7256e71f85c473952a"} May 25 01:06:30.340513 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:30.340082 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5","Type":"ContainerStarted","Data":"8a4de8887d43eb2560f4ae7ac70c8979bbfd118ed822f5b7a019e23aaac098fe"} May 25 01:06:30.340513 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:30.340091 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5","Type":"ContainerStarted","Data":"b427a783881fd91132625d64f8709c2a9051e03a188c80b92b3fd2f528745def"} May 25 01:06:30.340513 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:30.340098 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"219cca1e-8c89-4ccb-9ad9-e61fcb7579a5","Type":"ContainerStarted","Data":"f260e9f1c23d6951b789c4edf6c88cd56e276e5fabf0913a167cf11ce3ff9ac5"} May 25 01:06:30.376383 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:30.376335 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.376317493 podStartE2EDuration="2.376317493s" podCreationTimestamp="2026-05-25 01:06:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:06:30.374883766 +0000 UTC m=+233.449943622" watchObservedRunningTime="2026-05-25 01:06:30.376317493 +0000 UTC m=+233.451377362" May 25 01:06:33.705621 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:06:33.705576 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:07:12.219788 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.219750 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hq45t"] May 25 01:07:12.223915 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.223898 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.226991 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.226967 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 25 01:07:12.234350 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.234325 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hq45t"] May 25 01:07:12.273765 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.273734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dc3c78d-0729-4d29-877e-fe180296b272-kubelet-config\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.273765 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.273779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dc3c78d-0729-4d29-877e-fe180296b272-original-pull-secret\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.273984 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.273906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dc3c78d-0729-4d29-877e-fe180296b272-dbus\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.374500 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.374460 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dc3c78d-0729-4d29-877e-fe180296b272-original-pull-secret\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.374674 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.374558 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dc3c78d-0729-4d29-877e-fe180296b272-dbus\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.374674 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.374590 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dc3c78d-0729-4d29-877e-fe180296b272-kubelet-config\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.374674 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.374673 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dc3c78d-0729-4d29-877e-fe180296b272-kubelet-config\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.374778 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.374737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dc3c78d-0729-4d29-877e-fe180296b272-dbus\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.376963 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.376937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dc3c78d-0729-4d29-877e-fe180296b272-original-pull-secret\") pod \"global-pull-secret-syncer-hq45t\" (UID: \"3dc3c78d-0729-4d29-877e-fe180296b272\") " pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.533297 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.533190 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq45t" May 25 01:07:12.685316 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:12.685288 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hq45t"] May 25 01:07:12.687302 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:07:12.687269 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc3c78d_0729_4d29_877e_fe180296b272.slice/crio-edf4862899b16d1e32a37adb831bd0121fb1ef4023d7ea34ce0d70b55b740b19 WatchSource:0}: Error finding container edf4862899b16d1e32a37adb831bd0121fb1ef4023d7ea34ce0d70b55b740b19: Status 404 returned error can't find the container with id edf4862899b16d1e32a37adb831bd0121fb1ef4023d7ea34ce0d70b55b740b19 May 25 01:07:13.464925 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:13.464884 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hq45t" event={"ID":"3dc3c78d-0729-4d29-877e-fe180296b272","Type":"ContainerStarted","Data":"edf4862899b16d1e32a37adb831bd0121fb1ef4023d7ea34ce0d70b55b740b19"} May 25 01:07:17.479492 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:17.479452 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hq45t" event={"ID":"3dc3c78d-0729-4d29-877e-fe180296b272","Type":"ContainerStarted","Data":"b59c8932388052711fcf6027b1ce94e1cda5678f0bcf27211583e297f91c680c"} May 25 01:07:17.499252 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:17.499183 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hq45t" podStartSLOduration=1.77006834 podStartE2EDuration="5.499166946s" podCreationTimestamp="2026-05-25 01:07:12 +0000 UTC" firstStartedPulling="2026-05-25 01:07:12.688904063 +0000 UTC m=+275.763963886" lastFinishedPulling="2026-05-25 01:07:16.41800265 +0000 UTC m=+279.493062492" observedRunningTime="2026-05-25 01:07:17.498136143 +0000 UTC m=+280.573195989" watchObservedRunningTime="2026-05-25 01:07:17.499166946 +0000 UTC m=+280.574226793" May 25 01:07:28.705940 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:28.705906 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:07:28.721860 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:28.721835 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:07:29.532508 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:29.532480 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 01:07:37.412145 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:07:37.412124 2576 kubelet.go:1628] "Image garbage collection succeeded" May 25 01:08:07.221219 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.221187 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-24wmj"] May 25 01:08:07.224502 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.224487 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" May 25 01:08:07.227308 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.227284 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 25 01:08:07.228273 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.228253 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 25 01:08:07.228385 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.228286 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bdk49\"" May 25 01:08:07.234423 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.234401 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-24wmj"] May 25 01:08:07.340732 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.340694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57d4ba6d-02e8-40f7-a48c-4ae5301a7a31-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-24wmj\" (UID: \"57d4ba6d-02e8-40f7-a48c-4ae5301a7a31\") " pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" May 25 01:08:07.340908 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.340807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2tb5\" (UniqueName: \"kubernetes.io/projected/57d4ba6d-02e8-40f7-a48c-4ae5301a7a31-kube-api-access-x2tb5\") pod \"cert-manager-cainjector-68b757865b-24wmj\" (UID: \"57d4ba6d-02e8-40f7-a48c-4ae5301a7a31\") " pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" May 25 01:08:07.442171 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.442139 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tb5\" (UniqueName: \"kubernetes.io/projected/57d4ba6d-02e8-40f7-a48c-4ae5301a7a31-kube-api-access-x2tb5\") pod \"cert-manager-cainjector-68b757865b-24wmj\" (UID: \"57d4ba6d-02e8-40f7-a48c-4ae5301a7a31\") " pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" May 25 01:08:07.442329 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.442185 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57d4ba6d-02e8-40f7-a48c-4ae5301a7a31-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-24wmj\" (UID: \"57d4ba6d-02e8-40f7-a48c-4ae5301a7a31\") " pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" May 25 01:08:07.451285 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.451263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57d4ba6d-02e8-40f7-a48c-4ae5301a7a31-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-24wmj\" (UID: \"57d4ba6d-02e8-40f7-a48c-4ae5301a7a31\") " pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" May 25 01:08:07.451407 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.451312 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2tb5\" (UniqueName: \"kubernetes.io/projected/57d4ba6d-02e8-40f7-a48c-4ae5301a7a31-kube-api-access-x2tb5\") pod \"cert-manager-cainjector-68b757865b-24wmj\" (UID: \"57d4ba6d-02e8-40f7-a48c-4ae5301a7a31\") " pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" May 25 01:08:07.545237 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.545144 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" May 25 01:08:07.675451 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.675420 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-24wmj"] May 25 01:08:07.680364 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:08:07.680324 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57d4ba6d_02e8_40f7_a48c_4ae5301a7a31.slice/crio-44f377de48af31d56b1ab9863b7e8bf4a11badf85fb6dbbdd4f601ee250fcb4b WatchSource:0}: Error finding container 44f377de48af31d56b1ab9863b7e8bf4a11badf85fb6dbbdd4f601ee250fcb4b: Status 404 returned error can't find the container with id 44f377de48af31d56b1ab9863b7e8bf4a11badf85fb6dbbdd4f601ee250fcb4b May 25 01:08:07.681727 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:07.681712 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 01:08:08.625461 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:08.625425 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" event={"ID":"57d4ba6d-02e8-40f7-a48c-4ae5301a7a31","Type":"ContainerStarted","Data":"44f377de48af31d56b1ab9863b7e8bf4a11badf85fb6dbbdd4f601ee250fcb4b"} May 25 01:08:11.635114 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:11.635076 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" event={"ID":"57d4ba6d-02e8-40f7-a48c-4ae5301a7a31","Type":"ContainerStarted","Data":"5eb1e8a2926860a77996d706a96d1c8285c18fe10c52707721adb9b3fa48dd28"} May 25 01:08:11.651517 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:11.651472 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-24wmj" podStartSLOduration=1.65033817 podStartE2EDuration="4.651459042s" podCreationTimestamp="2026-05-25 01:08:07 +0000 UTC" firstStartedPulling="2026-05-25 01:08:07.681838206 +0000 UTC m=+330.756898029" lastFinishedPulling="2026-05-25 01:08:10.682959075 +0000 UTC m=+333.758018901" observedRunningTime="2026-05-25 01:08:11.651095334 +0000 UTC m=+334.726155180" watchObservedRunningTime="2026-05-25 01:08:11.651459042 +0000 UTC m=+334.726518887" May 25 01:08:46.610725 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.610639 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc"] May 25 01:08:46.615775 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.615758 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.618554 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.618529 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 25 01:08:46.618641 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.618614 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 25 01:08:46.618974 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.618961 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m7q2p\"" May 25 01:08:46.619159 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.619142 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 25 01:08:46.619354 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.619341 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 25 01:08:46.629183 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.629160 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc"] May 25 01:08:46.683339 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.683306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6354102-0e2e-4dda-83d9-4eff69507125-webhook-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.683477 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.683363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6354102-0e2e-4dda-83d9-4eff69507125-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.683477 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.683421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kpcp\" (UniqueName: \"kubernetes.io/projected/a6354102-0e2e-4dda-83d9-4eff69507125-kube-api-access-9kpcp\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.784224 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.784174 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6354102-0e2e-4dda-83d9-4eff69507125-webhook-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.784413 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.784277 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6354102-0e2e-4dda-83d9-4eff69507125-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.784413 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.784305 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kpcp\" (UniqueName: \"kubernetes.io/projected/a6354102-0e2e-4dda-83d9-4eff69507125-kube-api-access-9kpcp\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.786851 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.786826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6354102-0e2e-4dda-83d9-4eff69507125-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.786965 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.786946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6354102-0e2e-4dda-83d9-4eff69507125-webhook-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.792320 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.792296 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kpcp\" (UniqueName: \"kubernetes.io/projected/a6354102-0e2e-4dda-83d9-4eff69507125-kube-api-access-9kpcp\") pod \"opendatahub-operator-controller-manager-68d974c4c6-sqcrc\" (UID: \"a6354102-0e2e-4dda-83d9-4eff69507125\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:46.926563 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:46.926522 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:47.056755 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:47.056698 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc"] May 25 01:08:47.060697 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:08:47.060667 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6354102_0e2e_4dda_83d9_4eff69507125.slice/crio-3df1606ffb98190c690a272b02fac042a5be8ac6e4422c444c5e3e461901ab90 WatchSource:0}: Error finding container 3df1606ffb98190c690a272b02fac042a5be8ac6e4422c444c5e3e461901ab90: Status 404 returned error can't find the container with id 3df1606ffb98190c690a272b02fac042a5be8ac6e4422c444c5e3e461901ab90 May 25 01:08:47.738165 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:47.738128 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" event={"ID":"a6354102-0e2e-4dda-83d9-4eff69507125","Type":"ContainerStarted","Data":"3df1606ffb98190c690a272b02fac042a5be8ac6e4422c444c5e3e461901ab90"} May 25 01:08:49.746784 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:49.746755 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" event={"ID":"a6354102-0e2e-4dda-83d9-4eff69507125","Type":"ContainerStarted","Data":"f0a86b8faea22295bdd8c236ca8c0f8bc72add6f20135e9fcdc62c31d0ff67b6"} May 25 01:08:49.747141 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:49.746904 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:08:49.769161 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:08:49.769079 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" podStartSLOduration=1.163174195 podStartE2EDuration="3.769060354s" podCreationTimestamp="2026-05-25 01:08:46 +0000 UTC" firstStartedPulling="2026-05-25 01:08:47.062626158 +0000 UTC m=+370.137685985" lastFinishedPulling="2026-05-25 01:08:49.668512317 +0000 UTC m=+372.743572144" observedRunningTime="2026-05-25 01:08:49.767041291 +0000 UTC m=+372.842101136" watchObservedRunningTime="2026-05-25 01:08:49.769060354 +0000 UTC m=+372.844120200" May 25 01:09:00.752674 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:00.752636 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-sqcrc" May 25 01:09:05.941445 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:05.941406 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2"] May 25 01:09:05.944804 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:05.944781 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:05.947374 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:05.947355 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 25 01:09:05.947505 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:05.947453 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kdr7t\"" May 25 01:09:05.948584 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:05.948566 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 25 01:09:05.948661 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:05.948626 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 25 01:09:05.948724 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:05.948707 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 25 01:09:05.961927 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:05.961902 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2"] May 25 01:09:06.055989 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.055954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqjb4\" (UniqueName: \"kubernetes.io/projected/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-kube-api-access-xqjb4\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.056157 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.056019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-tls-certs\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.056157 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.056050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-tmp\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.156642 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.156607 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-tls-certs\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.156819 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.156656 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-tmp\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.156819 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.156703 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqjb4\" (UniqueName: \"kubernetes.io/projected/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-kube-api-access-xqjb4\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.159187 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.159160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-tmp\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.159385 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.159367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-tls-certs\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.166113 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.166093 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqjb4\" (UniqueName: \"kubernetes.io/projected/1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7-kube-api-access-xqjb4\") pod \"kube-auth-proxy-5b5b59cdf9-gmqr2\" (UID: \"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7\") " pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.254351 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.254267 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" May 25 01:09:06.393572 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.393547 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2"] May 25 01:09:06.396085 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:09:06.396054 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1ee4c2_796a_4ce0_a484_bdf7cf808ef7.slice/crio-b389b22039bce0970ea9a7d6bc019faaeecb7bb0816a09b06dfb8f51a69bfe92 WatchSource:0}: Error finding container b389b22039bce0970ea9a7d6bc019faaeecb7bb0816a09b06dfb8f51a69bfe92: Status 404 returned error can't find the container with id b389b22039bce0970ea9a7d6bc019faaeecb7bb0816a09b06dfb8f51a69bfe92 May 25 01:09:06.801276 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:06.801239 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" event={"ID":"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7","Type":"ContainerStarted","Data":"b389b22039bce0970ea9a7d6bc019faaeecb7bb0816a09b06dfb8f51a69bfe92"} May 25 01:09:08.938720 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:08.938687 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-zmzlf"] May 25 01:09:08.942397 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:08.942377 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:08.945079 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:08.945059 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 25 01:09:08.945236 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:08.945186 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-c6sm4\"" May 25 01:09:08.952732 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:08.952708 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-zmzlf"] May 25 01:09:09.082624 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:09.082585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcphd\" (UniqueName: \"kubernetes.io/projected/6e8cb494-d348-4aaa-b146-f58a4dda37c3-kube-api-access-jcphd\") pod \"odh-model-controller-858dbf95b8-zmzlf\" (UID: \"6e8cb494-d348-4aaa-b146-f58a4dda37c3\") " pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:09.082813 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:09.082732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert\") pod \"odh-model-controller-858dbf95b8-zmzlf\" (UID: \"6e8cb494-d348-4aaa-b146-f58a4dda37c3\") " pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:09.184288 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:09.184195 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert\") pod \"odh-model-controller-858dbf95b8-zmzlf\" (UID: \"6e8cb494-d348-4aaa-b146-f58a4dda37c3\") " pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:09.184473 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:09.184327 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcphd\" (UniqueName: \"kubernetes.io/projected/6e8cb494-d348-4aaa-b146-f58a4dda37c3-kube-api-access-jcphd\") pod \"odh-model-controller-858dbf95b8-zmzlf\" (UID: \"6e8cb494-d348-4aaa-b146-f58a4dda37c3\") " pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:09.184473 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:09.184352 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 25 01:09:09.184473 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:09.184425 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert podName:6e8cb494-d348-4aaa-b146-f58a4dda37c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:09:09.684405503 +0000 UTC m=+392.759465330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert") pod "odh-model-controller-858dbf95b8-zmzlf" (UID: "6e8cb494-d348-4aaa-b146-f58a4dda37c3") : secret "odh-model-controller-webhook-cert" not found May 25 01:09:09.196912 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:09.196839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcphd\" (UniqueName: \"kubernetes.io/projected/6e8cb494-d348-4aaa-b146-f58a4dda37c3-kube-api-access-jcphd\") pod \"odh-model-controller-858dbf95b8-zmzlf\" (UID: \"6e8cb494-d348-4aaa-b146-f58a4dda37c3\") " pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:09.690459 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:09.690428 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert\") pod \"odh-model-controller-858dbf95b8-zmzlf\" (UID: \"6e8cb494-d348-4aaa-b146-f58a4dda37c3\") " pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:09.690760 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:09.690726 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 25 01:09:09.690867 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:09.690854 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert podName:6e8cb494-d348-4aaa-b146-f58a4dda37c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:09:10.690831603 +0000 UTC m=+393.765891428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert") pod "odh-model-controller-858dbf95b8-zmzlf" (UID: "6e8cb494-d348-4aaa-b146-f58a4dda37c3") : secret "odh-model-controller-webhook-cert" not found May 25 01:09:09.818708 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:09.818657 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" event={"ID":"1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7","Type":"ContainerStarted","Data":"b265a60f40738e95acfa488574f537bc0c60d543c25f8f9c7950864aeac811b5"} May 25 01:09:09.839065 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:09.839015 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b5b59cdf9-gmqr2" podStartSLOduration=1.5902703809999998 podStartE2EDuration="4.839000108s" podCreationTimestamp="2026-05-25 01:09:05 +0000 UTC" firstStartedPulling="2026-05-25 01:09:06.397889901 +0000 UTC m=+389.472949727" lastFinishedPulling="2026-05-25 01:09:09.646619631 +0000 UTC m=+392.721679454" observedRunningTime="2026-05-25 01:09:09.837165681 +0000 UTC m=+392.912225527" watchObservedRunningTime="2026-05-25 01:09:09.839000108 +0000 UTC m=+392.914059954" May 25 01:09:10.700292 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:10.700257 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert\") pod \"odh-model-controller-858dbf95b8-zmzlf\" (UID: \"6e8cb494-d348-4aaa-b146-f58a4dda37c3\") " pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:10.702780 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:10.702750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e8cb494-d348-4aaa-b146-f58a4dda37c3-cert\") pod \"odh-model-controller-858dbf95b8-zmzlf\" (UID: \"6e8cb494-d348-4aaa-b146-f58a4dda37c3\") " pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:10.754349 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:10.754321 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:10.899080 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:10.899046 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-zmzlf"] May 25 01:09:10.903091 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:09:10.903062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8cb494_d348_4aaa_b146_f58a4dda37c3.slice/crio-99a442c02fd2b63260dce182e888ed5ef238119392f9bcd364ab9add990c2316 WatchSource:0}: Error finding container 99a442c02fd2b63260dce182e888ed5ef238119392f9bcd364ab9add990c2316: Status 404 returned error can't find the container with id 99a442c02fd2b63260dce182e888ed5ef238119392f9bcd364ab9add990c2316 May 25 01:09:11.828063 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:11.828026 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" event={"ID":"6e8cb494-d348-4aaa-b146-f58a4dda37c3","Type":"ContainerStarted","Data":"99a442c02fd2b63260dce182e888ed5ef238119392f9bcd364ab9add990c2316"} May 25 01:09:14.839131 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:14.839096 2576 generic.go:358] "Generic (PLEG): container finished" podID="6e8cb494-d348-4aaa-b146-f58a4dda37c3" containerID="a8363882ec9972819da0513b677a8a27bf762c4267b96645b48d5dd85124d721" exitCode=1 May 25 01:09:14.839542 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:14.839179 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" event={"ID":"6e8cb494-d348-4aaa-b146-f58a4dda37c3","Type":"ContainerDied","Data":"a8363882ec9972819da0513b677a8a27bf762c4267b96645b48d5dd85124d721"} May 25 01:09:14.839542 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:14.839366 2576 scope.go:117] "RemoveContainer" containerID="a8363882ec9972819da0513b677a8a27bf762c4267b96645b48d5dd85124d721" May 25 01:09:15.604237 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.604132 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-ltcwj"] May 25 01:09:15.607795 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.607770 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:15.610850 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.610826 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 25 01:09:15.611268 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.611248 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kp7nk\"" May 25 01:09:15.623542 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.623519 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-ltcwj"] May 25 01:09:15.746516 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.746485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4516c595-47af-406a-9bb7-1e975d17a8fd-cert\") pod \"kserve-controller-manager-856948b99f-ltcwj\" (UID: \"4516c595-47af-406a-9bb7-1e975d17a8fd\") " pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:15.746701 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.746525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj94z\" (UniqueName: \"kubernetes.io/projected/4516c595-47af-406a-9bb7-1e975d17a8fd-kube-api-access-wj94z\") pod \"kserve-controller-manager-856948b99f-ltcwj\" (UID: \"4516c595-47af-406a-9bb7-1e975d17a8fd\") " pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:15.845408 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.845377 2576 generic.go:358] "Generic (PLEG): container finished" podID="6e8cb494-d348-4aaa-b146-f58a4dda37c3" containerID="5517d9b854cdc6033c8a81070ca49491e444cfefe49fcee46c0fa49b62c203f6" exitCode=1 May 25 01:09:15.845796 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.845463 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" event={"ID":"6e8cb494-d348-4aaa-b146-f58a4dda37c3","Type":"ContainerDied","Data":"5517d9b854cdc6033c8a81070ca49491e444cfefe49fcee46c0fa49b62c203f6"} May 25 01:09:15.845796 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.845501 2576 scope.go:117] "RemoveContainer" containerID="a8363882ec9972819da0513b677a8a27bf762c4267b96645b48d5dd85124d721" May 25 01:09:15.845796 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.845682 2576 scope.go:117] "RemoveContainer" containerID="5517d9b854cdc6033c8a81070ca49491e444cfefe49fcee46c0fa49b62c203f6" May 25 01:09:15.845946 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:15.845905 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-zmzlf_opendatahub(6e8cb494-d348-4aaa-b146-f58a4dda37c3)\"" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" podUID="6e8cb494-d348-4aaa-b146-f58a4dda37c3" May 25 01:09:15.847723 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.847703 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4516c595-47af-406a-9bb7-1e975d17a8fd-cert\") pod \"kserve-controller-manager-856948b99f-ltcwj\" (UID: \"4516c595-47af-406a-9bb7-1e975d17a8fd\") " pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:15.847779 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.847737 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wj94z\" (UniqueName: \"kubernetes.io/projected/4516c595-47af-406a-9bb7-1e975d17a8fd-kube-api-access-wj94z\") pod \"kserve-controller-manager-856948b99f-ltcwj\" (UID: \"4516c595-47af-406a-9bb7-1e975d17a8fd\") " pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:15.847843 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:15.847829 2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 25 01:09:15.847887 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:15.847878 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4516c595-47af-406a-9bb7-1e975d17a8fd-cert podName:4516c595-47af-406a-9bb7-1e975d17a8fd nodeName:}" failed. No retries permitted until 2026-05-25 01:09:16.347864738 +0000 UTC m=+399.422924560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4516c595-47af-406a-9bb7-1e975d17a8fd-cert") pod "kserve-controller-manager-856948b99f-ltcwj" (UID: "4516c595-47af-406a-9bb7-1e975d17a8fd") : secret "kserve-webhook-server-cert" not found May 25 01:09:15.883596 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:15.883564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj94z\" (UniqueName: \"kubernetes.io/projected/4516c595-47af-406a-9bb7-1e975d17a8fd-kube-api-access-wj94z\") pod \"kserve-controller-manager-856948b99f-ltcwj\" (UID: \"4516c595-47af-406a-9bb7-1e975d17a8fd\") " pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:16.351760 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:16.351714 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4516c595-47af-406a-9bb7-1e975d17a8fd-cert\") pod \"kserve-controller-manager-856948b99f-ltcwj\" (UID: \"4516c595-47af-406a-9bb7-1e975d17a8fd\") " pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:16.354250 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:16.354198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4516c595-47af-406a-9bb7-1e975d17a8fd-cert\") pod \"kserve-controller-manager-856948b99f-ltcwj\" (UID: \"4516c595-47af-406a-9bb7-1e975d17a8fd\") " pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:16.518348 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:16.518309 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:16.663362 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:16.663337 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-ltcwj"] May 25 01:09:16.665370 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:09:16.665344 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4516c595_47af_406a_9bb7_1e975d17a8fd.slice/crio-4c3a0c564b55616988201366d2b8e48b5e94fa28fa788b7bea2ee38dd0d8c567 WatchSource:0}: Error finding container 4c3a0c564b55616988201366d2b8e48b5e94fa28fa788b7bea2ee38dd0d8c567: Status 404 returned error can't find the container with id 4c3a0c564b55616988201366d2b8e48b5e94fa28fa788b7bea2ee38dd0d8c567 May 25 01:09:16.850846 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:16.850813 2576 scope.go:117] "RemoveContainer" containerID="5517d9b854cdc6033c8a81070ca49491e444cfefe49fcee46c0fa49b62c203f6" May 25 01:09:16.851273 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:16.851057 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-zmzlf_opendatahub(6e8cb494-d348-4aaa-b146-f58a4dda37c3)\"" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" podUID="6e8cb494-d348-4aaa-b146-f58a4dda37c3" May 25 01:09:16.851518 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:16.851499 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" event={"ID":"4516c595-47af-406a-9bb7-1e975d17a8fd","Type":"ContainerStarted","Data":"4c3a0c564b55616988201366d2b8e48b5e94fa28fa788b7bea2ee38dd0d8c567"} May 25 01:09:20.589338 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.589301 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-hpppl"] May 25 01:09:20.594115 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.594093 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:20.597979 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.597951 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 25 01:09:20.598198 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.598180 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 25 01:09:20.598382 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.598358 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-qbxhn\"" May 25 01:09:20.620085 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.620039 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-hpppl"] May 25 01:09:20.693443 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.693116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hrbw\" (UniqueName: \"kubernetes.io/projected/ca493fcb-2449-4504-81c0-88a82a5b19ef-kube-api-access-4hrbw\") pod \"servicemesh-operator3-55f49c5f94-hpppl\" (UID: \"ca493fcb-2449-4504-81c0-88a82a5b19ef\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:20.693443 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.693332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ca493fcb-2449-4504-81c0-88a82a5b19ef-operator-config\") pod \"servicemesh-operator3-55f49c5f94-hpppl\" (UID: \"ca493fcb-2449-4504-81c0-88a82a5b19ef\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:20.754715 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.754681 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:20.755080 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.755057 2576 scope.go:117] "RemoveContainer" containerID="5517d9b854cdc6033c8a81070ca49491e444cfefe49fcee46c0fa49b62c203f6" May 25 01:09:20.755312 ip-10-0-128-11 kubenswrapper[2576]: E0525 01:09:20.755294 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-zmzlf_opendatahub(6e8cb494-d348-4aaa-b146-f58a4dda37c3)\"" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" podUID="6e8cb494-d348-4aaa-b146-f58a4dda37c3" May 25 01:09:20.794073 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.794051 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ca493fcb-2449-4504-81c0-88a82a5b19ef-operator-config\") pod \"servicemesh-operator3-55f49c5f94-hpppl\" (UID: \"ca493fcb-2449-4504-81c0-88a82a5b19ef\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:20.794169 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.794123 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hrbw\" (UniqueName: \"kubernetes.io/projected/ca493fcb-2449-4504-81c0-88a82a5b19ef-kube-api-access-4hrbw\") pod \"servicemesh-operator3-55f49c5f94-hpppl\" (UID: \"ca493fcb-2449-4504-81c0-88a82a5b19ef\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:20.796749 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.796715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ca493fcb-2449-4504-81c0-88a82a5b19ef-operator-config\") pod \"servicemesh-operator3-55f49c5f94-hpppl\" (UID: \"ca493fcb-2449-4504-81c0-88a82a5b19ef\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:20.806684 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.806648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hrbw\" (UniqueName: \"kubernetes.io/projected/ca493fcb-2449-4504-81c0-88a82a5b19ef-kube-api-access-4hrbw\") pod \"servicemesh-operator3-55f49c5f94-hpppl\" (UID: \"ca493fcb-2449-4504-81c0-88a82a5b19ef\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:20.865437 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.865404 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" event={"ID":"4516c595-47af-406a-9bb7-1e975d17a8fd","Type":"ContainerStarted","Data":"2b08afea48d0555886f3dcaa761dab489d24a68caa1a6297dd08a4fba6811ba8"} May 25 01:09:20.865574 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.865461 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:09:20.906983 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:20.906948 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:21.065867 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:21.065801 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" podStartSLOduration=1.947179088 podStartE2EDuration="6.06577971s" podCreationTimestamp="2026-05-25 01:09:15 +0000 UTC" firstStartedPulling="2026-05-25 01:09:16.666743916 +0000 UTC m=+399.741803750" lastFinishedPulling="2026-05-25 01:09:20.785344545 +0000 UTC m=+403.860404372" observedRunningTime="2026-05-25 01:09:20.897795788 +0000 UTC m=+403.972855633" watchObservedRunningTime="2026-05-25 01:09:21.06577971 +0000 UTC m=+404.140839557" May 25 01:09:21.067391 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:21.067340 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-hpppl"] May 25 01:09:21.070383 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:09:21.070343 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca493fcb_2449_4504_81c0_88a82a5b19ef.slice/crio-ae0d07df2fe671131d0ea4abc429158cf605c566840964367f52f57060a49ffa WatchSource:0}: Error finding container ae0d07df2fe671131d0ea4abc429158cf605c566840964367f52f57060a49ffa: Status 404 returned error can't find the container with id ae0d07df2fe671131d0ea4abc429158cf605c566840964367f52f57060a49ffa May 25 01:09:21.870080 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:21.870006 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" event={"ID":"ca493fcb-2449-4504-81c0-88a82a5b19ef","Type":"ContainerStarted","Data":"ae0d07df2fe671131d0ea4abc429158cf605c566840964367f52f57060a49ffa"} May 25 01:09:25.886106 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:25.886053 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" event={"ID":"ca493fcb-2449-4504-81c0-88a82a5b19ef","Type":"ContainerStarted","Data":"88130be490b75441fc56a607da9fb82dd5afe031653af100db9063dba0abec87"} May 25 01:09:25.886571 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:25.886134 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:25.906882 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:25.906815 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" podStartSLOduration=1.299659498 podStartE2EDuration="5.906796643s" podCreationTimestamp="2026-05-25 01:09:20 +0000 UTC" firstStartedPulling="2026-05-25 01:09:21.072791951 +0000 UTC m=+404.147851773" lastFinishedPulling="2026-05-25 01:09:25.679929091 +0000 UTC m=+408.754988918" observedRunningTime="2026-05-25 01:09:25.904725336 +0000 UTC m=+408.979785182" watchObservedRunningTime="2026-05-25 01:09:25.906796643 +0000 UTC m=+408.981856490" May 25 01:09:29.276463 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.276431 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5"] May 25 01:09:29.279806 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.279788 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.282785 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.282724 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 25 01:09:29.282917 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.282822 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 25 01:09:29.283964 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.283931 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 25 01:09:29.284122 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.284082 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 25 01:09:29.284433 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.284416 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wcb2t\"" May 25 01:09:29.292329 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.292308 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5"] May 25 01:09:29.364626 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.364593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.364788 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.364643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-cacerts\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.364788 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.364728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xw4\" (UniqueName: \"kubernetes.io/projected/9ecb035c-3163-411c-8d3c-fb39c944ad46-kube-api-access-m2xw4\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.364788 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.364758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-token\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.364788 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.364778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ecb035c-3163-411c-8d3c-fb39c944ad46-local-certs\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.364918 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.364795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.364918 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.364827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.465224 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.465170 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xw4\" (UniqueName: \"kubernetes.io/projected/9ecb035c-3163-411c-8d3c-fb39c944ad46-kube-api-access-m2xw4\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.465419 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.465232 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-token\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.465419 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.465260 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ecb035c-3163-411c-8d3c-fb39c944ad46-local-certs\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.465419 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.465281 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.465419 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.465326 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.465419 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.465368 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.465419 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.465419 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-cacerts\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.466107 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.466080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.468282 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.468255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-cacerts\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.468569 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.468486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.468663 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.468624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.469972 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.469950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ecb035c-3163-411c-8d3c-fb39c944ad46-local-certs\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.474426 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.474399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ecb035c-3163-411c-8d3c-fb39c944ad46-istio-token\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.474665 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.474644 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xw4\" (UniqueName: \"kubernetes.io/projected/9ecb035c-3163-411c-8d3c-fb39c944ad46-kube-api-access-m2xw4\") pod \"istiod-openshift-gateway-798958bb55-htpq5\" (UID: \"9ecb035c-3163-411c-8d3c-fb39c944ad46\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.591084 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.590986 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:29.741037 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.741002 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5"] May 25 01:09:29.744650 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:09:29.744615 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ecb035c_3163_411c_8d3c_fb39c944ad46.slice/crio-d033b40b844dd439e2db7f04642bda62fbc69eea10ae4cb3f506a6981649d79f WatchSource:0}: Error finding container d033b40b844dd439e2db7f04642bda62fbc69eea10ae4cb3f506a6981649d79f: Status 404 returned error can't find the container with id d033b40b844dd439e2db7f04642bda62fbc69eea10ae4cb3f506a6981649d79f May 25 01:09:29.902577 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:29.902543 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" event={"ID":"9ecb035c-3163-411c-8d3c-fb39c944ad46","Type":"ContainerStarted","Data":"d033b40b844dd439e2db7f04642bda62fbc69eea10ae4cb3f506a6981649d79f"} May 25 01:09:30.755430 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:30.755392 2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:30.755904 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:30.755793 2576 scope.go:117] "RemoveContainer" containerID="5517d9b854cdc6033c8a81070ca49491e444cfefe49fcee46c0fa49b62c203f6" May 25 01:09:31.917782 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:31.917741 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" event={"ID":"6e8cb494-d348-4aaa-b146-f58a4dda37c3","Type":"ContainerStarted","Data":"35b45e1e96526af331f9cd177808f005df9ff6552f66246c6c132183a632c49c"} May 25 01:09:31.918268 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:31.917990 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:31.937190 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:31.937134 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" podStartSLOduration=3.808568433 podStartE2EDuration="23.937114775s" podCreationTimestamp="2026-05-25 01:09:08 +0000 UTC" firstStartedPulling="2026-05-25 01:09:10.90449777 +0000 UTC m=+393.979557596" lastFinishedPulling="2026-05-25 01:09:31.033044109 +0000 UTC m=+414.108103938" observedRunningTime="2026-05-25 01:09:31.935573327 +0000 UTC m=+415.010633173" watchObservedRunningTime="2026-05-25 01:09:31.937114775 +0000 UTC m=+415.012174623" May 25 01:09:33.242549 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:33.242514 2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 25 01:09:33.242818 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:33.242582 2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 25 01:09:33.926298 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:33.926257 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" event={"ID":"9ecb035c-3163-411c-8d3c-fb39c944ad46","Type":"ContainerStarted","Data":"6c193950a3e9e9b1f2e96f6620757df921fd782997b835ee97385ce08aa3da8b"} May 25 01:09:33.926491 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:33.926464 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:33.950859 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:33.950803 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" podStartSLOduration=1.455307482 podStartE2EDuration="4.95078543s" podCreationTimestamp="2026-05-25 01:09:29 +0000 UTC" firstStartedPulling="2026-05-25 01:09:29.746783377 +0000 UTC m=+412.821843213" lastFinishedPulling="2026-05-25 01:09:33.242261322 +0000 UTC m=+416.317321161" observedRunningTime="2026-05-25 01:09:33.949163392 +0000 UTC m=+417.024223239" watchObservedRunningTime="2026-05-25 01:09:33.95078543 +0000 UTC m=+417.025845275" May 25 01:09:34.932369 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:34.932341 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-htpq5" May 25 01:09:36.891357 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:36.891327 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hpppl" May 25 01:09:42.923721 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:42.923687 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-zmzlf" May 25 01:09:51.876330 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:09:51.876292 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-ltcwj" May 25 01:10:08.708745 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:08.708705 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-ltcwj_4516c595-47af-406a-9bb7-1e975d17a8fd/manager/0.log" May 25 01:10:08.819471 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:08.819441 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-zmzlf_6e8cb494-d348-4aaa-b146-f58a4dda37c3/manager/2.log" May 25 01:10:09.070687 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:09.070604 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68d974c4c6-sqcrc_a6354102-0e2e-4dda-83d9-4eff69507125/manager/0.log" May 25 01:10:10.065396 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:10.065355 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-htpq5_9ecb035c-3163-411c-8d3c-fb39c944ad46/discovery/0.log" May 25 01:10:10.174158 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:10.174126 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b5b59cdf9-gmqr2_1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7/kube-auth-proxy/0.log" May 25 01:10:17.560478 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:17.560440 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hq45t_3dc3c78d-0729-4d29-877e-fe180296b272/global-pull-secret-syncer/0.log" May 25 01:10:17.643821 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:17.643788 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8fpl8_bfe62eec-4ce7-4fd0-88f1-9319e7dbefe4/konnectivity-agent/0.log" May 25 01:10:17.711675 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:17.711637 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-11.ec2.internal_cef790bf704935fd6f0c648e0b097c0c/haproxy/0.log" May 25 01:10:21.310107 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:21.310066 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-vqs62_19db15d4-5a51-4c96-bc95-54ea1a403781/cluster-monitoring-operator/0.log" May 25 01:10:21.494282 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:21.494250 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-z5xwp_b76f1987-8d4b-4d0b-a7f5-4911827a8149/monitoring-plugin/0.log" May 25 01:10:21.726025 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:21.725991 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhgjh_3880859a-fd88-4ef1-9e2e-579b84b426b6/node-exporter/0.log" May 25 01:10:21.745747 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:21.745716 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhgjh_3880859a-fd88-4ef1-9e2e-579b84b426b6/kube-rbac-proxy/0.log" May 25 01:10:21.770331 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:21.770311 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhgjh_3880859a-fd88-4ef1-9e2e-579b84b426b6/init-textfile/0.log" May 25 01:10:21.899157 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:21.899130 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_219cca1e-8c89-4ccb-9ad9-e61fcb7579a5/prometheus/0.log" May 25 01:10:21.939813 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:21.939787 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_219cca1e-8c89-4ccb-9ad9-e61fcb7579a5/config-reloader/0.log" May 25 01:10:21.967389 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:21.967356 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_219cca1e-8c89-4ccb-9ad9-e61fcb7579a5/thanos-sidecar/0.log" May 25 01:10:22.006110 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.006036 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_219cca1e-8c89-4ccb-9ad9-e61fcb7579a5/kube-rbac-proxy-web/0.log" May 25 01:10:22.028559 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.028536 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_219cca1e-8c89-4ccb-9ad9-e61fcb7579a5/kube-rbac-proxy/0.log" May 25 01:10:22.052151 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.052128 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_219cca1e-8c89-4ccb-9ad9-e61fcb7579a5/kube-rbac-proxy-thanos/0.log" May 25 01:10:22.081192 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.081168 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_219cca1e-8c89-4ccb-9ad9-e61fcb7579a5/init-config-reloader/0.log" May 25 01:10:22.112830 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.112809 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-q5kz8_a88a0f02-c9c5-474c-9f36-6dfc3b1a5629/prometheus-operator/0.log" May 25 01:10:22.133498 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.133475 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-q5kz8_a88a0f02-c9c5-474c-9f36-6dfc3b1a5629/kube-rbac-proxy/0.log" May 25 01:10:22.192608 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.192587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68b6687d65-mf82h_8ce76847-c8e1-4170-9cd2-457fa5278c76/telemeter-client/0.log" May 25 01:10:22.215881 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.215854 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68b6687d65-mf82h_8ce76847-c8e1-4170-9cd2-457fa5278c76/reload/0.log" May 25 01:10:22.250162 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.250139 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68b6687d65-mf82h_8ce76847-c8e1-4170-9cd2-457fa5278c76/kube-rbac-proxy/0.log" May 25 01:10:22.330103 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.330078 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8b644b7c-hkj8g_2135d6fe-9c7b-4560-9422-59c651c73272/thanos-query/0.log" May 25 01:10:22.380019 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.379992 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8b644b7c-hkj8g_2135d6fe-9c7b-4560-9422-59c651c73272/kube-rbac-proxy-web/0.log" May 25 01:10:22.409077 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.409052 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8b644b7c-hkj8g_2135d6fe-9c7b-4560-9422-59c651c73272/kube-rbac-proxy/0.log" May 25 01:10:22.432583 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.432561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8b644b7c-hkj8g_2135d6fe-9c7b-4560-9422-59c651c73272/prom-label-proxy/0.log" May 25 01:10:22.455313 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.455285 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8b644b7c-hkj8g_2135d6fe-9c7b-4560-9422-59c651c73272/kube-rbac-proxy-rules/0.log" May 25 01:10:22.480548 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:22.480523 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8b644b7c-hkj8g_2135d6fe-9c7b-4560-9422-59c651c73272/kube-rbac-proxy-metrics/0.log" May 25 01:10:25.890220 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.890170 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g"] May 25 01:10:25.902890 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.902861 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g"] May 25 01:10:25.903044 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.902977 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:25.905546 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.905515 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8phq\"/\"openshift-service-ca.crt\"" May 25 01:10:25.905692 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.905554 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g8phq\"/\"default-dockercfg-dm52t\"" May 25 01:10:25.906665 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.906640 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8phq\"/\"kube-root-ca.crt\"" May 25 01:10:25.967046 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.967006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-lib-modules\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:25.967225 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.967072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nbwz\" (UniqueName: \"kubernetes.io/projected/a92bccbb-47c7-4ca7-896d-da8ae851a147-kube-api-access-8nbwz\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:25.967225 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.967090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-podres\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:25.967225 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.967110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-sys\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:25.967225 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:25.967132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-proc\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068586 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068549 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-lib-modules\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068746 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068614 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nbwz\" (UniqueName: \"kubernetes.io/projected/a92bccbb-47c7-4ca7-896d-da8ae851a147-kube-api-access-8nbwz\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068746 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068642 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-podres\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068746 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068663 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-sys\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068746 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068683 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-proc\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068930 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068740 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-lib-modules\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068930 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-sys\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068930 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068786 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-proc\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.068930 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.068797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a92bccbb-47c7-4ca7-896d-da8ae851a147-podres\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.077637 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.077605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nbwz\" (UniqueName: \"kubernetes.io/projected/a92bccbb-47c7-4ca7-896d-da8ae851a147-kube-api-access-8nbwz\") pod \"perf-node-gather-daemonset-5tx8g\" (UID: \"a92bccbb-47c7-4ca7-896d-da8ae851a147\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.214836 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.214738 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:26.345474 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.345449 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g"] May 25 01:10:26.348353 ip-10-0-128-11 kubenswrapper[2576]: W0525 01:10:26.348325 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda92bccbb_47c7_4ca7_896d_da8ae851a147.slice/crio-8d32dfb11b67821aebcdac7f8169bbfc62150ded519828bd919e8e7b7c3e56e4 WatchSource:0}: Error finding container 8d32dfb11b67821aebcdac7f8169bbfc62150ded519828bd919e8e7b7c3e56e4: Status 404 returned error can't find the container with id 8d32dfb11b67821aebcdac7f8169bbfc62150ded519828bd919e8e7b7c3e56e4 May 25 01:10:26.562762 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.562722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tbrtc_c4b945e3-319a-43c7-b993-89eb18d5e1e4/dns/0.log" May 25 01:10:26.584478 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.584446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tbrtc_c4b945e3-319a-43c7-b993-89eb18d5e1e4/kube-rbac-proxy/0.log" May 25 01:10:26.606752 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:26.606724 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7mf9_ffe78edd-189b-4a93-90cc-5f2c97d9a6cd/dns-node-resolver/0.log" May 25 01:10:27.084061 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:27.084034 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b7f5bdb8b-x27lw_4226d4cf-0139-4ce3-8bec-5cb54a6f6e47/registry/0.log" May 25 01:10:27.110688 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:27.110650 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" event={"ID":"a92bccbb-47c7-4ca7-896d-da8ae851a147","Type":"ContainerStarted","Data":"0a3d4d952a84e8a2986ac99d7eb20dd118e770145772884e2d8ec01c9fbabaab"} May 25 01:10:27.110688 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:27.110690 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" event={"ID":"a92bccbb-47c7-4ca7-896d-da8ae851a147","Type":"ContainerStarted","Data":"8d32dfb11b67821aebcdac7f8169bbfc62150ded519828bd919e8e7b7c3e56e4"} May 25 01:10:27.110928 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:27.110789 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:27.128636 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:27.128584 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" podStartSLOduration=2.128567216 podStartE2EDuration="2.128567216s" podCreationTimestamp="2026-05-25 01:10:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:10:27.127096141 +0000 UTC m=+470.202155987" watchObservedRunningTime="2026-05-25 01:10:27.128567216 +0000 UTC m=+470.203627063" May 25 01:10:27.164453 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:27.164426 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqxcg_f3189d30-4fd7-4b96-8241-d79fdc007377/node-ca/0.log" May 25 01:10:28.022607 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:28.022575 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-htpq5_9ecb035c-3163-411c-8d3c-fb39c944ad46/discovery/0.log" May 25 01:10:28.041305 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:28.041269 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b5b59cdf9-gmqr2_1d1ee4c2-796a-4ce0-a484-bdf7cf808ef7/kube-auth-proxy/0.log" May 25 01:10:28.584002 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:28.583971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fzm75_2a0f2312-f21f-44b0-9f83-32d57e6aa1fe/serve-healthcheck-canary/0.log" May 25 01:10:29.121150 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:29.121116 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ddk6t_48ff4b7e-8cf5-4ca0-9c00-006d04b81532/kube-rbac-proxy/0.log" May 25 01:10:29.161843 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:29.161812 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ddk6t_48ff4b7e-8cf5-4ca0-9c00-006d04b81532/exporter/0.log" May 25 01:10:29.199358 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:29.199330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ddk6t_48ff4b7e-8cf5-4ca0-9c00-006d04b81532/extractor/0.log" May 25 01:10:30.901282 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:30.901253 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-ltcwj_4516c595-47af-406a-9bb7-1e975d17a8fd/manager/0.log" May 25 01:10:30.926271 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:30.926246 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-zmzlf_6e8cb494-d348-4aaa-b146-f58a4dda37c3/manager/1.log" May 25 01:10:30.934113 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:30.934091 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-zmzlf_6e8cb494-d348-4aaa-b146-f58a4dda37c3/manager/2.log" May 25 01:10:31.007147 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:31.007110 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68d974c4c6-sqcrc_a6354102-0e2e-4dda-83d9-4eff69507125/manager/0.log" May 25 01:10:33.124424 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:33.124397 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-5tx8g" May 25 01:10:36.425806 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:36.425773 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kb87d_3ac23afe-892e-4a94-ac11-791cfdf7549a/kube-storage-version-migrator-operator/1.log" May 25 01:10:36.427599 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:36.427578 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kb87d_3ac23afe-892e-4a94-ac11-791cfdf7549a/kube-storage-version-migrator-operator/0.log" May 25 01:10:38.004237 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.004197 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w8f62_c4cacf21-ff59-4e12-8f9b-130673bfc29f/kube-multus-additional-cni-plugins/0.log" May 25 01:10:38.035238 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.035191 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w8f62_c4cacf21-ff59-4e12-8f9b-130673bfc29f/egress-router-binary-copy/0.log" May 25 01:10:38.070268 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.070205 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w8f62_c4cacf21-ff59-4e12-8f9b-130673bfc29f/cni-plugins/0.log" May 25 01:10:38.099389 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.099347 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w8f62_c4cacf21-ff59-4e12-8f9b-130673bfc29f/bond-cni-plugin/0.log" May 25 01:10:38.127199 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.127176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w8f62_c4cacf21-ff59-4e12-8f9b-130673bfc29f/routeoverride-cni/0.log" May 25 01:10:38.155128 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.155109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w8f62_c4cacf21-ff59-4e12-8f9b-130673bfc29f/whereabouts-cni-bincopy/0.log" May 25 01:10:38.183462 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.183393 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w8f62_c4cacf21-ff59-4e12-8f9b-130673bfc29f/whereabouts-cni/0.log" May 25 01:10:38.249955 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.249915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kdn9g_727e87f7-0bbf-41c3-8e71-5f5b7be641fa/kube-multus/0.log" May 25 01:10:38.303180 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.303155 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b4pxg_3f49e520-69c0-4518-917d-9b40ce19c4ea/network-metrics-daemon/0.log" May 25 01:10:38.325978 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:38.325957 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b4pxg_3f49e520-69c0-4518-917d-9b40ce19c4ea/kube-rbac-proxy/0.log" May 25 01:10:39.759603 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:39.759572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5l7k_8d257155-006f-422f-a108-6143220e0ca1/ovn-controller/0.log" May 25 01:10:39.779929 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:39.779860 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5l7k_8d257155-006f-422f-a108-6143220e0ca1/ovn-acl-logging/0.log" May 25 01:10:39.798641 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:39.798618 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5l7k_8d257155-006f-422f-a108-6143220e0ca1/kube-rbac-proxy-node/0.log" May 25 01:10:39.817460 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:39.817434 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5l7k_8d257155-006f-422f-a108-6143220e0ca1/kube-rbac-proxy-ovn-metrics/0.log" May 25 01:10:39.833528 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:39.833505 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5l7k_8d257155-006f-422f-a108-6143220e0ca1/northd/0.log" May 25 01:10:39.851843 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:39.851818 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5l7k_8d257155-006f-422f-a108-6143220e0ca1/nbdb/0.log" May 25 01:10:39.871154 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:39.871132 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5l7k_8d257155-006f-422f-a108-6143220e0ca1/sbdb/0.log" May 25 01:10:40.040573 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:40.040500 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5l7k_8d257155-006f-422f-a108-6143220e0ca1/ovnkube-controller/0.log" May 25 01:10:41.136106 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:41.136078 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-s4sqq_4c1d0c44-3976-45a8-be1a-410e9225fc42/network-check-target-container/0.log" May 25 01:10:42.070760 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:42.070731 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-gr8cn_37f2f933-7033-41c6-9545-0988d7ec6ef6/iptables-alerter/0.log" May 25 01:10:42.811090 ip-10-0-128-11 kubenswrapper[2576]: I0525 01:10:42.811035 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9tdfv_6f55b4ba-337f-4abf-8533-3ca933aa0426/tuned/0.log"