May 29 10:04:57.524213 ip-10-0-136-71 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 29 10:04:57.524229 ip-10-0-136-71 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 29 10:04:57.524240 ip-10-0-136-71 systemd[1]: kubelet.service: Failed with result 'resources'. May 29 10:04:57.524560 ip-10-0-136-71 systemd[1]: Failed to start Kubernetes Kubelet. May 29 10:05:08.934575 ip-10-0-136-71 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 29 10:05:08.934591 ip-10-0-136-71 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1429cf9a5c744854bf95af145cc938fb -- May 29 10:07:58.219265 ip-10-0-136-71 systemd[1]: Starting Kubernetes Kubelet... May 29 10:07:58.757144 ip-10-0-136-71 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 10:07:58.757144 ip-10-0-136-71 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 10:07:58.757144 ip-10-0-136-71 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 10:07:58.757144 ip-10-0-136-71 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 10:07:58.757144 ip-10-0-136-71 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 10:07:58.760480 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.760389 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 10:07:58.765047 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765022 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:07:58.765047 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765041 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:07:58.765047 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765045 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:07:58.765047 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765050 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:07:58.765047 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765053 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765056 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765059 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765062 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765065 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765067 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765070 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765073 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765075 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765078 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765081 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765083 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765086 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765088 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765091 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765094 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765097 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765100 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765103 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765105 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:07:58.765245 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765108 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765115 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765118 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765121 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765123 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765125 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765128 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765131 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765133 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765137 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765139 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765142 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765145 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765147 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765152 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765154 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765157 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765160 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765163 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:07:58.765725 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765165 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765168 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765172 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765194 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765198 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765201 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765204 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765207 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765209 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765212 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765215 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765217 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765220 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765222 2575 feature_gate.go:328] unrecognized feature gate: Example May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765225 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765227 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765230 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765232 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765237 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765242 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:07:58.766219 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765245 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765248 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765251 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765254 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765258 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765263 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765267 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765272 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765275 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765278 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765280 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765283 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765285 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765288 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765290 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765294 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765297 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765299 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765302 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:07:58.766698 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765304 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765307 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765310 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765313 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765721 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765726 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765729 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765732 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765735 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765738 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765741 2575 feature_gate.go:328] unrecognized feature gate: Example May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765744 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765746 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765749 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765752 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765754 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765757 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765761 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765765 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765768 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:07:58.767164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765771 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765774 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765777 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765780 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765783 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765786 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765789 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765791 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765795 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765797 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765800 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765802 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765805 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765807 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765810 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765812 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765815 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765818 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765820 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765823 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:07:58.767636 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765841 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765844 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765847 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765850 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765852 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765855 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765857 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765860 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765862 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765865 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765867 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765870 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765873 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765876 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765878 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765881 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765886 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765889 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765892 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:07:58.768184 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765895 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765897 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765900 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765903 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765905 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765908 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765911 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765914 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765916 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765919 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765922 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765924 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765927 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765929 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765933 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765936 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765938 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765941 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765944 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:07:58.768644 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765946 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765949 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765952 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765955 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765958 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765960 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765963 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765966 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765968 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765971 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765973 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.765976 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767267 2575 flags.go:64] FLAG: --address="0.0.0.0" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767277 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767284 2575 flags.go:64] FLAG: --anonymous-auth="true" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767289 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767300 2575 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767304 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767308 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767313 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767316 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 10:07:58.769123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767319 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767323 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767326 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767329 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767332 2575 flags.go:64] FLAG: --cgroup-root="" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767335 2575 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767339 2575 flags.go:64] FLAG: --client-ca-file="" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767342 2575 flags.go:64] FLAG: --cloud-config="" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767344 2575 flags.go:64] FLAG: --cloud-provider="external" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767348 2575 flags.go:64] FLAG: --cluster-dns="[]" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767351 2575 flags.go:64] FLAG: --cluster-domain="" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767354 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767357 2575 flags.go:64] FLAG: --config-dir="" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767360 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767363 2575 flags.go:64] FLAG: --container-log-max-files="5" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767367 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767370 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767373 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767376 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767379 2575 flags.go:64] FLAG: --contention-profiling="false" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767382 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767385 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767388 2575 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767391 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767395 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 10:07:58.769644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767398 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767401 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767404 2575 flags.go:64] FLAG: --enable-load-reader="false" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767407 2575 flags.go:64] FLAG: --enable-server="true" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767410 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767414 2575 flags.go:64] FLAG: --event-burst="100" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767417 2575 flags.go:64] FLAG: --event-qps="50" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767421 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767425 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767428 2575 flags.go:64] FLAG: --eviction-hard="" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767432 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767435 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767438 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767441 2575 flags.go:64] FLAG: --eviction-soft="" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767444 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767447 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767449 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767452 2575 flags.go:64] FLAG: --experimental-mounter-path="" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767455 2575 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767458 2575 flags.go:64] FLAG: --fail-swap-on="true" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767461 2575 flags.go:64] FLAG: --feature-gates="" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767465 2575 flags.go:64] FLAG: --file-check-frequency="20s" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767468 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767471 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767474 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767477 2575 flags.go:64] FLAG: --healthz-port="10248" May 29 10:07:58.770263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767481 2575 flags.go:64] FLAG: --help="false" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767484 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-71.ec2.internal" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767487 2575 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767490 2575 flags.go:64] FLAG: --http-check-frequency="20s" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767493 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767497 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767500 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767503 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767506 2575 flags.go:64] FLAG: --image-service-endpoint="" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767509 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767513 2575 flags.go:64] FLAG: --kube-api-burst="100" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767516 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767519 2575 flags.go:64] FLAG: --kube-api-qps="50" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767522 2575 flags.go:64] FLAG: --kube-reserved="" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767525 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767528 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767531 2575 flags.go:64] FLAG: --kubelet-cgroups="" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767534 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767537 2575 flags.go:64] FLAG: --lock-file="" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767540 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767543 2575 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767546 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767552 2575 flags.go:64] FLAG: --log-json-split-stream="false" May 29 10:07:58.770908 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767554 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767557 2575 flags.go:64] FLAG: --log-text-split-stream="false" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767560 2575 flags.go:64] FLAG: --logging-format="text" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767563 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767566 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767569 2575 flags.go:64] FLAG: --manifest-url="" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767572 2575 flags.go:64] FLAG: --manifest-url-header="" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767576 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767579 2575 flags.go:64] FLAG: --max-open-files="1000000" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767583 2575 flags.go:64] FLAG: --max-pods="110" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767586 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767589 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767592 2575 flags.go:64] FLAG: --memory-manager-policy="None" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767595 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767598 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767604 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767607 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767614 2575 flags.go:64] FLAG: --node-status-max-images="50" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767620 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767624 2575 flags.go:64] FLAG: --oom-score-adj="-999" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767627 2575 flags.go:64] FLAG: --pod-cidr="" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767631 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767636 2575 flags.go:64] FLAG: --pod-manifest-path="" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767639 2575 flags.go:64] FLAG: --pod-max-pids="-1" May 29 10:07:58.771464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767642 2575 flags.go:64] FLAG: --pods-per-core="0" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767646 2575 flags.go:64] FLAG: --port="10250" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767649 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767652 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-050803b8b560081e3" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767655 2575 flags.go:64] FLAG: --qos-reserved="" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767658 2575 flags.go:64] FLAG: --read-only-port="10255" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767661 2575 flags.go:64] FLAG: --register-node="true" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767664 2575 flags.go:64] FLAG: --register-schedulable="true" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767667 2575 flags.go:64] FLAG: --register-with-taints="" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767671 2575 flags.go:64] FLAG: --registry-burst="10" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767674 2575 flags.go:64] FLAG: --registry-qps="5" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767676 2575 flags.go:64] FLAG: --reserved-cpus="" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767679 2575 flags.go:64] FLAG: --reserved-memory="" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767683 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767686 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767689 2575 flags.go:64] FLAG: --rotate-certificates="false" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767692 2575 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767695 2575 flags.go:64] FLAG: --runonce="false" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767698 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767701 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767703 2575 flags.go:64] FLAG: --seccomp-default="false" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767706 2575 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767709 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767714 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767717 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767720 2575 flags.go:64] FLAG: --storage-driver-password="root" May 29 10:07:58.772062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767723 2575 flags.go:64] FLAG: --storage-driver-secure="false" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767727 2575 flags.go:64] FLAG: --storage-driver-table="stats" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767730 2575 flags.go:64] FLAG: --storage-driver-user="root" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767734 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767737 2575 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767740 2575 flags.go:64] FLAG: --system-cgroups="" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767743 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767748 2575 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767751 2575 flags.go:64] FLAG: --tls-cert-file="" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767754 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767757 2575 flags.go:64] FLAG: --tls-min-version="" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767760 2575 flags.go:64] FLAG: --tls-private-key-file="" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767763 2575 flags.go:64] FLAG: --topology-manager-policy="none" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767766 2575 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767769 2575 flags.go:64] FLAG: --topology-manager-scope="container" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767772 2575 flags.go:64] FLAG: --v="2" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767776 2575 flags.go:64] FLAG: --version="false" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767780 2575 flags.go:64] FLAG: --vmodule="" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767785 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.767788 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767894 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767898 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767901 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767904 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:07:58.772722 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767907 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767910 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767912 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767915 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767918 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767922 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767925 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767927 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767930 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767933 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767936 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767938 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767941 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767944 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767947 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767950 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767954 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767957 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767960 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:07:58.773302 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767963 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767966 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767969 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767971 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767974 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767977 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767980 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767983 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767986 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767988 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767990 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767993 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767996 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.767998 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768001 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768003 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768006 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768008 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768012 2575 feature_gate.go:328] unrecognized feature gate: Example May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768015 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:07:58.773836 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768017 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768020 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768023 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768025 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768028 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768030 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768033 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768036 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768038 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768041 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768043 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768046 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768048 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768051 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768053 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768056 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768058 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768061 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768063 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:07:58.774327 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768066 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768068 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768071 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768073 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768076 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768078 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768081 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768083 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768087 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768091 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768094 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768098 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768101 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768103 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768106 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768109 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768111 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768114 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768116 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768119 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:07:58.774848 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768122 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768124 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768127 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.768129 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.768138 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.774815 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.774850 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774899 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774905 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774909 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774912 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774916 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774919 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774922 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774925 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:07:58.775345 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774928 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774932 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774936 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774939 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774942 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774945 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774948 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774951 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774953 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774956 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774959 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774961 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774964 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774966 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774969 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774972 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774974 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774977 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774980 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774982 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:07:58.775727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774985 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774988 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774990 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774995 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.774998 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775000 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775003 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775006 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775008 2575 feature_gate.go:328] unrecognized feature gate: Example May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775011 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775014 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775016 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775019 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775021 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775024 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775026 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775029 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775031 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775034 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775036 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:07:58.776252 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775039 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775041 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775044 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775047 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775049 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775052 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775054 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775057 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775059 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775062 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775064 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775067 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775069 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775072 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775074 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775078 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775082 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775085 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775087 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775090 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:07:58.776750 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775092 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775095 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775097 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775100 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775104 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775107 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775109 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775112 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775114 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775117 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775119 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775122 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775124 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775127 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775129 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775132 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775134 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:07:58.777264 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775136 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.775142 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775265 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775271 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775274 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775277 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775280 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775282 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775284 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775287 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775290 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775293 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775297 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775299 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775302 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:07:58.777671 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775305 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775308 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775311 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775313 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775316 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775318 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775321 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775323 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775327 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775329 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775332 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775334 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775337 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775339 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775343 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775348 2575 feature_gate.go:328] unrecognized feature gate: Example May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775351 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775354 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775357 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775360 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:07:58.778064 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775363 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775365 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775368 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775370 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775373 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775376 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775378 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775381 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775384 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775387 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775390 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775393 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775396 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775398 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775401 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775403 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775406 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775408 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775411 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775414 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:07:58.778550 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775416 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775419 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775421 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775424 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775426 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775429 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775431 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775434 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775438 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775441 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775444 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775447 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775449 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775452 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775454 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775457 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775459 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775462 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775464 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:07:58.779199 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775468 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775471 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775473 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775476 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775479 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775482 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775484 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775487 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775489 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775492 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775494 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775497 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775499 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:58.775501 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.775506 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 10:07:58.779699 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.776310 2575 server.go:962] "Client rotation is on, will bootstrap in background" May 29 10:07:58.780105 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.778572 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 10:07:58.780105 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.779590 2575 server.go:1019] "Starting client certificate rotation" May 29 10:07:58.780105 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.779688 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 10:07:58.780105 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.779727 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 10:07:58.808304 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.808288 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 10:07:58.810278 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.810255 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 10:07:58.828876 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.828848 2575 log.go:25] "Validated CRI v1 runtime API" May 29 10:07:58.835113 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.835091 2575 log.go:25] "Validated CRI v1 image API" May 29 10:07:58.836555 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.836533 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 10:07:58.839600 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.839583 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 10:07:58.839820 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.839799 2575 fs.go:135] Filesystem UUIDs: map[07a56618-0a90-4244-8627-513981df1944:/dev/nvme0n1p4 09bfd3c8-9532-4709-8e44-8d09d8e75ba7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 29 10:07:58.839868 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.839821 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 10:07:58.844463 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.844345 2575 manager.go:217] Machine: {Timestamp:2026-05-29 10:07:58.843784967 +0000 UTC m=+0.476826113 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099880 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d2e27602974a8354e76a8248ca662 SystemUUID:ec2d2e27-6029-74a8-354e-76a8248ca662 BootID:1429cf9a-5c74-4854-bf95-af145cc938fb Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c0:4b:07:f8:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c0:4b:07:f8:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:ba:3e:df:6c:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 10:07:58.845318 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.845306 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 10:07:58.845420 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.845406 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 10:07:58.849459 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.849432 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 10:07:58.849615 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.849461 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-71.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 10:07:58.849659 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.849625 2575 topology_manager.go:138] "Creating topology manager with none policy" May 29 10:07:58.849659 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.849635 2575 container_manager_linux.go:306] "Creating device plugin manager" May 29 10:07:58.849659 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.849647 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 10:07:58.849743 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.849666 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 10:07:58.851585 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.851572 2575 state_mem.go:36] "Initialized new in-memory state store" May 29 10:07:58.851704 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.851695 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 10:07:58.854567 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.854555 2575 kubelet.go:491] "Attempting to sync node with API server" May 29 10:07:58.854612 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.854573 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 10:07:58.854612 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.854590 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 10:07:58.854612 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.854600 2575 kubelet.go:397] "Adding apiserver pod source" May 29 10:07:58.854612 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.854613 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 10:07:58.856001 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.855987 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 10:07:58.856055 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.856008 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 10:07:58.859546 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.859526 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 29 10:07:58.862002 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.861984 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 10:07:58.864291 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864278 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 10:07:58.864291 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864296 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864321 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864328 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864336 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864342 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864348 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864353 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864360 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864366 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864378 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 10:07:58.864391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.864384 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 10:07:58.865374 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.865363 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 10:07:58.865374 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.865373 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 10:07:58.865754 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.865718 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 29 10:07:58.865880 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.865857 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 29 10:07:58.868539 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.868524 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 10:07:58.868584 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.868563 2575 server.go:1295] "Started kubelet" May 29 10:07:58.868751 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.868714 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 10:07:58.868877 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.868759 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 10:07:58.868945 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.868884 2575 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 10:07:58.869220 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.869196 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-71.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 29 10:07:58.869520 ip-10-0-136-71 systemd[1]: Started Kubernetes Kubelet. May 29 10:07:58.872030 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.872014 2575 server.go:317] "Adding debug handlers to kubelet server" May 29 10:07:58.872539 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.872523 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 10:07:58.874193 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.874174 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8lsb" May 29 10:07:58.879511 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.879436 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 10:07:58.881033 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.881008 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 10:07:58.882087 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.882068 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 10:07:58.882417 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.882253 2575 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 10:07:58.882417 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.882266 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 10:07:58.882528 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.882439 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 10:07:58.882922 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.882583 2575 reconstruct.go:97] "Volume reconstruction finished" May 29 10:07:58.882922 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.882597 2575 reconciler.go:26] "Reconciler: start to sync state" May 29 10:07:58.883058 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883019 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8lsb" May 29 10:07:58.883115 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883059 2575 factory.go:55] Registering systemd factory May 29 10:07:58.883115 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883072 2575 factory.go:223] Registration of the systemd container factory successfully May 29 10:07:58.883293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883275 2575 factory.go:153] Registering CRI-O factory May 29 10:07:58.883293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883293 2575 factory.go:223] Registration of the crio container factory successfully May 29 10:07:58.883417 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883348 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 10:07:58.883417 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883367 2575 factory.go:103] Registering Raw factory May 29 10:07:58.883417 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883381 2575 manager.go:1196] Started watching for new ooms in manager May 29 10:07:58.883539 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.883445 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:58.883874 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.883712 2575 manager.go:319] Starting recovery of all containers May 29 10:07:58.884571 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.883460 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-71.ec2.internal.18b4016355a63dff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-71.ec2.internal,UID:ip-10-0-136-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-71.ec2.internal,},FirstTimestamp:2026-05-29 10:07:58.868536831 +0000 UTC m=+0.501577977,LastTimestamp:2026-05-29 10:07:58.868536831 +0000 UTC m=+0.501577977,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-71.ec2.internal,}" May 29 10:07:58.893864 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.893701 2575 manager.go:324] Recovery completed May 29 10:07:58.898056 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.897890 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:07:58.898929 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.898916 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 10:07:58.901032 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.901013 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientMemory" May 29 10:07:58.901099 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.901043 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasNoDiskPressure" May 29 10:07:58.901099 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.901060 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientPID" May 29 10:07:58.901500 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.901485 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-71.ec2.internal\" not found" node="ip-10-0-136-71.ec2.internal" May 29 10:07:58.901638 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.901626 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 10:07:58.901669 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.901640 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 10:07:58.901699 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.901681 2575 state_mem.go:36] "Initialized new in-memory state store" May 29 10:07:58.905194 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.905179 2575 policy_none.go:49] "None policy: Start" May 29 10:07:58.905245 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.905197 2575 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 10:07:58.905245 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.905208 2575 state_mem.go:35] "Initializing new in-memory state store" May 29 10:07:58.949587 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.949566 2575 manager.go:341] "Starting Device Plugin manager" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.949612 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.949626 2575 server.go:85] "Starting device plugin registration server" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.949924 2575 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.949935 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.950150 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.950281 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:58.950295 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.950790 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 10:07:58.960562 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:58.950846 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.005063 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.005028 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 10:07:59.006310 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.006283 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 10:07:59.006310 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.006304 2575 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 10:07:59.006474 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.006326 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 10:07:59.006474 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.006336 2575 kubelet.go:2451] "Starting kubelet main sync loop" May 29 10:07:59.006474 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.006385 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 10:07:59.012822 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.012767 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:07:59.050054 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.050026 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 10:07:59.051071 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.051053 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientMemory" May 29 10:07:59.051196 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.051083 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasNoDiskPressure" May 29 10:07:59.051196 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.051092 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientPID" May 29 10:07:59.051196 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.051117 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-71.ec2.internal" May 29 10:07:59.060085 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.060056 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-71.ec2.internal" May 29 10:07:59.060188 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.060090 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-71.ec2.internal\": node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.082562 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.082529 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.106898 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.106810 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal"] May 29 10:07:59.106984 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.106959 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 10:07:59.108757 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.108740 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientMemory" May 29 10:07:59.108883 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.108796 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasNoDiskPressure" May 29 10:07:59.108883 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.108812 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientPID" May 29 10:07:59.109976 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.109960 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 10:07:59.110137 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.110121 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:07:59.110185 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.110157 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 10:07:59.113264 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.113241 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientMemory" May 29 10:07:59.113373 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.113269 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasNoDiskPressure" May 29 10:07:59.113373 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.113243 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientMemory" May 29 10:07:59.113373 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.113284 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientPID" May 29 10:07:59.113373 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.113305 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasNoDiskPressure" May 29 10:07:59.113373 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.113323 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientPID" May 29 10:07:59.114367 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.114352 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" May 29 10:07:59.114450 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.114382 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 10:07:59.115114 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.115101 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientMemory" May 29 10:07:59.115195 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.115128 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasNoDiskPressure" May 29 10:07:59.115195 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.115141 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeHasSufficientPID" May 29 10:07:59.139633 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.139608 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-71.ec2.internal\" not found" node="ip-10-0-136-71.ec2.internal" May 29 10:07:59.144017 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.143998 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-71.ec2.internal\" not found" node="ip-10-0-136-71.ec2.internal" May 29 10:07:59.183376 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.183338 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.184522 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.184507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4a5a68d22a5b2932ba3902cb698cbdf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal\" (UID: \"e4a5a68d22a5b2932ba3902cb698cbdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:07:59.184574 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.184530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4a5a68d22a5b2932ba3902cb698cbdf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal\" (UID: \"e4a5a68d22a5b2932ba3902cb698cbdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:07:59.184574 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.184556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7e4a7adf99a1fd4c9ab0a27defd1d89-config\") pod \"kube-apiserver-proxy-ip-10-0-136-71.ec2.internal\" (UID: \"a7e4a7adf99a1fd4c9ab0a27defd1d89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" May 29 10:07:59.283488 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.283426 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.285592 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.285573 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4a5a68d22a5b2932ba3902cb698cbdf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal\" (UID: \"e4a5a68d22a5b2932ba3902cb698cbdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:07:59.285645 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.285607 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4a5a68d22a5b2932ba3902cb698cbdf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal\" (UID: \"e4a5a68d22a5b2932ba3902cb698cbdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:07:59.285645 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.285627 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7e4a7adf99a1fd4c9ab0a27defd1d89-config\") pod \"kube-apiserver-proxy-ip-10-0-136-71.ec2.internal\" (UID: \"a7e4a7adf99a1fd4c9ab0a27defd1d89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" May 29 10:07:59.285724 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.285676 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4a5a68d22a5b2932ba3902cb698cbdf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal\" (UID: \"e4a5a68d22a5b2932ba3902cb698cbdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:07:59.285724 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.285680 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4a5a68d22a5b2932ba3902cb698cbdf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal\" (UID: \"e4a5a68d22a5b2932ba3902cb698cbdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:07:59.285724 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.285701 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7e4a7adf99a1fd4c9ab0a27defd1d89-config\") pod \"kube-apiserver-proxy-ip-10-0-136-71.ec2.internal\" (UID: \"a7e4a7adf99a1fd4c9ab0a27defd1d89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" May 29 10:07:59.383840 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.383795 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.442119 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.442098 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:07:59.446564 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.446540 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" May 29 10:07:59.484210 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.484176 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.584650 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.584583 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.685098 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.685070 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.779377 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.779346 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 10:07:59.779924 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.779513 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 10:07:59.779924 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.779524 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 10:07:59.785635 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.785614 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.881977 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.881949 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 10:07:59.885272 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.885243 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 10:02:58 +0000 UTC" deadline="2028-01-11 03:52:39.617181666 +0000 UTC" May 29 10:07:59.885272 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.885270 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14201h44m39.731913904s" May 29 10:07:59.886342 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.886318 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.892001 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.891978 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 10:07:59.917318 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.917292 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zclg6" May 29 10:07:59.927420 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:07:59.927396 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zclg6" May 29 10:07:59.986538 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:07:59.986518 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:07:59.997700 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:59.997669 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e4a7adf99a1fd4c9ab0a27defd1d89.slice/crio-bf26f91fe4e03a267ffb0e79c5ce36ca6cf2a009ef72675b90af3eb9a59c549a WatchSource:0}: Error finding container bf26f91fe4e03a267ffb0e79c5ce36ca6cf2a009ef72675b90af3eb9a59c549a: Status 404 returned error can't find the container with id bf26f91fe4e03a267ffb0e79c5ce36ca6cf2a009ef72675b90af3eb9a59c549a May 29 10:07:59.997896 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:07:59.997877 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a5a68d22a5b2932ba3902cb698cbdf.slice/crio-cef6a781d40cb660407de512a532bf6c32c5ee508dbd7d7e579a25ced31373ea WatchSource:0}: Error finding container cef6a781d40cb660407de512a532bf6c32c5ee508dbd7d7e579a25ced31373ea: Status 404 returned error can't find the container with id cef6a781d40cb660407de512a532bf6c32c5ee508dbd7d7e579a25ced31373ea May 29 10:08:00.001941 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.001927 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 10:08:00.009705 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.009664 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" event={"ID":"a7e4a7adf99a1fd4c9ab0a27defd1d89","Type":"ContainerStarted","Data":"bf26f91fe4e03a267ffb0e79c5ce36ca6cf2a009ef72675b90af3eb9a59c549a"} May 29 10:08:00.011155 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.011134 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" event={"ID":"e4a5a68d22a5b2932ba3902cb698cbdf","Type":"ContainerStarted","Data":"cef6a781d40cb660407de512a532bf6c32c5ee508dbd7d7e579a25ced31373ea"} May 29 10:08:00.087518 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:00.087476 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:08:00.142893 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.142814 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:08:00.188026 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:00.187992 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-71.ec2.internal\" not found" May 29 10:08:00.283537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.283508 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:08:00.383380 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.383136 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" May 29 10:08:00.396678 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.396597 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 10:08:00.397992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.397969 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" May 29 10:08:00.409339 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.409297 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 10:08:00.649851 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.649751 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:08:00.855494 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.855464 2575 apiserver.go:52] "Watching apiserver" May 29 10:08:00.861037 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.861014 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 10:08:00.862474 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.862448 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf","openshift-image-registry/node-ca-njxbt","openshift-multus/multus-additional-cni-plugins-ks5bs","openshift-multus/multus-gjd7g","openshift-multus/network-metrics-daemon-b5znn","openshift-network-diagnostics/network-check-target-f6vs6","openshift-network-operator/iptables-alerter-8zfjs","openshift-ovn-kubernetes/ovnkube-node-7pz67","kube-system/konnectivity-agent-t4tvr","kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wssjx","openshift-dns/node-resolver-8tlwz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal"] May 29 10:08:00.865040 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.865020 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.867135 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.867117 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:00.867786 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.867753 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rcgdb\"" May 29 10:08:00.867964 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.867940 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 10:08:00.868111 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.867992 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 10:08:00.868111 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.867992 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 10:08:00.869156 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.868994 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 10:08:00.869156 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.869098 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 10:08:00.869378 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.869358 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.870132 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.870116 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8hkzl\"" May 29 10:08:00.871385 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.871351 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 10:08:00.871741 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.871579 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gjd7g" May 29 10:08:00.874262 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.874114 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 10:08:00.874328 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.874264 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 10:08:00.874473 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.874434 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 10:08:00.874999 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.874978 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 10:08:00.874999 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.874990 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 10:08:00.875478 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.875437 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zh8qc\"" May 29 10:08:00.875897 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.875880 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 10:08:00.876129 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.876107 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w9g8r\"" May 29 10:08:00.876244 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.876226 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:00.876345 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:00.876319 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:00.878494 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.878475 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:00.878579 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:00.878547 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:00.880695 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.880674 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.883231 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.883209 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 10:08:00.883483 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.883466 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 10:08:00.883562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.883525 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 10:08:00.883905 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.883881 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fdkjt\"" May 29 10:08:00.885444 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.885387 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:00.885444 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.885397 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.887298 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.887284 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 10:08:00.887748 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.887727 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.888202 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.888184 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 10:08:00.888363 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.888345 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 10:08:00.888531 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.888513 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lmmfp\"" May 29 10:08:00.888633 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.888612 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 10:08:00.888983 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.888965 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 10:08:00.888983 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.888971 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 10:08:00.889124 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.889107 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 10:08:00.889976 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.889956 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wrb2t\"" May 29 10:08:00.890123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.890109 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:00.890904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.890887 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 10:08:00.890993 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.890890 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r6ddc\"" May 29 10:08:00.891117 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.891091 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 10:08:00.891460 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.891444 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 10:08:00.892534 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.892488 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 10:08:00.892627 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.892506 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jqwmq\"" May 29 10:08:00.892778 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.892598 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 10:08:00.893247 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-k8s-cni-cncf-io\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.893357 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:00.893357 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-node-log\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.893357 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e96459d6-92cc-4ac5-a200-69688559a4dd-iptables-alerter-script\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.893491 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-socket-dir-parent\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.893491 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-cni-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.893491 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-kubelet\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.893491 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-kubelet\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.893491 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-cni-bin\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.893692 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.893692 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-etc-kubernetes\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.893692 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-sys-fs\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.893692 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-cni-netd\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.893692 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72f875f-be72-4db9-ba73-68b9494491fc-ovn-node-metrics-cert\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.893904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94x7z\" (UniqueName: \"kubernetes.io/projected/e96459d6-92cc-4ac5-a200-69688559a4dd-kube-api-access-94x7z\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.893904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-conf-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.893904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893805 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-log-socket\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.893904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-multus-certs\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.893904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-etc-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.893904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/39da41c1-61f6-4523-9e9a-8dd76b2cc723-serviceca\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:00.894153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-system-cni-dir\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.894153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-hostroot\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.894153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.893977 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2fz6\" (UniqueName: \"kubernetes.io/projected/9301b3d6-a026-4f32-b887-c810341d8584-kube-api-access-s2fz6\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.894153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-registration-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.894153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.894153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzcv7\" (UniqueName: \"kubernetes.io/projected/44666ece-c940-4772-a965-70e4879c1abf-kube-api-access-rzcv7\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.894409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-cni-multus\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.894409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894184 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-systemd-units\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.894409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-var-lib-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.894409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.894409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894277 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-cnibin\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.894409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-os-release\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.894409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4vs5\" (UniqueName: \"kubernetes.io/projected/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-kube-api-access-l4vs5\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:00.894409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894446 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-cni-binary-copy\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-cnibin\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-netns\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9301b3d6-a026-4f32-b887-c810341d8584-multus-daemon-config\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894561 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-socket-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-run-netns\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-env-overrides\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjrrz\" (UniqueName: \"kubernetes.io/projected/85f306e0-e2de-4975-be9d-a968a3e37d8d-kube-api-access-hjrrz\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.894728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-ovnkube-config\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb7fv\" (UniqueName: \"kubernetes.io/projected/39da41c1-61f6-4523-9e9a-8dd76b2cc723-kube-api-access-vb7fv\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894837 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-ovnkube-script-lib\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnglz\" (UniqueName: \"kubernetes.io/projected/d72f875f-be72-4db9-ba73-68b9494491fc-kube-api-access-jnglz\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-os-release\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9301b3d6-a026-4f32-b887-c810341d8584-cni-binary-copy\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.894980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-cni-bin\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.895012 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-slash\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.895056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39da41c1-61f6-4523-9e9a-8dd76b2cc723-host\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.895096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-system-cni-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.895120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.895151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-device-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.895179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-systemd\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.895203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-ovn\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.895265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.895225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e96459d6-92cc-4ac5-a200-69688559a4dd-host-slash\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.928588 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.928551 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 10:02:59 +0000 UTC" deadline="2028-01-18 16:48:17.949718136 +0000 UTC" May 29 10:08:00.928588 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.928588 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14382h40m17.021135379s" May 29 10:08:00.984336 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.984299 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 10:08:00.996290 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996254 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996297 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnglz\" (UniqueName: \"kubernetes.io/projected/d72f875f-be72-4db9-ba73-68b9494491fc-kube-api-access-jnglz\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysconfig\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-systemd\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996363 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-tuned\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996406 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-os-release\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996428 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9301b3d6-a026-4f32-b887-c810341d8584-cni-binary-copy\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996474 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-cni-bin\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996496 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-slash\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996523 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-sys\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996547 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39da41c1-61f6-4523-9e9a-8dd76b2cc723-host\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-cni-bin\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996564 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-slash\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996565 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-os-release\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39da41c1-61f6-4523-9e9a-8dd76b2cc723-host\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996572 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-system-cni-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996635 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-system-cni-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996657 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996686 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-device-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996705 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-systemd\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996729 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-ovn\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996778 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-ovn\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996778 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-systemd\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-device-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996812 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e96459d6-92cc-4ac5-a200-69688559a4dd-host-slash\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996862 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-k8s-cni-cncf-io\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996883 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e96459d6-92cc-4ac5-a200-69688559a4dd-host-slash\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.996986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996888 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:00.996800 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.996915 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-node-log\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:00.997005 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs podName:5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:01.496974472 +0000 UTC m=+3.130015629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs") pod "network-metrics-daemon-b5znn" (UID: "5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997133 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-k8s-cni-cncf-io\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997139 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9301b3d6-a026-4f32-b887-c810341d8584-cni-binary-copy\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-kubernetes\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997217 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-node-log\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysctl-d\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-var-lib-kubelet\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997322 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e96459d6-92cc-4ac5-a200-69688559a4dd-iptables-alerter-script\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997356 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-socket-dir-parent\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysctl-conf\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5gr4\" (UniqueName: \"kubernetes.io/projected/6667d0fa-d378-45d0-955f-8aa8f9fe328a-kube-api-access-j5gr4\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-socket-dir-parent\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997471 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-cni-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997504 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-kubelet\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.997733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997529 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-kubelet\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-cni-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997556 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-cni-bin\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-run\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997587 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-kubelet\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997588 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-kubelet\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dskfp\" (UniqueName: \"kubernetes.io/projected/48d38eb1-eec2-4180-9ea6-a43f14ad718e-kube-api-access-dskfp\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997637 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-cni-bin\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997671 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997711 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-etc-kubernetes\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997780 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-sys-fs\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997808 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-etc-kubernetes\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997812 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e96459d6-92cc-4ac5-a200-69688559a4dd-iptables-alerter-script\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997819 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-cni-netd\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997865 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72f875f-be72-4db9-ba73-68b9494491fc-ovn-node-metrics-cert\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997874 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-sys-fs\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997884 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-cni-netd\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.998517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-host\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997922 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94x7z\" (UniqueName: \"kubernetes.io/projected/e96459d6-92cc-4ac5-a200-69688559a4dd-kube-api-access-94x7z\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997947 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-conf-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997970 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-log-socket\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.997995 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-multus-certs\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998041 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-multus-conf-dir\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998064 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-etc-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998044 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-multus-certs\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6667d0fa-d378-45d0-955f-8aa8f9fe328a-tmp-dir\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-log-socket\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998117 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-etc-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998117 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/39da41c1-61f6-4523-9e9a-8dd76b2cc723-serviceca\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998157 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-system-cni-dir\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998186 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-hostroot\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998214 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2fz6\" (UniqueName: \"kubernetes.io/projected/9301b3d6-a026-4f32-b887-c810341d8584-kube-api-access-s2fz6\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998204 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-system-cni-dir\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998244 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-registration-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:00.999300 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998247 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-hostroot\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998269 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-modprobe-d\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-registration-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998320 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-lib-modules\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998341 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998369 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzcv7\" (UniqueName: \"kubernetes.io/projected/44666ece-c940-4772-a965-70e4879c1abf-kube-api-access-rzcv7\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998394 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-cni-multus\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998419 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-systemd-units\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998448 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-var-lib-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998469 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998466 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/39da41c1-61f6-4523-9e9a-8dd76b2cc723-serviceca\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998493 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-cnibin\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998486 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-var-lib-cni-multus\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998518 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-os-release\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-var-lib-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998543 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4vs5\" (UniqueName: \"kubernetes.io/projected/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-kube-api-access-l4vs5\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:01.000134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998567 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-systemd-units\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998569 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998597 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998611 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998623 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-cni-binary-copy\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998631 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-os-release\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998672 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998673 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-run-openvswitch\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998672 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44666ece-c940-4772-a965-70e4879c1abf-cnibin\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998697 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998729 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-cnibin\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998771 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-netns\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998798 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9301b3d6-a026-4f32-b887-c810341d8584-multus-daemon-config\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998844 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-socket-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998861 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-cnibin\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998870 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-run-netns\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998898 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-env-overrides\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.000694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998925 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjrrz\" (UniqueName: \"kubernetes.io/projected/85f306e0-e2de-4975-be9d-a968a3e37d8d-kube-api-access-hjrrz\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998954 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-ovnkube-config\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.998984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d38eb1-eec2-4180-9ea6-a43f14ad718e-tmp\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6667d0fa-d378-45d0-955f-8aa8f9fe328a-hosts-file\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999039 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vb7fv\" (UniqueName: \"kubernetes.io/projected/39da41c1-61f6-4523-9e9a-8dd76b2cc723-kube-api-access-vb7fv\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999065 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999092 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-ovnkube-script-lib\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999106 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-cni-binary-copy\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999119 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee4f8337-3c9e-43a0-bb2d-2094b6545e4f-agent-certs\") pod \"konnectivity-agent-t4tvr\" (UID: \"ee4f8337-3c9e-43a0-bb2d-2094b6545e4f\") " pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee4f8337-3c9e-43a0-bb2d-2094b6545e4f-konnectivity-ca\") pod \"konnectivity-agent-t4tvr\" (UID: \"ee4f8337-3c9e-43a0-bb2d-2094b6545e4f\") " pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999235 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9301b3d6-a026-4f32-b887-c810341d8584-host-run-netns\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999238 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999640 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44666ece-c940-4772-a965-70e4879c1abf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999691 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72f875f-be72-4db9-ba73-68b9494491fc-host-run-netns\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:00.999970 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-ovnkube-script-lib\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.000065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-env-overrides\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.001274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.000296 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d72f875f-be72-4db9-ba73-68b9494491fc-ovnkube-config\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.001901 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.000419 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85f306e0-e2de-4975-be9d-a968a3e37d8d-socket-dir\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.001901 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.000475 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9301b3d6-a026-4f32-b887-c810341d8584-multus-daemon-config\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.002010 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.001990 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72f875f-be72-4db9-ba73-68b9494491fc-ovn-node-metrics-cert\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.004412 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.004388 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:08:01.005462 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.005440 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:08:01.005543 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.005466 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:08:01.005543 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.005479 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bzkg2 for pod openshift-network-diagnostics/network-check-target-f6vs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:01.005543 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.005537 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2 podName:2100660c-80ac-412b-8f52-5648c846322e nodeName:}" failed. No retries permitted until 2026-05-29 10:08:01.505516869 +0000 UTC m=+3.138558007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bzkg2" (UniqueName: "kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2") pod "network-check-target-f6vs6" (UID: "2100660c-80ac-412b-8f52-5648c846322e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:01.007594 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.007573 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnglz\" (UniqueName: \"kubernetes.io/projected/d72f875f-be72-4db9-ba73-68b9494491fc-kube-api-access-jnglz\") pod \"ovnkube-node-7pz67\" (UID: \"d72f875f-be72-4db9-ba73-68b9494491fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.010291 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.010271 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94x7z\" (UniqueName: \"kubernetes.io/projected/e96459d6-92cc-4ac5-a200-69688559a4dd-kube-api-access-94x7z\") pod \"iptables-alerter-8zfjs\" (UID: \"e96459d6-92cc-4ac5-a200-69688559a4dd\") " pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:01.016764 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.016738 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4vs5\" (UniqueName: \"kubernetes.io/projected/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-kube-api-access-l4vs5\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:01.017564 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.017531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzcv7\" (UniqueName: \"kubernetes.io/projected/44666ece-c940-4772-a965-70e4879c1abf-kube-api-access-rzcv7\") pod \"multus-additional-cni-plugins-ks5bs\" (UID: \"44666ece-c940-4772-a965-70e4879c1abf\") " pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.017950 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.017931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb7fv\" (UniqueName: \"kubernetes.io/projected/39da41c1-61f6-4523-9e9a-8dd76b2cc723-kube-api-access-vb7fv\") pod \"node-ca-njxbt\" (UID: \"39da41c1-61f6-4523-9e9a-8dd76b2cc723\") " pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:01.018324 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.018300 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2fz6\" (UniqueName: \"kubernetes.io/projected/9301b3d6-a026-4f32-b887-c810341d8584-kube-api-access-s2fz6\") pod \"multus-gjd7g\" (UID: \"9301b3d6-a026-4f32-b887-c810341d8584\") " pod="openshift-multus/multus-gjd7g" May 29 10:08:01.018493 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.018473 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjrrz\" (UniqueName: \"kubernetes.io/projected/85f306e0-e2de-4975-be9d-a968a3e37d8d-kube-api-access-hjrrz\") pod \"aws-ebs-csi-driver-node-jk6hf\" (UID: \"85f306e0-e2de-4975-be9d-a968a3e37d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.100712 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.100677 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-run\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.100914 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.100718 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dskfp\" (UniqueName: \"kubernetes.io/projected/48d38eb1-eec2-4180-9ea6-a43f14ad718e-kube-api-access-dskfp\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.100914 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.100786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-run\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.100914 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.100845 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-host\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.100914 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.100871 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6667d0fa-d378-45d0-955f-8aa8f9fe328a-tmp-dir\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:01.100914 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.100900 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-modprobe-d\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.100940 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-host\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.100997 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-lib-modules\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-modprobe-d\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101039 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d38eb1-eec2-4180-9ea6-a43f14ad718e-tmp\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101066 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6667d0fa-d378-45d0-955f-8aa8f9fe328a-hosts-file\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101119 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-lib-modules\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101137 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6667d0fa-d378-45d0-955f-8aa8f9fe328a-hosts-file\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101147 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee4f8337-3c9e-43a0-bb2d-2094b6545e4f-agent-certs\") pod \"konnectivity-agent-t4tvr\" (UID: \"ee4f8337-3c9e-43a0-bb2d-2094b6545e4f\") " pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:01.101204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101182 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee4f8337-3c9e-43a0-bb2d-2094b6545e4f-konnectivity-ca\") pod \"konnectivity-agent-t4tvr\" (UID: \"ee4f8337-3c9e-43a0-bb2d-2094b6545e4f\") " pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101234 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6667d0fa-d378-45d0-955f-8aa8f9fe328a-tmp-dir\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101253 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysconfig\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101293 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-systemd\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101316 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-tuned\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysconfig\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101428 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-sys\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101489 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-systemd\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101491 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-kubernetes\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101527 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysctl-d\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101542 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-kubernetes\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101552 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-var-lib-kubelet\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101594 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysctl-conf\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.101655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5gr4\" (UniqueName: \"kubernetes.io/projected/6667d0fa-d378-45d0-955f-8aa8f9fe328a-kube-api-access-j5gr4\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:01.102241 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101673 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysctl-d\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.102241 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee4f8337-3c9e-43a0-bb2d-2094b6545e4f-konnectivity-ca\") pod \"konnectivity-agent-t4tvr\" (UID: \"ee4f8337-3c9e-43a0-bb2d-2094b6545e4f\") " pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:01.102241 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101812 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-var-lib-kubelet\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.102241 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101871 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-sysctl-conf\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.102241 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.101882 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d38eb1-eec2-4180-9ea6-a43f14ad718e-sys\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.105598 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.103974 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d38eb1-eec2-4180-9ea6-a43f14ad718e-tmp\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.105598 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.104001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48d38eb1-eec2-4180-9ea6-a43f14ad718e-etc-tuned\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.105598 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.104235 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee4f8337-3c9e-43a0-bb2d-2094b6545e4f-agent-certs\") pod \"konnectivity-agent-t4tvr\" (UID: \"ee4f8337-3c9e-43a0-bb2d-2094b6545e4f\") " pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:01.112268 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.112238 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5gr4\" (UniqueName: \"kubernetes.io/projected/6667d0fa-d378-45d0-955f-8aa8f9fe328a-kube-api-access-j5gr4\") pod \"node-resolver-8tlwz\" (UID: \"6667d0fa-d378-45d0-955f-8aa8f9fe328a\") " pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:01.112639 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.112616 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dskfp\" (UniqueName: \"kubernetes.io/projected/48d38eb1-eec2-4180-9ea6-a43f14ad718e-kube-api-access-dskfp\") pod \"tuned-wssjx\" (UID: \"48d38eb1-eec2-4180-9ea6-a43f14ad718e\") " pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.178570 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.178485 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8zfjs" May 29 10:08:01.186293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.186271 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-njxbt" May 29 10:08:01.195934 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.195910 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" May 29 10:08:01.200602 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.200580 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gjd7g" May 29 10:08:01.208357 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.208337 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" May 29 10:08:01.213876 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.213856 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:01.220465 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.220445 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:01.227065 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.227042 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wssjx" May 29 10:08:01.233620 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.233594 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8tlwz" May 29 10:08:01.503632 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.503538 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:01.503776 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.503703 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:01.503776 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.503773 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs podName:5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:02.503757075 +0000 UTC m=+4.136798208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs") pod "network-metrics-daemon-b5znn" (UID: "5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:01.577904 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.577870 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72f875f_be72_4db9_ba73_68b9494491fc.slice/crio-ced888d6d9f19c5e2f85cb3be96d878f9992a4146919325fcfaa8b14fe708d7e WatchSource:0}: Error finding container ced888d6d9f19c5e2f85cb3be96d878f9992a4146919325fcfaa8b14fe708d7e: Status 404 returned error can't find the container with id ced888d6d9f19c5e2f85cb3be96d878f9992a4146919325fcfaa8b14fe708d7e May 29 10:08:01.580334 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.580247 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39da41c1_61f6_4523_9e9a_8dd76b2cc723.slice/crio-d0cca068c0a8ad9ee80dd28a7dd746bf7bd6e883edbbbdc09fce28e4ee80f10c WatchSource:0}: Error finding container d0cca068c0a8ad9ee80dd28a7dd746bf7bd6e883edbbbdc09fce28e4ee80f10c: Status 404 returned error can't find the container with id d0cca068c0a8ad9ee80dd28a7dd746bf7bd6e883edbbbdc09fce28e4ee80f10c May 29 10:08:01.581613 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.581455 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6667d0fa_d378_45d0_955f_8aa8f9fe328a.slice/crio-2106fd088dfd1a2212300116fdda2e7280750ed53802ab7c44ac7f69d05f17f0 WatchSource:0}: Error finding container 2106fd088dfd1a2212300116fdda2e7280750ed53802ab7c44ac7f69d05f17f0: Status 404 returned error can't find the container with id 2106fd088dfd1a2212300116fdda2e7280750ed53802ab7c44ac7f69d05f17f0 May 29 10:08:01.584526 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.584502 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96459d6_92cc_4ac5_a200_69688559a4dd.slice/crio-38489f7660ae456474699a4e0ed5d9666059f8a1c8c90b85bce9781bbd619e94 WatchSource:0}: Error finding container 38489f7660ae456474699a4e0ed5d9666059f8a1c8c90b85bce9781bbd619e94: Status 404 returned error can't find the container with id 38489f7660ae456474699a4e0ed5d9666059f8a1c8c90b85bce9781bbd619e94 May 29 10:08:01.584787 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.584764 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44666ece_c940_4772_a965_70e4879c1abf.slice/crio-a13ee571a4e919ab45462e09f6081c9e12ab33b4dd35c6470e256f549c3cdd43 WatchSource:0}: Error finding container a13ee571a4e919ab45462e09f6081c9e12ab33b4dd35c6470e256f549c3cdd43: Status 404 returned error can't find the container with id a13ee571a4e919ab45462e09f6081c9e12ab33b4dd35c6470e256f549c3cdd43 May 29 10:08:01.585727 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.585694 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4f8337_3c9e_43a0_bb2d_2094b6545e4f.slice/crio-c5d053d3bcc1bb3c55923a7ff69a245aed0f7e85660a1f29332eb83809846c97 WatchSource:0}: Error finding container c5d053d3bcc1bb3c55923a7ff69a245aed0f7e85660a1f29332eb83809846c97: Status 404 returned error can't find the container with id c5d053d3bcc1bb3c55923a7ff69a245aed0f7e85660a1f29332eb83809846c97 May 29 10:08:01.586637 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.586613 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9301b3d6_a026_4f32_b887_c810341d8584.slice/crio-ecc0fef1db23ef7eade61dc42098267b02121a8b4f9caf7694d0414bc03a966a WatchSource:0}: Error finding container ecc0fef1db23ef7eade61dc42098267b02121a8b4f9caf7694d0414bc03a966a: Status 404 returned error can't find the container with id ecc0fef1db23ef7eade61dc42098267b02121a8b4f9caf7694d0414bc03a966a May 29 10:08:01.588548 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.588528 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d38eb1_eec2_4180_9ea6_a43f14ad718e.slice/crio-f26d868e18300d7fb00310d26dd07d06fcf6895a6183bd5507fecd444dfb46a5 WatchSource:0}: Error finding container f26d868e18300d7fb00310d26dd07d06fcf6895a6183bd5507fecd444dfb46a5: Status 404 returned error can't find the container with id f26d868e18300d7fb00310d26dd07d06fcf6895a6183bd5507fecd444dfb46a5 May 29 10:08:01.588945 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:01.588851 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f306e0_e2de_4975_be9d_a968a3e37d8d.slice/crio-617044e8a3ba8cad5c62637cb389ea63d7a2496a6fa7770ddba3f3ba598f1c7f WatchSource:0}: Error finding container 617044e8a3ba8cad5c62637cb389ea63d7a2496a6fa7770ddba3f3ba598f1c7f: Status 404 returned error can't find the container with id 617044e8a3ba8cad5c62637cb389ea63d7a2496a6fa7770ddba3f3ba598f1c7f May 29 10:08:01.604240 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.604218 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:01.604384 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.604353 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:08:01.604384 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.604366 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:08:01.604384 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.604375 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bzkg2 for pod openshift-network-diagnostics/network-check-target-f6vs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:01.604503 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:01.604429 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2 podName:2100660c-80ac-412b-8f52-5648c846322e nodeName:}" failed. No retries permitted until 2026-05-29 10:08:02.604414878 +0000 UTC m=+4.237456010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzkg2" (UniqueName: "kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2") pod "network-check-target-f6vs6" (UID: "2100660c-80ac-412b-8f52-5648c846322e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:01.931427 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.930256 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 10:02:59 +0000 UTC" deadline="2027-12-14 08:05:11.183557275 +0000 UTC" May 29 10:08:01.931427 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:01.930510 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13533h57m9.253053735s" May 29 10:08:02.007329 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.007292 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:02.007503 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:02.007430 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:02.020502 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.020466 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8tlwz" event={"ID":"6667d0fa-d378-45d0-955f-8aa8f9fe328a","Type":"ContainerStarted","Data":"2106fd088dfd1a2212300116fdda2e7280750ed53802ab7c44ac7f69d05f17f0"} May 29 10:08:02.023256 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.023223 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-njxbt" event={"ID":"39da41c1-61f6-4523-9e9a-8dd76b2cc723","Type":"ContainerStarted","Data":"d0cca068c0a8ad9ee80dd28a7dd746bf7bd6e883edbbbdc09fce28e4ee80f10c"} May 29 10:08:02.026895 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.026864 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" event={"ID":"a7e4a7adf99a1fd4c9ab0a27defd1d89","Type":"ContainerStarted","Data":"dfaf0b806467f1d3cc8ebcf601ec33058cceaba5f4eb33ae5e37813a54094418"} May 29 10:08:02.033182 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.033156 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4tvr" event={"ID":"ee4f8337-3c9e-43a0-bb2d-2094b6545e4f","Type":"ContainerStarted","Data":"c5d053d3bcc1bb3c55923a7ff69a245aed0f7e85660a1f29332eb83809846c97"} May 29 10:08:02.035198 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.035174 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8zfjs" event={"ID":"e96459d6-92cc-4ac5-a200-69688559a4dd","Type":"ContainerStarted","Data":"38489f7660ae456474699a4e0ed5d9666059f8a1c8c90b85bce9781bbd619e94"} May 29 10:08:02.036792 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.036754 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"ced888d6d9f19c5e2f85cb3be96d878f9992a4146919325fcfaa8b14fe708d7e"} May 29 10:08:02.046548 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.046496 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-71.ec2.internal" podStartSLOduration=2.046480418 podStartE2EDuration="2.046480418s" podCreationTimestamp="2026-05-29 10:08:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:08:02.046147542 +0000 UTC m=+3.679188698" watchObservedRunningTime="2026-05-29 10:08:02.046480418 +0000 UTC m=+3.679521575" May 29 10:08:02.052416 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.052385 2575 generic.go:358] "Generic (PLEG): container finished" podID="e4a5a68d22a5b2932ba3902cb698cbdf" containerID="9a679ebc6ebce859026a365a6288d40c49c2b2ad70c114a57efa12cbb058c580" exitCode=0 May 29 10:08:02.052537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.052460 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" event={"ID":"e4a5a68d22a5b2932ba3902cb698cbdf","Type":"ContainerDied","Data":"9a679ebc6ebce859026a365a6288d40c49c2b2ad70c114a57efa12cbb058c580"} May 29 10:08:02.056843 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.056807 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" event={"ID":"85f306e0-e2de-4975-be9d-a968a3e37d8d","Type":"ContainerStarted","Data":"617044e8a3ba8cad5c62637cb389ea63d7a2496a6fa7770ddba3f3ba598f1c7f"} May 29 10:08:02.070114 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.070086 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wssjx" event={"ID":"48d38eb1-eec2-4180-9ea6-a43f14ad718e","Type":"ContainerStarted","Data":"f26d868e18300d7fb00310d26dd07d06fcf6895a6183bd5507fecd444dfb46a5"} May 29 10:08:02.075537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.075508 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gjd7g" event={"ID":"9301b3d6-a026-4f32-b887-c810341d8584","Type":"ContainerStarted","Data":"ecc0fef1db23ef7eade61dc42098267b02121a8b4f9caf7694d0414bc03a966a"} May 29 10:08:02.098841 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.098675 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerStarted","Data":"a13ee571a4e919ab45462e09f6081c9e12ab33b4dd35c6470e256f549c3cdd43"} May 29 10:08:02.515694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.515606 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:02.515891 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:02.515807 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:02.515968 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:02.515892 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs podName:5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:04.515872147 +0000 UTC m=+6.148913282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs") pod "network-metrics-daemon-b5znn" (UID: "5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:02.616851 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:02.616801 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:02.617045 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:02.616985 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:08:02.617045 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:02.617007 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:08:02.617045 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:02.617019 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bzkg2 for pod openshift-network-diagnostics/network-check-target-f6vs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:02.617197 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:02.617088 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2 podName:2100660c-80ac-412b-8f52-5648c846322e nodeName:}" failed. No retries permitted until 2026-05-29 10:08:04.617069858 +0000 UTC m=+6.250111014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzkg2" (UniqueName: "kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2") pod "network-check-target-f6vs6" (UID: "2100660c-80ac-412b-8f52-5648c846322e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:03.007218 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:03.007125 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:03.007850 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:03.007271 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:03.138797 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:03.138735 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" event={"ID":"e4a5a68d22a5b2932ba3902cb698cbdf","Type":"ContainerStarted","Data":"343cadfb53d822400ec39d5f11cf399868162fcc5eeab992ef2b97a66575fdac"} May 29 10:08:03.158804 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:03.158202 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-71.ec2.internal" podStartSLOduration=3.158181963 podStartE2EDuration="3.158181963s" podCreationTimestamp="2026-05-29 10:08:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:08:03.157636379 +0000 UTC m=+4.790677535" watchObservedRunningTime="2026-05-29 10:08:03.158181963 +0000 UTC m=+4.791223121" May 29 10:08:04.007548 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:04.007511 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:04.008055 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:04.007651 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:04.532751 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:04.532709 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:04.532970 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:04.532875 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:04.532970 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:04.532948 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs podName:5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:08.532928581 +0000 UTC m=+10.165969719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs") pod "network-metrics-daemon-b5znn" (UID: "5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:04.633377 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:04.633312 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:04.633616 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:04.633579 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:08:04.633616 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:04.633609 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:08:04.633616 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:04.633624 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bzkg2 for pod openshift-network-diagnostics/network-check-target-f6vs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:04.633871 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:04.633690 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2 podName:2100660c-80ac-412b-8f52-5648c846322e nodeName:}" failed. No retries permitted until 2026-05-29 10:08:08.633669732 +0000 UTC m=+10.266710887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzkg2" (UniqueName: "kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2") pod "network-check-target-f6vs6" (UID: "2100660c-80ac-412b-8f52-5648c846322e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:05.012326 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:05.012245 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:05.012767 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:05.012437 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:06.006954 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:06.006919 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:06.007153 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:06.007067 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:07.006652 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:07.006538 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:07.006652 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:07.006645 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:08.006956 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:08.006918 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:08.007468 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:08.007177 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:08.564651 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:08.564287 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:08.564651 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:08.564439 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:08.564651 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:08.564515 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs podName:5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:16.564494401 +0000 UTC m=+18.197535537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs") pod "network-metrics-daemon-b5znn" (UID: "5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:08.665633 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:08.665587 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:08.665817 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:08.665713 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:08:08.665817 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:08.665735 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:08:08.665817 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:08.665749 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bzkg2 for pod openshift-network-diagnostics/network-check-target-f6vs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:08.665817 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:08.665815 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2 podName:2100660c-80ac-412b-8f52-5648c846322e nodeName:}" failed. No retries permitted until 2026-05-29 10:08:16.665796568 +0000 UTC m=+18.298837707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzkg2" (UniqueName: "kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2") pod "network-check-target-f6vs6" (UID: "2100660c-80ac-412b-8f52-5648c846322e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:09.008496 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:09.008419 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:09.008945 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:09.008521 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:10.006887 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:10.006599 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:10.006887 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:10.006755 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:11.010646 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:11.010615 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:11.011177 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:11.010766 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:12.006976 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:12.006886 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:12.007153 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:12.007022 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:13.009813 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:13.009783 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:13.010270 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:13.009922 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:14.007085 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:14.007047 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:14.007258 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:14.007173 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:15.007378 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:15.007340 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:15.007819 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:15.007489 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:16.007050 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:16.007007 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:16.007215 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:16.007138 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:16.625010 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:16.624958 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:16.625489 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:16.625120 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:16.625489 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:16.625196 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs podName:5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:32.625176825 +0000 UTC m=+34.258217959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs") pod "network-metrics-daemon-b5znn" (UID: "5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:16.726241 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:16.726203 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:16.726410 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:16.726378 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:08:16.726410 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:16.726405 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:08:16.726520 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:16.726419 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bzkg2 for pod openshift-network-diagnostics/network-check-target-f6vs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:16.726520 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:16.726484 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2 podName:2100660c-80ac-412b-8f52-5648c846322e nodeName:}" failed. No retries permitted until 2026-05-29 10:08:32.726464426 +0000 UTC m=+34.359505585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzkg2" (UniqueName: "kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2") pod "network-check-target-f6vs6" (UID: "2100660c-80ac-412b-8f52-5648c846322e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:17.007373 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:17.007293 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:17.007520 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:17.007434 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:18.006912 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:18.006876 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:18.007362 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:18.006987 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:19.007139 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:19.007112 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:19.007502 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:19.007199 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:20.006665 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.006501 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:20.006761 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:20.006742 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:20.169812 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.169549 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4tvr" event={"ID":"ee4f8337-3c9e-43a0-bb2d-2094b6545e4f","Type":"ContainerStarted","Data":"7614405c474fa21733abf5b6eafec5507e088f7a06c3b1233c45474bf8cfd9fb"} May 29 10:08:20.171666 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.171647 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:08:20.171989 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.171963 2575 generic.go:358] "Generic (PLEG): container finished" podID="d72f875f-be72-4db9-ba73-68b9494491fc" containerID="aeaa4405516aee84ca28e4219f5e4917b1695ab996cd9039e00f41db80392416" exitCode=1 May 29 10:08:20.172079 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.172023 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"ce777acd83f02f2f47962d24be1ad4efcfdef74890bdc13af958bffb45917be3"} May 29 10:08:20.172079 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.172054 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"0ae4588e90b6bd17b84461db87608cb09f760216ea261df15e79dbf3dc58458a"} May 29 10:08:20.172079 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.172063 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerDied","Data":"aeaa4405516aee84ca28e4219f5e4917b1695ab996cd9039e00f41db80392416"} May 29 10:08:20.172079 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.172074 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"246a0c14f8e4aa1fd97b553dd11f0b967d57c816562bf8df5ff325f5e2f99e84"} May 29 10:08:20.173668 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.173646 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" event={"ID":"85f306e0-e2de-4975-be9d-a968a3e37d8d","Type":"ContainerStarted","Data":"cefe866f26fdc7bc9688aa379b413ce58a6d2ccd133f646a2e791b0d2780fce2"} May 29 10:08:20.175081 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.175053 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wssjx" event={"ID":"48d38eb1-eec2-4180-9ea6-a43f14ad718e","Type":"ContainerStarted","Data":"0eed1daa28fd6a0088524047ecc52d9a984656374676d949987624a00dbae2a9"} May 29 10:08:20.176538 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.176515 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gjd7g" event={"ID":"9301b3d6-a026-4f32-b887-c810341d8584","Type":"ContainerStarted","Data":"83a75f08b9cde97a036f0092b02da4d6a64e834ec67ade244ca44268dc160dde"} May 29 10:08:20.178047 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.178026 2575 generic.go:358] "Generic (PLEG): container finished" podID="44666ece-c940-4772-a965-70e4879c1abf" containerID="9af77304f68fbf3dc6aff4ce1d2343c13292423b668072556e8c7867f62a47e5" exitCode=0 May 29 10:08:20.178127 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.178095 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerDied","Data":"9af77304f68fbf3dc6aff4ce1d2343c13292423b668072556e8c7867f62a47e5"} May 29 10:08:20.179697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.179674 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8tlwz" event={"ID":"6667d0fa-d378-45d0-955f-8aa8f9fe328a","Type":"ContainerStarted","Data":"084b9088310f0eed7681da23056965f410db2e0f0793dcdb652ebb9190ab74b3"} May 29 10:08:20.181180 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.181155 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-njxbt" event={"ID":"39da41c1-61f6-4523-9e9a-8dd76b2cc723","Type":"ContainerStarted","Data":"03c94874dc10a8db2ede08f28e8d86731e685b6cd521c12d94180fb2c3dd67b1"} May 29 10:08:20.191799 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.191738 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t4tvr" podStartSLOduration=3.300807919 podStartE2EDuration="21.191720329s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.588702622 +0000 UTC m=+3.221743769" lastFinishedPulling="2026-05-29 10:08:19.479615032 +0000 UTC m=+21.112656179" observedRunningTime="2026-05-29 10:08:20.19098582 +0000 UTC m=+21.824026976" watchObservedRunningTime="2026-05-29 10:08:20.191720329 +0000 UTC m=+21.824761484" May 29 10:08:20.207340 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.207288 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-njxbt" podStartSLOduration=3.277893259 podStartE2EDuration="21.207269272s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.582420917 +0000 UTC m=+3.215462055" lastFinishedPulling="2026-05-29 10:08:19.511796921 +0000 UTC m=+21.144838068" observedRunningTime="2026-05-29 10:08:20.206936131 +0000 UTC m=+21.839977288" watchObservedRunningTime="2026-05-29 10:08:20.207269272 +0000 UTC m=+21.840310427" May 29 10:08:20.262648 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.262597 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-8tlwz" podStartSLOduration=3.294121875 podStartE2EDuration="21.262582303s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.58320797 +0000 UTC m=+3.216249107" lastFinishedPulling="2026-05-29 10:08:19.551668388 +0000 UTC m=+21.184709535" observedRunningTime="2026-05-29 10:08:20.261911765 +0000 UTC m=+21.894952920" watchObservedRunningTime="2026-05-29 10:08:20.262582303 +0000 UTC m=+21.895623457" May 29 10:08:20.288529 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.288479 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-gjd7g" podStartSLOduration=3.325145551 podStartE2EDuration="21.288465525s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.589494034 +0000 UTC m=+3.222535174" lastFinishedPulling="2026-05-29 10:08:19.552813997 +0000 UTC m=+21.185855148" observedRunningTime="2026-05-29 10:08:20.288402766 +0000 UTC m=+21.921443920" watchObservedRunningTime="2026-05-29 10:08:20.288465525 +0000 UTC m=+21.921506679" May 29 10:08:20.309118 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.309058 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wssjx" podStartSLOduration=3.348882702 podStartE2EDuration="21.309042978s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.589810905 +0000 UTC m=+3.222852051" lastFinishedPulling="2026-05-29 10:08:19.549971194 +0000 UTC m=+21.183012327" observedRunningTime="2026-05-29 10:08:20.308706139 +0000 UTC m=+21.941747311" watchObservedRunningTime="2026-05-29 10:08:20.309042978 +0000 UTC m=+21.942084133" May 29 10:08:20.854842 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.854804 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 10:08:20.960791 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.960666 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T10:08:20.854843253Z","UUID":"6a2ee603-f371-4764-abd2-091e3e6dae80","Handler":null,"Name":"","Endpoint":""} May 29 10:08:20.962540 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.962516 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 10:08:20.962667 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.962547 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 10:08:20.976140 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.976103 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:20.976742 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:20.976722 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:21.007638 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.007560 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:21.007788 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:21.007702 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:21.184480 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.184443 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8zfjs" event={"ID":"e96459d6-92cc-4ac5-a200-69688559a4dd","Type":"ContainerStarted","Data":"3be05ab11805e6fb7c392bc5975d09678e6df27902a02321f4d8fded2e2f90cb"} May 29 10:08:21.187515 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.187495 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:08:21.187925 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.187899 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"23fb34458aa6bd7bc5d1d5a864164e4fec65c24560d6587461db57dd391be6d9"} May 29 10:08:21.187925 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.187924 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"79222b7986abd90e993a39661f11f7b27994c584f3bf5b83869321bff911e630"} May 29 10:08:21.191950 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.191918 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" event={"ID":"85f306e0-e2de-4975-be9d-a968a3e37d8d","Type":"ContainerStarted","Data":"70a4c76863678bbc751fdb467ec4bea635075bc5d5ebb067319b93b0a4a2c3ea"} May 29 10:08:21.205577 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.205533 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8zfjs" podStartSLOduration=4.235871658 podStartE2EDuration="22.205518758s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.586708855 +0000 UTC m=+3.219750003" lastFinishedPulling="2026-05-29 10:08:19.556355971 +0000 UTC m=+21.189397103" observedRunningTime="2026-05-29 10:08:21.205072184 +0000 UTC m=+22.838113341" watchObservedRunningTime="2026-05-29 10:08:21.205518758 +0000 UTC m=+22.838559913" May 29 10:08:21.444153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.444119 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:21.444857 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:21.444792 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t4tvr" May 29 10:08:22.006950 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:22.006917 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:22.007109 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:22.007040 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:22.196434 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:22.196337 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" event={"ID":"85f306e0-e2de-4975-be9d-a968a3e37d8d","Type":"ContainerStarted","Data":"d051da3f35af5663a7f24ba34cf864dc4b25d64c4f355a34a533d7d3003bca3e"} May 29 10:08:22.218564 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:22.218502 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jk6hf" podStartSLOduration=2.90895987 podStartE2EDuration="23.218481783s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.591069443 +0000 UTC m=+3.224110592" lastFinishedPulling="2026-05-29 10:08:21.900591359 +0000 UTC m=+23.533632505" observedRunningTime="2026-05-29 10:08:22.218013606 +0000 UTC m=+23.851054761" watchObservedRunningTime="2026-05-29 10:08:22.218481783 +0000 UTC m=+23.851522939" May 29 10:08:23.006938 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:23.006906 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:23.007126 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:23.007045 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:23.201771 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:23.201739 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:08:23.202264 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:23.202235 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"d68408db242c17ae411d8687f9a22695c28ddc16bd4d5e347617799df22a4ed1"} May 29 10:08:24.007091 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:24.006883 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:24.007261 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:24.007182 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:25.006549 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:25.006517 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:25.007342 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:25.006638 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:25.210426 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:25.210388 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:08:25.210803 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:25.210769 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"2d9da41fce0c3115a4242f9fc6de04a6067b4692c1faa485c9cac0719860a594"} May 29 10:08:25.211080 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:25.211056 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:25.211262 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:25.211240 2575 scope.go:117] "RemoveContainer" containerID="aeaa4405516aee84ca28e4219f5e4917b1695ab996cd9039e00f41db80392416" May 29 10:08:25.212680 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:25.212655 2575 generic.go:358] "Generic (PLEG): container finished" podID="44666ece-c940-4772-a965-70e4879c1abf" containerID="7684234852fcb976e85ebbca5d19ac0e2b0455d858cafa0a9b36cf35aea1b7c3" exitCode=0 May 29 10:08:25.212757 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:25.212700 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerDied","Data":"7684234852fcb976e85ebbca5d19ac0e2b0455d858cafa0a9b36cf35aea1b7c3"} May 29 10:08:25.228785 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:25.228630 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:26.006552 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.006518 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:26.006712 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:26.006624 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:26.217770 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.217736 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:08:26.218125 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.218097 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" event={"ID":"d72f875f-be72-4db9-ba73-68b9494491fc","Type":"ContainerStarted","Data":"0b576a25b92dd7c769c1ad76cef4e33152fa212cd5b1bd9a7434ab9446e66a3d"} May 29 10:08:26.218496 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.218467 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:26.218579 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.218554 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:26.234192 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.234165 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:08:26.247223 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.247170 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" podStartSLOduration=9.244070481 podStartE2EDuration="27.247153891s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.580817757 +0000 UTC m=+3.213858904" lastFinishedPulling="2026-05-29 10:08:19.583901178 +0000 UTC m=+21.216942314" observedRunningTime="2026-05-29 10:08:26.246584008 +0000 UTC m=+27.879625163" watchObservedRunningTime="2026-05-29 10:08:26.247153891 +0000 UTC m=+27.880195045" May 29 10:08:26.591102 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.591026 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b5znn"] May 29 10:08:26.591226 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.591184 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:26.591316 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:26.591297 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:26.595244 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.595219 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f6vs6"] May 29 10:08:26.595365 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:26.595314 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:26.595459 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:26.595439 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:27.222367 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:27.222329 2575 generic.go:358] "Generic (PLEG): container finished" podID="44666ece-c940-4772-a965-70e4879c1abf" containerID="8e38c58c9a956d2a442d4752bfceeb15d6e5c6d5bf29a45ff00b98e0ac4d56f1" exitCode=0 May 29 10:08:27.222856 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:27.222408 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerDied","Data":"8e38c58c9a956d2a442d4752bfceeb15d6e5c6d5bf29a45ff00b98e0ac4d56f1"} May 29 10:08:28.007023 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:28.006984 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:28.007257 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:28.007091 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:29.009894 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:29.008486 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:29.009894 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:29.008643 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:29.228578 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:29.228543 2575 generic.go:358] "Generic (PLEG): container finished" podID="44666ece-c940-4772-a965-70e4879c1abf" containerID="4111fbc2f513fbeeba87ce038e686c375ac549969be6cc8e8dab92cb93ff7130" exitCode=0 May 29 10:08:29.228724 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:29.228588 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerDied","Data":"4111fbc2f513fbeeba87ce038e686c375ac549969be6cc8e8dab92cb93ff7130"} May 29 10:08:30.007012 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:30.006964 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:30.007211 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:30.007104 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:31.006970 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:31.006939 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:31.007374 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:31.007074 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5znn" podUID="5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1" May 29 10:08:32.006750 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.006714 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:32.006940 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.006843 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6vs6" podUID="2100660c-80ac-412b-8f52-5648c846322e" May 29 10:08:32.626164 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.626135 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-71.ec2.internal" event="NodeReady" May 29 10:08:32.626679 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.626271 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 10:08:32.654473 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.654443 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:32.654652 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.654570 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:32.654652 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.654627 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs podName:5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1 nodeName:}" failed. No retries permitted until 2026-05-29 10:09:04.654610005 +0000 UTC m=+66.287651138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs") pod "network-metrics-daemon-b5znn" (UID: "5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:08:32.667114 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.667076 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-558f9567bc-x4nfr"] May 29 10:08:32.693742 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.693706 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tgw6k"] May 29 10:08:32.693937 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.693906 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.699376 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.698984 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 10:08:32.699376 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.699258 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 10:08:32.699376 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.699267 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rfg46\"" May 29 10:08:32.699630 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.699446 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 10:08:32.705374 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.705342 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 10:08:32.726594 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.726555 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6ns82"] May 29 10:08:32.726768 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.726725 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.728699 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.728672 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 10:08:32.728842 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.728775 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 10:08:32.728842 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.728785 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2rw8\"" May 29 10:08:32.755267 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.755235 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:32.755448 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.755425 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:08:32.755516 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.755452 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:08:32.755516 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.755465 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bzkg2 for pod openshift-network-diagnostics/network-check-target-f6vs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:32.755610 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.755533 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2 podName:2100660c-80ac-412b-8f52-5648c846322e nodeName:}" failed. No retries permitted until 2026-05-29 10:09:04.755512927 +0000 UTC m=+66.388554065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzkg2" (UniqueName: "kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2") pod "network-check-target-f6vs6" (UID: "2100660c-80ac-412b-8f52-5648c846322e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:08:32.755797 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.755777 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-558f9567bc-x4nfr"] May 29 10:08:32.755954 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.755857 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6ns82"] May 29 10:08:32.755954 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.755879 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tgw6k"] May 29 10:08:32.755954 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.755947 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:32.758083 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.758058 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 10:08:32.758557 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.758537 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 10:08:32.758650 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.758598 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w2q2q\"" May 29 10:08:32.758965 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.758934 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 10:08:32.856657 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-installation-pull-secrets\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.856873 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ee49d5-2c65-4f14-8f87-532905395c93-tmp-dir\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.856873 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.856873 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-bound-sa-token\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.856873 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88t2r\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-kube-api-access-88t2r\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.856873 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856787 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-image-registry-private-configuration\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.856873 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-trusted-ca\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.857170 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.857170 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.856927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:32.857170 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.857020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2mqf\" (UniqueName: \"kubernetes.io/projected/52ee49d5-2c65-4f14-8f87-532905395c93-kube-api-access-g2mqf\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.857170 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.857081 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-certificates\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.857170 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.857143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f9391f8-e070-40eb-9587-cf5c0c1e8782-ca-trust-extracted\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.857170 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.857169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zkrm\" (UniqueName: \"kubernetes.io/projected/de5c0b31-fdf4-46a5-a840-861369481f5a-kube-api-access-8zkrm\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:32.857470 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.857197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52ee49d5-2c65-4f14-8f87-532905395c93-config-volume\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.958197 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958109 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-installation-pull-secrets\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.958197 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958153 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ee49d5-2c65-4f14-8f87-532905395c93-tmp-dir\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.958197 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958177 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.958446 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958209 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-bound-sa-token\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.958446 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958227 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88t2r\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-kube-api-access-88t2r\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.958446 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958250 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-image-registry-private-configuration\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.958446 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.958425 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:08:32.958446 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.958441 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558f9567bc-x4nfr: secret "image-registry-tls" not found May 29 10:08:32.958642 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958467 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-trusted-ca\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.958642 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.958506 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls podName:3f9391f8-e070-40eb-9587-cf5c0c1e8782 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:33.45848696 +0000 UTC m=+35.091528110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls") pod "image-registry-558f9567bc-x4nfr" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782") : secret "image-registry-tls" not found May 29 10:08:32.958642 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958571 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.958642 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958609 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:32.958862 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958653 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2mqf\" (UniqueName: \"kubernetes.io/projected/52ee49d5-2c65-4f14-8f87-532905395c93-kube-api-access-g2mqf\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.958862 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.958684 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:08:32.958862 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958708 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-certificates\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.958862 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.958757 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls podName:52ee49d5-2c65-4f14-8f87-532905395c93 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:33.458731211 +0000 UTC m=+35.091772356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls") pod "dns-default-tgw6k" (UID: "52ee49d5-2c65-4f14-8f87-532905395c93") : secret "dns-default-metrics-tls" not found May 29 10:08:32.958862 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958809 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f9391f8-e070-40eb-9587-cf5c0c1e8782-ca-trust-extracted\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.958862 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958810 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ee49d5-2c65-4f14-8f87-532905395c93-tmp-dir\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.958862 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.958844 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:08:32.959195 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958863 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zkrm\" (UniqueName: \"kubernetes.io/projected/de5c0b31-fdf4-46a5-a840-861369481f5a-kube-api-access-8zkrm\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:32.959195 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:32.958916 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert podName:de5c0b31-fdf4-46a5-a840-861369481f5a nodeName:}" failed. No retries permitted until 2026-05-29 10:08:33.458896127 +0000 UTC m=+35.091937279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert") pod "ingress-canary-6ns82" (UID: "de5c0b31-fdf4-46a5-a840-861369481f5a") : secret "canary-serving-cert" not found May 29 10:08:32.959195 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.958957 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52ee49d5-2c65-4f14-8f87-532905395c93-config-volume\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.959526 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.959491 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-certificates\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.959634 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.959518 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f9391f8-e070-40eb-9587-cf5c0c1e8782-ca-trust-extracted\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.959967 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.959946 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-trusted-ca\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.963026 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.963004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-image-registry-private-configuration\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.963141 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.963006 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-installation-pull-secrets\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.965713 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.965689 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52ee49d5-2c65-4f14-8f87-532905395c93-config-volume\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.970015 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.969982 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-bound-sa-token\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:32.970271 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.970248 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2mqf\" (UniqueName: \"kubernetes.io/projected/52ee49d5-2c65-4f14-8f87-532905395c93-kube-api-access-g2mqf\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:32.970601 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.970581 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zkrm\" (UniqueName: \"kubernetes.io/projected/de5c0b31-fdf4-46a5-a840-861369481f5a-kube-api-access-8zkrm\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:32.970914 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:32.970891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88t2r\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-kube-api-access-88t2r\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:33.009955 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:33.009920 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:08:33.012205 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:33.012184 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 10:08:33.012205 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:33.012194 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hnsrd\"" May 29 10:08:33.463565 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:33.463528 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:33.463884 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:33.463600 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:33.463884 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:33.463699 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:08:33.463884 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:33.463723 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558f9567bc-x4nfr: secret "image-registry-tls" not found May 29 10:08:33.463884 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:33.463733 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:33.463884 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:33.463784 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls podName:3f9391f8-e070-40eb-9587-cf5c0c1e8782 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:34.463769308 +0000 UTC m=+36.096810441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls") pod "image-registry-558f9567bc-x4nfr" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782") : secret "image-registry-tls" not found May 29 10:08:33.463884 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:33.463699 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:08:33.463884 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:33.463845 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:08:33.464170 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:33.463901 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls podName:52ee49d5-2c65-4f14-8f87-532905395c93 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:34.463879656 +0000 UTC m=+36.096920790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls") pod "dns-default-tgw6k" (UID: "52ee49d5-2c65-4f14-8f87-532905395c93") : secret "dns-default-metrics-tls" not found May 29 10:08:33.464170 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:33.463922 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert podName:de5c0b31-fdf4-46a5-a840-861369481f5a nodeName:}" failed. No retries permitted until 2026-05-29 10:08:34.463912968 +0000 UTC m=+36.096954115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert") pod "ingress-canary-6ns82" (UID: "de5c0b31-fdf4-46a5-a840-861369481f5a") : secret "canary-serving-cert" not found May 29 10:08:34.007023 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:34.006979 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:08:34.009379 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:34.009336 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 10:08:34.009712 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:34.009690 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 10:08:34.009843 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:34.009713 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ggj4k\"" May 29 10:08:34.471882 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:34.471851 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:34.472067 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:34.471999 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:08:34.472067 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:34.472019 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558f9567bc-x4nfr: secret "image-registry-tls" not found May 29 10:08:34.472186 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:34.472001 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:34.472186 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:34.472068 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls podName:3f9391f8-e070-40eb-9587-cf5c0c1e8782 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:36.472052924 +0000 UTC m=+38.105094082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls") pod "image-registry-558f9567bc-x4nfr" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782") : secret "image-registry-tls" not found May 29 10:08:34.472186 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:34.472132 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:34.472186 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:34.472069 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:08:34.472355 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:34.472208 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:08:34.472355 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:34.472240 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls podName:52ee49d5-2c65-4f14-8f87-532905395c93 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:36.47221795 +0000 UTC m=+38.105259098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls") pod "dns-default-tgw6k" (UID: "52ee49d5-2c65-4f14-8f87-532905395c93") : secret "dns-default-metrics-tls" not found May 29 10:08:34.472355 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:34.472262 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert podName:de5c0b31-fdf4-46a5-a840-861369481f5a nodeName:}" failed. No retries permitted until 2026-05-29 10:08:36.472249711 +0000 UTC m=+38.105290849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert") pod "ingress-canary-6ns82" (UID: "de5c0b31-fdf4-46a5-a840-861369481f5a") : secret "canary-serving-cert" not found May 29 10:08:35.242531 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:35.242498 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerStarted","Data":"c766d7d541059c5a9e58cdf3f50144bb979418a9cc6db0995a93e35edc664042"} May 29 10:08:36.246726 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:36.246691 2575 generic.go:358] "Generic (PLEG): container finished" podID="44666ece-c940-4772-a965-70e4879c1abf" containerID="c766d7d541059c5a9e58cdf3f50144bb979418a9cc6db0995a93e35edc664042" exitCode=0 May 29 10:08:36.247105 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:36.246750 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerDied","Data":"c766d7d541059c5a9e58cdf3f50144bb979418a9cc6db0995a93e35edc664042"} May 29 10:08:36.490140 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:36.489914 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:36.490140 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:36.490124 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:36.490356 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:36.490145 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:36.490356 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:36.490046 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:08:36.490356 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:36.490170 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558f9567bc-x4nfr: secret "image-registry-tls" not found May 29 10:08:36.490356 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:36.490226 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls podName:3f9391f8-e070-40eb-9587-cf5c0c1e8782 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:40.490210913 +0000 UTC m=+42.123252047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls") pod "image-registry-558f9567bc-x4nfr" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782") : secret "image-registry-tls" not found May 29 10:08:36.490356 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:36.490230 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:08:36.490356 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:36.490235 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:08:36.490356 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:36.490267 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert podName:de5c0b31-fdf4-46a5-a840-861369481f5a nodeName:}" failed. No retries permitted until 2026-05-29 10:08:40.490256172 +0000 UTC m=+42.123297304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert") pod "ingress-canary-6ns82" (UID: "de5c0b31-fdf4-46a5-a840-861369481f5a") : secret "canary-serving-cert" not found May 29 10:08:36.490356 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:36.490279 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls podName:52ee49d5-2c65-4f14-8f87-532905395c93 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:40.490273121 +0000 UTC m=+42.123314254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls") pod "dns-default-tgw6k" (UID: "52ee49d5-2c65-4f14-8f87-532905395c93") : secret "dns-default-metrics-tls" not found May 29 10:08:37.254240 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:37.254205 2575 generic.go:358] "Generic (PLEG): container finished" podID="44666ece-c940-4772-a965-70e4879c1abf" containerID="4a52e8c203d2acb9ec014ded310565126b3862af7fc92f2aa0d85de532cba6a2" exitCode=0 May 29 10:08:37.254629 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:37.254263 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerDied","Data":"4a52e8c203d2acb9ec014ded310565126b3862af7fc92f2aa0d85de532cba6a2"} May 29 10:08:38.258689 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:38.258654 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" event={"ID":"44666ece-c940-4772-a965-70e4879c1abf","Type":"ContainerStarted","Data":"027ae346ca3d1dab718dfb01665228486731d350a323c6babc5d0d344035ca7d"} May 29 10:08:38.285336 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:38.285282 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ks5bs" podStartSLOduration=5.819917264 podStartE2EDuration="39.285267191s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:08:01.586448905 +0000 UTC m=+3.219490051" lastFinishedPulling="2026-05-29 10:08:35.051798842 +0000 UTC m=+36.684839978" observedRunningTime="2026-05-29 10:08:38.284641839 +0000 UTC m=+39.917682994" watchObservedRunningTime="2026-05-29 10:08:38.285267191 +0000 UTC m=+39.918308323" May 29 10:08:40.519846 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:40.519770 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:40.519940 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:40.519965 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:40.519939 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:40.520034 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558f9567bc-x4nfr: secret "image-registry-tls" not found May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:40.520063 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:40.520068 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:40.520111 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls podName:3f9391f8-e070-40eb-9587-cf5c0c1e8782 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:48.520087709 +0000 UTC m=+50.153128862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls") pod "image-registry-558f9567bc-x4nfr" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782") : secret "image-registry-tls" not found May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:40.520127 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert podName:de5c0b31-fdf4-46a5-a840-861369481f5a nodeName:}" failed. No retries permitted until 2026-05-29 10:08:48.520119963 +0000 UTC m=+50.153161100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert") pod "ingress-canary-6ns82" (UID: "de5c0b31-fdf4-46a5-a840-861369481f5a") : secret "canary-serving-cert" not found May 29 10:08:40.520263 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:40.520136 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls podName:52ee49d5-2c65-4f14-8f87-532905395c93 nodeName:}" failed. No retries permitted until 2026-05-29 10:08:48.52013151 +0000 UTC m=+50.153172642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls") pod "dns-default-tgw6k" (UID: "52ee49d5-2c65-4f14-8f87-532905395c93") : secret "dns-default-metrics-tls" not found May 29 10:08:42.870582 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:42.870548 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh"] May 29 10:08:42.876119 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:42.876098 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" May 29 10:08:42.878610 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:42.878591 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 29 10:08:42.878944 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:42.878926 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xdjfp\"" May 29 10:08:42.879041 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:42.879025 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 29 10:08:42.885577 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:42.885551 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh"] May 29 10:08:43.037477 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:43.037433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25hn\" (UniqueName: \"kubernetes.io/projected/aa1523df-34df-46f6-ab5a-175945b369b4-kube-api-access-b25hn\") pod \"migrator-b985f5d89-5cfzh\" (UID: \"aa1523df-34df-46f6-ab5a-175945b369b4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" May 29 10:08:43.138456 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:43.138365 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b25hn\" (UniqueName: \"kubernetes.io/projected/aa1523df-34df-46f6-ab5a-175945b369b4-kube-api-access-b25hn\") pod \"migrator-b985f5d89-5cfzh\" (UID: \"aa1523df-34df-46f6-ab5a-175945b369b4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" May 29 10:08:43.153204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:43.153169 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25hn\" (UniqueName: \"kubernetes.io/projected/aa1523df-34df-46f6-ab5a-175945b369b4-kube-api-access-b25hn\") pod \"migrator-b985f5d89-5cfzh\" (UID: \"aa1523df-34df-46f6-ab5a-175945b369b4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" May 29 10:08:43.185080 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:43.185041 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" May 29 10:08:43.319150 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:43.319122 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh"] May 29 10:08:43.322618 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:43.322583 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1523df_34df_46f6_ab5a_175945b369b4.slice/crio-1c32c76145407f5b6f51a6782497f8af8e385e896c76332a1455e3f7696c5e38 WatchSource:0}: Error finding container 1c32c76145407f5b6f51a6782497f8af8e385e896c76332a1455e3f7696c5e38: Status 404 returned error can't find the container with id 1c32c76145407f5b6f51a6782497f8af8e385e896c76332a1455e3f7696c5e38 May 29 10:08:43.593166 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:43.593138 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8tlwz_6667d0fa-d378-45d0-955f-8aa8f9fe328a/dns-node-resolver/0.log" May 29 10:08:44.269062 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:44.269027 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" event={"ID":"aa1523df-34df-46f6-ab5a-175945b369b4","Type":"ContainerStarted","Data":"1c32c76145407f5b6f51a6782497f8af8e385e896c76332a1455e3f7696c5e38"} May 29 10:08:44.393158 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:44.393127 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njxbt_39da41c1-61f6-4523-9e9a-8dd76b2cc723/node-ca/0.log" May 29 10:08:45.029396 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.029368 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tft66"] May 29 10:08:45.064170 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.064134 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tft66"] May 29 10:08:45.064333 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.064275 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.066589 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.066563 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 29 10:08:45.067009 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.066990 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 29 10:08:45.067101 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.067008 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-47wfn\"" May 29 10:08:45.067159 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.067150 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 29 10:08:45.067209 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.067186 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 29 10:08:45.156217 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.156180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c2308116-05ac-4707-9e86-180035ad5990-signing-cabundle\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.156327 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.156283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c2308116-05ac-4707-9e86-180035ad5990-signing-key\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.156381 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.156363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvhbr\" (UniqueName: \"kubernetes.io/projected/c2308116-05ac-4707-9e86-180035ad5990-kube-api-access-bvhbr\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.256753 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.256716 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvhbr\" (UniqueName: \"kubernetes.io/projected/c2308116-05ac-4707-9e86-180035ad5990-kube-api-access-bvhbr\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.256955 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.256818 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c2308116-05ac-4707-9e86-180035ad5990-signing-cabundle\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.256955 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.256862 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c2308116-05ac-4707-9e86-180035ad5990-signing-key\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.257481 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.257461 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c2308116-05ac-4707-9e86-180035ad5990-signing-cabundle\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.259324 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.259300 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c2308116-05ac-4707-9e86-180035ad5990-signing-key\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.266665 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.266646 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvhbr\" (UniqueName: \"kubernetes.io/projected/c2308116-05ac-4707-9e86-180035ad5990-kube-api-access-bvhbr\") pod \"service-ca-67d667c7d-tft66\" (UID: \"c2308116-05ac-4707-9e86-180035ad5990\") " pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.272578 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.272551 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" event={"ID":"aa1523df-34df-46f6-ab5a-175945b369b4","Type":"ContainerStarted","Data":"5ce9eb67c6db4aa50bf8e79ea6b207552cc25e4a7f6a6f8bcf54818d35fe6dfb"} May 29 10:08:45.272898 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.272586 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" event={"ID":"aa1523df-34df-46f6-ab5a-175945b369b4","Type":"ContainerStarted","Data":"4f9d5b32989b7a492c67a543400dd5d68fccaa89d748ee5910cba3a9a41bc1a2"} May 29 10:08:45.288358 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.288211 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-5cfzh" podStartSLOduration=1.6541449689999999 podStartE2EDuration="3.288195177s" podCreationTimestamp="2026-05-29 10:08:42 +0000 UTC" firstStartedPulling="2026-05-29 10:08:43.324501697 +0000 UTC m=+44.957542832" lastFinishedPulling="2026-05-29 10:08:44.958551904 +0000 UTC m=+46.591593040" observedRunningTime="2026-05-29 10:08:45.288024821 +0000 UTC m=+46.921065975" watchObservedRunningTime="2026-05-29 10:08:45.288195177 +0000 UTC m=+46.921236332" May 29 10:08:45.372902 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.372870 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-tft66" May 29 10:08:45.495404 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:45.495330 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tft66"] May 29 10:08:45.498278 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:08:45.498248 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2308116_05ac_4707_9e86_180035ad5990.slice/crio-ab36a6a100fed1946571f684edef4e3c03ad901a943a67225b8048f0a3600832 WatchSource:0}: Error finding container ab36a6a100fed1946571f684edef4e3c03ad901a943a67225b8048f0a3600832: Status 404 returned error can't find the container with id ab36a6a100fed1946571f684edef4e3c03ad901a943a67225b8048f0a3600832 May 29 10:08:46.275676 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:46.275616 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-tft66" event={"ID":"c2308116-05ac-4707-9e86-180035ad5990","Type":"ContainerStarted","Data":"ab36a6a100fed1946571f684edef4e3c03ad901a943a67225b8048f0a3600832"} May 29 10:08:48.280961 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:48.280929 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-tft66" event={"ID":"c2308116-05ac-4707-9e86-180035ad5990","Type":"ContainerStarted","Data":"9d52b87e8e36c0d5477fbfbeb61ba4e58c40c17acc85675a110a1e2091608e59"} May 29 10:08:48.304909 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:48.304865 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-tft66" podStartSLOduration=0.703945016 podStartE2EDuration="3.304849912s" podCreationTimestamp="2026-05-29 10:08:45 +0000 UTC" firstStartedPulling="2026-05-29 10:08:45.500156648 +0000 UTC m=+47.133197780" lastFinishedPulling="2026-05-29 10:08:48.101061544 +0000 UTC m=+49.734102676" observedRunningTime="2026-05-29 10:08:48.303193066 +0000 UTC m=+49.936234221" watchObservedRunningTime="2026-05-29 10:08:48.304849912 +0000 UTC m=+49.937891064" May 29 10:08:48.586310 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:48.586270 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:08:48.586310 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:48.586312 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:08:48.586526 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:48.586362 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:08:48.586526 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:48.586419 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:08:48.586526 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:48.586449 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:08:48.586526 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:48.586461 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558f9567bc-x4nfr: secret "image-registry-tls" not found May 29 10:08:48.586526 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:48.586465 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:08:48.586526 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:48.586502 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls podName:52ee49d5-2c65-4f14-8f87-532905395c93 nodeName:}" failed. No retries permitted until 2026-05-29 10:09:04.586480039 +0000 UTC m=+66.219521193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls") pod "dns-default-tgw6k" (UID: "52ee49d5-2c65-4f14-8f87-532905395c93") : secret "dns-default-metrics-tls" not found May 29 10:08:48.586526 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:48.586518 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls podName:3f9391f8-e070-40eb-9587-cf5c0c1e8782 nodeName:}" failed. No retries permitted until 2026-05-29 10:09:04.586511325 +0000 UTC m=+66.219552458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls") pod "image-registry-558f9567bc-x4nfr" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782") : secret "image-registry-tls" not found May 29 10:08:48.586526 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:08:48.586527 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert podName:de5c0b31-fdf4-46a5-a840-861369481f5a nodeName:}" failed. No retries permitted until 2026-05-29 10:09:04.586522294 +0000 UTC m=+66.219563427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert") pod "ingress-canary-6ns82" (UID: "de5c0b31-fdf4-46a5-a840-861369481f5a") : secret "canary-serving-cert" not found May 29 10:08:58.234045 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:08:58.234017 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7pz67" May 29 10:09:04.616086 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.615908 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:09:04.616639 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.616273 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:09:04.616639 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.616337 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:09:04.619602 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.619562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"image-registry-558f9567bc-x4nfr\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:09:04.619768 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.619746 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de5c0b31-fdf4-46a5-a840-861369481f5a-cert\") pod \"ingress-canary-6ns82\" (UID: \"de5c0b31-fdf4-46a5-a840-861369481f5a\") " pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:09:04.620393 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.620169 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ee49d5-2c65-4f14-8f87-532905395c93-metrics-tls\") pod \"dns-default-tgw6k\" (UID: \"52ee49d5-2c65-4f14-8f87-532905395c93\") " pod="openshift-dns/dns-default-tgw6k" May 29 10:09:04.716992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.716940 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:09:04.719682 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.719660 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 10:09:04.729930 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.729902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1-metrics-certs\") pod \"network-metrics-daemon-b5znn\" (UID: \"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1\") " pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:09:04.808755 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.808723 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rfg46\"" May 29 10:09:04.817490 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.817468 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:09:04.817674 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.817654 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:09:04.819839 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.819810 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 10:09:04.821373 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.821357 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hnsrd\"" May 29 10:09:04.829861 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.829823 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5znn" May 29 10:09:04.830210 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.830187 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 10:09:04.838884 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.838857 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2rw8\"" May 29 10:09:04.840674 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.840652 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzkg2\" (UniqueName: \"kubernetes.io/projected/2100660c-80ac-412b-8f52-5648c846322e-kube-api-access-bzkg2\") pod \"network-check-target-f6vs6\" (UID: \"2100660c-80ac-412b-8f52-5648c846322e\") " pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:09:04.847408 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.847372 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tgw6k" May 29 10:09:04.870759 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.870725 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w2q2q\"" May 29 10:09:04.879410 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.878159 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6ns82" May 29 10:09:04.920784 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.920475 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ggj4k\"" May 29 10:09:04.930386 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.927971 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:09:04.978693 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.978657 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-558f9567bc-x4nfr"] May 29 10:09:04.984117 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:04.984080 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9391f8_e070_40eb_9587_cf5c0c1e8782.slice/crio-94bf94a77f76ee02e0fc4701dc4e614cea4cf4935f3677643a1b1489f7cfc466 WatchSource:0}: Error finding container 94bf94a77f76ee02e0fc4701dc4e614cea4cf4935f3677643a1b1489f7cfc466: Status 404 returned error can't find the container with id 94bf94a77f76ee02e0fc4701dc4e614cea4cf4935f3677643a1b1489f7cfc466 May 29 10:09:04.993677 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:04.993343 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b5znn"] May 29 10:09:05.000967 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:05.000914 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d80a8a4_f4db_4e46_9dcd_a5ae8c17dbd1.slice/crio-847c3a687540e611d0b671f106088180f854214d2fde0c4923b99398f6fe2ac6 WatchSource:0}: Error finding container 847c3a687540e611d0b671f106088180f854214d2fde0c4923b99398f6fe2ac6: Status 404 returned error can't find the container with id 847c3a687540e611d0b671f106088180f854214d2fde0c4923b99398f6fe2ac6 May 29 10:09:05.024589 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.024551 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tgw6k"] May 29 10:09:05.028640 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:05.027623 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ee49d5_2c65_4f14_8f87_532905395c93.slice/crio-1dd660af85751f9cf599074877944d7206608bfde05de322cb456d5ebcfd0818 WatchSource:0}: Error finding container 1dd660af85751f9cf599074877944d7206608bfde05de322cb456d5ebcfd0818: Status 404 returned error can't find the container with id 1dd660af85751f9cf599074877944d7206608bfde05de322cb456d5ebcfd0818 May 29 10:09:05.057975 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.057926 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6ns82"] May 29 10:09:05.062188 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:05.062165 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5c0b31_fdf4_46a5_a840_861369481f5a.slice/crio-d7e0ed29b59120a34a662cf56638b138286390c944e51c747d94c98fa6058f48 WatchSource:0}: Error finding container d7e0ed29b59120a34a662cf56638b138286390c944e51c747d94c98fa6058f48: Status 404 returned error can't find the container with id d7e0ed29b59120a34a662cf56638b138286390c944e51c747d94c98fa6058f48 May 29 10:09:05.078021 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.077992 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f6vs6"] May 29 10:09:05.081373 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:05.081342 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2100660c_80ac_412b_8f52_5648c846322e.slice/crio-c3a572b04c9b4fd4477a2de7c5b6866e4050dc99b7df8ae5cb3d2f81cafcabe1 WatchSource:0}: Error finding container c3a572b04c9b4fd4477a2de7c5b6866e4050dc99b7df8ae5cb3d2f81cafcabe1: Status 404 returned error can't find the container with id c3a572b04c9b4fd4477a2de7c5b6866e4050dc99b7df8ae5cb3d2f81cafcabe1 May 29 10:09:05.313604 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.313558 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgw6k" event={"ID":"52ee49d5-2c65-4f14-8f87-532905395c93","Type":"ContainerStarted","Data":"1dd660af85751f9cf599074877944d7206608bfde05de322cb456d5ebcfd0818"} May 29 10:09:05.314939 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.314911 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" event={"ID":"3f9391f8-e070-40eb-9587-cf5c0c1e8782","Type":"ContainerStarted","Data":"c0816df8c6b4de161de69829521329aaeb16235cc21686c0c6bd198cec8a6280"} May 29 10:09:05.315057 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.314950 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" event={"ID":"3f9391f8-e070-40eb-9587-cf5c0c1e8782","Type":"ContainerStarted","Data":"94bf94a77f76ee02e0fc4701dc4e614cea4cf4935f3677643a1b1489f7cfc466"} May 29 10:09:05.315057 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.315014 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:09:05.316110 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.316085 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f6vs6" event={"ID":"2100660c-80ac-412b-8f52-5648c846322e","Type":"ContainerStarted","Data":"c3a572b04c9b4fd4477a2de7c5b6866e4050dc99b7df8ae5cb3d2f81cafcabe1"} May 29 10:09:05.317095 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.317071 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6ns82" event={"ID":"de5c0b31-fdf4-46a5-a840-861369481f5a","Type":"ContainerStarted","Data":"d7e0ed29b59120a34a662cf56638b138286390c944e51c747d94c98fa6058f48"} May 29 10:09:05.318049 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.318032 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b5znn" event={"ID":"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1","Type":"ContainerStarted","Data":"847c3a687540e611d0b671f106088180f854214d2fde0c4923b99398f6fe2ac6"} May 29 10:09:05.336793 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:05.336751 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" podStartSLOduration=50.336735728 podStartE2EDuration="50.336735728s" podCreationTimestamp="2026-05-29 10:08:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:09:05.335882406 +0000 UTC m=+66.968923562" watchObservedRunningTime="2026-05-29 10:09:05.336735728 +0000 UTC m=+66.969776894" May 29 10:09:06.215485 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.213946 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ng7kp"] May 29 10:09:06.218397 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.217159 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.221633 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.221218 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 10:09:06.221887 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.221860 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l9xpv\"" May 29 10:09:06.222011 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.221991 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 10:09:06.222153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.222123 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 10:09:06.222284 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.222266 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 10:09:06.231029 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.230977 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ng7kp"] May 29 10:09:06.294937 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.294856 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-558f9567bc-x4nfr"] May 29 10:09:06.330088 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.330051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-crio-socket\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.330088 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.330096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-data-volume\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.330341 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.330116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.330341 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.330196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.330341 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.330299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dfwl\" (UniqueName: \"kubernetes.io/projected/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-kube-api-access-5dfwl\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.341693 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.341662 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t"] May 29 10:09:06.343817 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.343792 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.348989 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.348778 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 29 10:09:06.352308 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.352282 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 29 10:09:06.352405 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.352352 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 29 10:09:06.362682 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.362591 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 29 10:09:06.362811 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.362594 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 29 10:09:06.362973 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.362956 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 29 10:09:06.370011 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.369974 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 29 10:09:06.384527 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.384481 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t"] May 29 10:09:06.431480 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431446 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-crio-socket\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.431667 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431495 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-data-volume\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.431667 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431595 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-crio-socket\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.431667 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.431866 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431684 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.431866 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.431866 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c664596b-3898-47bc-9b73-8c8e7778a493-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.431866 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431800 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dfwl\" (UniqueName: \"kubernetes.io/projected/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-kube-api-access-5dfwl\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.431866 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmn4t\" (UniqueName: \"kubernetes.io/projected/c664596b-3898-47bc-9b73-8c8e7778a493-kube-api-access-rmn4t\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.432111 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431865 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-data-volume\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.432111 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.431899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-hub\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.432111 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.432078 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-ca\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.435857 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.432917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.435857 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.433425 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.435857 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.434469 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.480931 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.480691 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75b69bbb74-wd7zp"] May 29 10:09:06.483021 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.482995 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.483927 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.483868 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dfwl\" (UniqueName: \"kubernetes.io/projected/0d570318-317d-4f5d-8431-9b6fc9f7d9a3-kube-api-access-5dfwl\") pod \"insights-runtime-extractor-ng7kp\" (UID: \"0d570318-317d-4f5d-8431-9b6fc9f7d9a3\") " pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.513847 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.513787 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75b69bbb74-wd7zp"] May 29 10:09:06.531079 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.531049 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ng7kp" May 29 10:09:06.534034 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c664596b-3898-47bc-9b73-8c8e7778a493-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.534171 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-registry-tls\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.534171 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cca78f8-3a02-40a6-8923-3079d11740e2-image-registry-private-configuration\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.534171 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cca78f8-3a02-40a6-8923-3079d11740e2-trusted-ca\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.534337 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534242 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmn4t\" (UniqueName: \"kubernetes.io/projected/c664596b-3898-47bc-9b73-8c8e7778a493-kube-api-access-rmn4t\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.534337 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cca78f8-3a02-40a6-8923-3079d11740e2-installation-pull-secrets\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.534337 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534303 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-hub\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.534337 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534330 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-ca\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.534511 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534368 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.534511 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cca78f8-3a02-40a6-8923-3079d11740e2-registry-certificates\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.534511 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n4pp\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-kube-api-access-9n4pp\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.534511 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-bound-sa-token\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.534511 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cca78f8-3a02-40a6-8923-3079d11740e2-ca-trust-extracted\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.534511 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534496 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.535177 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.534813 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c664596b-3898-47bc-9b73-8c8e7778a493-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.537500 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.537464 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.537625 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.537600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-ca\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.537942 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.537900 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-hub\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.538350 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.538318 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c664596b-3898-47bc-9b73-8c8e7778a493-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.561847 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.561767 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmn4t\" (UniqueName: \"kubernetes.io/projected/c664596b-3898-47bc-9b73-8c8e7778a493-kube-api-access-rmn4t\") pod \"cluster-proxy-proxy-agent-7f74dbd779-r968t\" (UID: \"c664596b-3898-47bc-9b73-8c8e7778a493\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.635120 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.635082 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cca78f8-3a02-40a6-8923-3079d11740e2-installation-pull-secrets\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.635285 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.635145 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cca78f8-3a02-40a6-8923-3079d11740e2-registry-certificates\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.635285 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.635174 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9n4pp\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-kube-api-access-9n4pp\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.635285 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.635210 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-bound-sa-token\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.635285 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.635242 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cca78f8-3a02-40a6-8923-3079d11740e2-ca-trust-extracted\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.635285 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.635273 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-registry-tls\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.635550 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.635318 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cca78f8-3a02-40a6-8923-3079d11740e2-image-registry-private-configuration\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.635550 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.635350 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cca78f8-3a02-40a6-8923-3079d11740e2-trusted-ca\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.636116 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.636090 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cca78f8-3a02-40a6-8923-3079d11740e2-registry-certificates\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.636518 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.636401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cca78f8-3a02-40a6-8923-3079d11740e2-ca-trust-extracted\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.636518 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.636445 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cca78f8-3a02-40a6-8923-3079d11740e2-trusted-ca\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.638307 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.638280 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cca78f8-3a02-40a6-8923-3079d11740e2-installation-pull-secrets\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.638781 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.638735 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-registry-tls\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.639100 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.639079 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cca78f8-3a02-40a6-8923-3079d11740e2-image-registry-private-configuration\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.645564 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.645523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-bound-sa-token\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.648174 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.648133 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n4pp\" (UniqueName: \"kubernetes.io/projected/7cca78f8-3a02-40a6-8923-3079d11740e2-kube-api-access-9n4pp\") pod \"image-registry-75b69bbb74-wd7zp\" (UID: \"7cca78f8-3a02-40a6-8923-3079d11740e2\") " pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:06.664901 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.664869 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" May 29 10:09:06.802390 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:06.802326 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:07.318020 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.317986 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hk7nq"] May 29 10:09:07.320968 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.320944 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.335021 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.334997 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 10:09:07.343336 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.343305 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hk7nq"] May 29 10:09:07.442953 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.442918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41fde825-3bee-419f-8c77-b89b667c2148-dbus\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.443135 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.442976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41fde825-3bee-419f-8c77-b89b667c2148-kubelet-config\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.443135 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.443008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41fde825-3bee-419f-8c77-b89b667c2148-original-pull-secret\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.544188 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.544147 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41fde825-3bee-419f-8c77-b89b667c2148-kubelet-config\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.544385 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.544207 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41fde825-3bee-419f-8c77-b89b667c2148-original-pull-secret\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.544385 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.544286 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41fde825-3bee-419f-8c77-b89b667c2148-kubelet-config\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.544385 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.544303 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41fde825-3bee-419f-8c77-b89b667c2148-dbus\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.544538 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.544443 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41fde825-3bee-419f-8c77-b89b667c2148-dbus\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.546890 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.546867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41fde825-3bee-419f-8c77-b89b667c2148-original-pull-secret\") pod \"global-pull-secret-syncer-hk7nq\" (UID: \"41fde825-3bee-419f-8c77-b89b667c2148\") " pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:07.632767 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:07.632719 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk7nq" May 29 10:09:08.340400 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:08.340344 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6ns82" event={"ID":"de5c0b31-fdf4-46a5-a840-861369481f5a","Type":"ContainerStarted","Data":"4828ce115aaf1b539a11b076dd72db87e1c313d93a9d9ecf8aa63b22275e994a"} May 29 10:09:08.402479 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:08.402428 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t"] May 29 10:09:08.484112 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:08.480899 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ng7kp"] May 29 10:09:08.484112 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:08.481899 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75b69bbb74-wd7zp"] May 29 10:09:08.498346 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:08.498308 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cca78f8_3a02_40a6_8923_3079d11740e2.slice/crio-8b67b7e551937586b6d2e5abbd65e230b466244e4a5d8a888cc48a2fa11a1787 WatchSource:0}: Error finding container 8b67b7e551937586b6d2e5abbd65e230b466244e4a5d8a888cc48a2fa11a1787: Status 404 returned error can't find the container with id 8b67b7e551937586b6d2e5abbd65e230b466244e4a5d8a888cc48a2fa11a1787 May 29 10:09:08.502472 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:08.502439 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hk7nq"] May 29 10:09:08.506391 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:08.506347 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fde825_3bee_419f_8c77_b89b667c2148.slice/crio-7c299406f1ca9e68cb767dc0a5b36ccb7344338fc34bc74352cf8c05e5190152 WatchSource:0}: Error finding container 7c299406f1ca9e68cb767dc0a5b36ccb7344338fc34bc74352cf8c05e5190152: Status 404 returned error can't find the container with id 7c299406f1ca9e68cb767dc0a5b36ccb7344338fc34bc74352cf8c05e5190152 May 29 10:09:09.074755 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.072290 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm"] May 29 10:09:09.078001 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.077966 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" May 29 10:09:09.081522 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.081496 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 29 10:09:09.081687 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.081669 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qgtx4\"" May 29 10:09:09.091775 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.091730 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm"] May 29 10:09:09.158845 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.158793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7127f5cd-245a-4a9e-a1fb-f322c89306b7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm\" (UID: \"7127f5cd-245a-4a9e-a1fb-f322c89306b7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" May 29 10:09:09.260427 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.260127 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7127f5cd-245a-4a9e-a1fb-f322c89306b7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm\" (UID: \"7127f5cd-245a-4a9e-a1fb-f322c89306b7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" May 29 10:09:09.260427 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:09:09.260276 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 29 10:09:09.260427 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:09:09.260347 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7127f5cd-245a-4a9e-a1fb-f322c89306b7-tls-certificates podName:7127f5cd-245a-4a9e-a1fb-f322c89306b7 nodeName:}" failed. No retries permitted until 2026-05-29 10:09:09.760325734 +0000 UTC m=+71.393366873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7127f5cd-245a-4a9e-a1fb-f322c89306b7-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" (UID: "7127f5cd-245a-4a9e-a1fb-f322c89306b7") : secret "prometheus-operator-admission-webhook-tls" not found May 29 10:09:09.354026 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.353942 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ng7kp" event={"ID":"0d570318-317d-4f5d-8431-9b6fc9f7d9a3","Type":"ContainerStarted","Data":"34f9101e65553307139e14f4a7c856116f286a4de666825e59733f9fb5526f1e"} May 29 10:09:09.354026 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.353990 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ng7kp" event={"ID":"0d570318-317d-4f5d-8431-9b6fc9f7d9a3","Type":"ContainerStarted","Data":"7d175509db84bd00aac638c49245d6ca98f1c393df02034c2e2d6be4b48f6998"} May 29 10:09:09.357880 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.357701 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f6vs6" event={"ID":"2100660c-80ac-412b-8f52-5648c846322e","Type":"ContainerStarted","Data":"e13eba29a09ceefe68a8e812760939a169c7bbf04783d9428a28eda9ae22731a"} May 29 10:09:09.358084 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.358061 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:09:09.367182 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.367123 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b5znn" event={"ID":"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1","Type":"ContainerStarted","Data":"80c3c7215e4e8936d2f541c9b59ed63ec6227ad93c2ceacf6bcfeec0e3b2dab1"} May 29 10:09:09.367182 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.367160 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b5znn" event={"ID":"5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1","Type":"ContainerStarted","Data":"d93d7c5e41b47d109382a2b38f131d57008650e0f55972d929c4c36848825470"} May 29 10:09:09.369097 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.369068 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" event={"ID":"7cca78f8-3a02-40a6-8923-3079d11740e2","Type":"ContainerStarted","Data":"19d2438c392ace635753678ae1bbe14282992bfbdd45ea8898c736b1a42c273b"} May 29 10:09:09.369204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.369105 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" event={"ID":"7cca78f8-3a02-40a6-8923-3079d11740e2","Type":"ContainerStarted","Data":"8b67b7e551937586b6d2e5abbd65e230b466244e4a5d8a888cc48a2fa11a1787"} May 29 10:09:09.369468 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.369445 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:09.372141 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.372112 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgw6k" event={"ID":"52ee49d5-2c65-4f14-8f87-532905395c93","Type":"ContainerStarted","Data":"5927ff710c99d3664bf971ddea78f49b7939aa2651a412277f5b00056d390cc2"} May 29 10:09:09.372254 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.372149 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgw6k" event={"ID":"52ee49d5-2c65-4f14-8f87-532905395c93","Type":"ContainerStarted","Data":"d9f1862bb67129f65f999f3d7fc972dd57045481b1bc38699dbc0a158afc15e9"} May 29 10:09:09.372685 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.372666 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tgw6k" May 29 10:09:09.374850 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.374792 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" event={"ID":"c664596b-3898-47bc-9b73-8c8e7778a493","Type":"ContainerStarted","Data":"36768c85cbc3095d05a80b61818c51e96d3ed9c6a8049555248ff312591ea794"} May 29 10:09:09.377134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.376749 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hk7nq" event={"ID":"41fde825-3bee-419f-8c77-b89b667c2148","Type":"ContainerStarted","Data":"7c299406f1ca9e68cb767dc0a5b36ccb7344338fc34bc74352cf8c05e5190152"} May 29 10:09:09.393488 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.393421 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" podStartSLOduration=3.393401859 podStartE2EDuration="3.393401859s" podCreationTimestamp="2026-05-29 10:09:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:09:09.39292926 +0000 UTC m=+71.025970417" watchObservedRunningTime="2026-05-29 10:09:09.393401859 +0000 UTC m=+71.026443029" May 29 10:09:09.394459 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.394413 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f6vs6" podStartSLOduration=67.266689144 podStartE2EDuration="1m10.394402121s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:09:05.08316218 +0000 UTC m=+66.716203317" lastFinishedPulling="2026-05-29 10:09:08.210875147 +0000 UTC m=+69.843916294" observedRunningTime="2026-05-29 10:09:09.373637045 +0000 UTC m=+71.006678201" watchObservedRunningTime="2026-05-29 10:09:09.394402121 +0000 UTC m=+71.027443279" May 29 10:09:09.416336 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.416174 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b5znn" podStartSLOduration=67.262752768 podStartE2EDuration="1m10.416156751s" podCreationTimestamp="2026-05-29 10:07:59 +0000 UTC" firstStartedPulling="2026-05-29 10:09:05.002973516 +0000 UTC m=+66.636014666" lastFinishedPulling="2026-05-29 10:09:08.156377501 +0000 UTC m=+69.789418649" observedRunningTime="2026-05-29 10:09:09.412100643 +0000 UTC m=+71.045141798" watchObservedRunningTime="2026-05-29 10:09:09.416156751 +0000 UTC m=+71.049197908" May 29 10:09:09.443772 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.443705 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-tgw6k" podStartSLOduration=34.29372758 podStartE2EDuration="37.443690834s" podCreationTimestamp="2026-05-29 10:08:32 +0000 UTC" firstStartedPulling="2026-05-29 10:09:05.030844448 +0000 UTC m=+66.663885581" lastFinishedPulling="2026-05-29 10:09:08.180807685 +0000 UTC m=+69.813848835" observedRunningTime="2026-05-29 10:09:09.44110101 +0000 UTC m=+71.074142166" watchObservedRunningTime="2026-05-29 10:09:09.443690834 +0000 UTC m=+71.076731986" May 29 10:09:09.469508 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.468205 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6ns82" podStartSLOduration=34.352786401 podStartE2EDuration="37.468183192s" podCreationTimestamp="2026-05-29 10:08:32 +0000 UTC" firstStartedPulling="2026-05-29 10:09:05.064286311 +0000 UTC m=+66.697327444" lastFinishedPulling="2026-05-29 10:09:08.179683084 +0000 UTC m=+69.812724235" observedRunningTime="2026-05-29 10:09:09.467107321 +0000 UTC m=+71.100148479" watchObservedRunningTime="2026-05-29 10:09:09.468183192 +0000 UTC m=+71.101224341" May 29 10:09:09.765636 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.765553 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7127f5cd-245a-4a9e-a1fb-f322c89306b7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm\" (UID: \"7127f5cd-245a-4a9e-a1fb-f322c89306b7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" May 29 10:09:09.768731 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.768697 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7127f5cd-245a-4a9e-a1fb-f322c89306b7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm\" (UID: \"7127f5cd-245a-4a9e-a1fb-f322c89306b7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" May 29 10:09:09.990533 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:09.990496 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" May 29 10:09:10.382757 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:10.382714 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ng7kp" event={"ID":"0d570318-317d-4f5d-8431-9b6fc9f7d9a3","Type":"ContainerStarted","Data":"4607cbe81b6cc5d279794f9152b5ea9e0afa0e9eb6aeb382080e4de9b490a8bd"} May 29 10:09:13.233258 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:13.233225 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm"] May 29 10:09:13.236158 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:13.236127 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7127f5cd_245a_4a9e_a1fb_f322c89306b7.slice/crio-7bb21e4829e4b68285fffc271bac4000bdf877ca49a18df5f039f24d9dc163ef WatchSource:0}: Error finding container 7bb21e4829e4b68285fffc271bac4000bdf877ca49a18df5f039f24d9dc163ef: Status 404 returned error can't find the container with id 7bb21e4829e4b68285fffc271bac4000bdf877ca49a18df5f039f24d9dc163ef May 29 10:09:13.391868 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:13.391768 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" event={"ID":"c664596b-3898-47bc-9b73-8c8e7778a493","Type":"ContainerStarted","Data":"dbad94a70fc4df62394362655cd464401c90fef7c3a74bf5c54bf56427701663"} May 29 10:09:13.393010 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:13.392990 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hk7nq" event={"ID":"41fde825-3bee-419f-8c77-b89b667c2148","Type":"ContainerStarted","Data":"45a3637b91f2b3aed7f9a645d6037bf7c6cce165b1b3b753e62655ffd4390e64"} May 29 10:09:13.394885 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:13.394863 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ng7kp" event={"ID":"0d570318-317d-4f5d-8431-9b6fc9f7d9a3","Type":"ContainerStarted","Data":"6e75179917fe9900f7db5aa06b90c4043658c340f88e4147123c475bc4cbf15b"} May 29 10:09:13.395868 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:13.395847 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" event={"ID":"7127f5cd-245a-4a9e-a1fb-f322c89306b7","Type":"ContainerStarted","Data":"7bb21e4829e4b68285fffc271bac4000bdf877ca49a18df5f039f24d9dc163ef"} May 29 10:09:13.456158 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:13.456096 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ng7kp" podStartSLOduration=2.917183535 podStartE2EDuration="7.456075437s" podCreationTimestamp="2026-05-29 10:09:06 +0000 UTC" firstStartedPulling="2026-05-29 10:09:08.55798323 +0000 UTC m=+70.191024380" lastFinishedPulling="2026-05-29 10:09:13.096875142 +0000 UTC m=+74.729916282" observedRunningTime="2026-05-29 10:09:13.454892261 +0000 UTC m=+75.087933415" watchObservedRunningTime="2026-05-29 10:09:13.456075437 +0000 UTC m=+75.089116597" May 29 10:09:13.456731 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:13.456703 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hk7nq" podStartSLOduration=1.875062993 podStartE2EDuration="6.456695706s" podCreationTimestamp="2026-05-29 10:09:07 +0000 UTC" firstStartedPulling="2026-05-29 10:09:08.50877809 +0000 UTC m=+70.141819228" lastFinishedPulling="2026-05-29 10:09:13.090410808 +0000 UTC m=+74.723451941" observedRunningTime="2026-05-29 10:09:13.427116903 +0000 UTC m=+75.060158059" watchObservedRunningTime="2026-05-29 10:09:13.456695706 +0000 UTC m=+75.089736861" May 29 10:09:16.406642 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:16.406604 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" event={"ID":"c664596b-3898-47bc-9b73-8c8e7778a493","Type":"ContainerStarted","Data":"a4bdb9d34f6fa2b2a8c0fb268402c4b81aa01458f9fc9fb6b46e5193bd5b4794"} May 29 10:09:16.407144 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:16.406649 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" event={"ID":"c664596b-3898-47bc-9b73-8c8e7778a493","Type":"ContainerStarted","Data":"aee39697d4a80254aff5b4a3b524cf4e23711761727edf681c1ea4e121eec8b5"} May 29 10:09:16.407871 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:16.407850 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" event={"ID":"7127f5cd-245a-4a9e-a1fb-f322c89306b7","Type":"ContainerStarted","Data":"aa702d1f1f128f41d1c3ed8b21939ae487056f4251c4d6b93143d31a91ec9898"} May 29 10:09:16.408083 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:16.408066 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" May 29 10:09:16.412745 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:16.412722 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" May 29 10:09:16.432248 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:16.432206 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f74dbd779-r968t" podStartSLOduration=3.05960177 podStartE2EDuration="10.432192883s" podCreationTimestamp="2026-05-29 10:09:06 +0000 UTC" firstStartedPulling="2026-05-29 10:09:08.411547761 +0000 UTC m=+70.044588904" lastFinishedPulling="2026-05-29 10:09:15.784138883 +0000 UTC m=+77.417180017" observedRunningTime="2026-05-29 10:09:16.431404088 +0000 UTC m=+78.064445242" watchObservedRunningTime="2026-05-29 10:09:16.432192883 +0000 UTC m=+78.065234109" May 29 10:09:16.448950 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:16.448883 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm" podStartSLOduration=4.929963412 podStartE2EDuration="7.448865246s" podCreationTimestamp="2026-05-29 10:09:09 +0000 UTC" firstStartedPulling="2026-05-29 10:09:13.238045246 +0000 UTC m=+74.871086393" lastFinishedPulling="2026-05-29 10:09:15.756947094 +0000 UTC m=+77.389988227" observedRunningTime="2026-05-29 10:09:16.448175534 +0000 UTC m=+78.081216689" watchObservedRunningTime="2026-05-29 10:09:16.448865246 +0000 UTC m=+78.081906403" May 29 10:09:17.353917 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.353881 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-qzmrm"] May 29 10:09:17.355635 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.355619 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-qzmrm" May 29 10:09:17.357666 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.357642 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 29 10:09:17.357783 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.357686 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pd44k\"" May 29 10:09:17.358058 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.358044 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 29 10:09:17.368952 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.368922 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-qzmrm"] May 29 10:09:17.432450 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.432412 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jmvw\" (UniqueName: \"kubernetes.io/projected/adb98195-4ca3-420e-b000-4241dd6934bb-kube-api-access-2jmvw\") pod \"downloads-57bd96b888-qzmrm\" (UID: \"adb98195-4ca3-420e-b000-4241dd6934bb\") " pod="openshift-console/downloads-57bd96b888-qzmrm" May 29 10:09:17.534087 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.534047 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jmvw\" (UniqueName: \"kubernetes.io/projected/adb98195-4ca3-420e-b000-4241dd6934bb-kube-api-access-2jmvw\") pod \"downloads-57bd96b888-qzmrm\" (UID: \"adb98195-4ca3-420e-b000-4241dd6934bb\") " pod="openshift-console/downloads-57bd96b888-qzmrm" May 29 10:09:17.542645 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.542612 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jmvw\" (UniqueName: \"kubernetes.io/projected/adb98195-4ca3-420e-b000-4241dd6934bb-kube-api-access-2jmvw\") pod \"downloads-57bd96b888-qzmrm\" (UID: \"adb98195-4ca3-420e-b000-4241dd6934bb\") " pod="openshift-console/downloads-57bd96b888-qzmrm" May 29 10:09:17.664558 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.664465 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-qzmrm" May 29 10:09:17.789594 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:17.789560 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-qzmrm"] May 29 10:09:17.794366 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:17.792551 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb98195_4ca3_420e_b000_4241dd6934bb.slice/crio-529a6c570c0928e487c0e7969a0c4fe7e317f35ec83518d335736b76735a352d WatchSource:0}: Error finding container 529a6c570c0928e487c0e7969a0c4fe7e317f35ec83518d335736b76735a352d: Status 404 returned error can't find the container with id 529a6c570c0928e487c0e7969a0c4fe7e317f35ec83518d335736b76735a352d May 29 10:09:18.415073 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:18.415037 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-qzmrm" event={"ID":"adb98195-4ca3-420e-b000-4241dd6934bb","Type":"ContainerStarted","Data":"529a6c570c0928e487c0e7969a0c4fe7e317f35ec83518d335736b76735a352d"} May 29 10:09:20.388579 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:20.388544 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tgw6k" May 29 10:09:25.461076 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.461000 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ft42h"] May 29 10:09:25.465130 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.464706 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.471965 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.470588 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-scsx8"] May 29 10:09:25.472145 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.472038 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 10:09:25.472332 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.472303 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 29 10:09:25.472612 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.472588 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 29 10:09:25.472612 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.472597 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 10:09:25.472870 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.472820 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 10:09:25.472957 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.472892 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vl6bc\"" May 29 10:09:25.474375 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.474074 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.480246 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.478507 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 10:09:25.480246 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.478795 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 10:09:25.480811 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.480787 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ft42h"] May 29 10:09:25.480957 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.480942 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8bclw\"" May 29 10:09:25.481853 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.481706 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 10:09:25.500565 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.500531 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp"] May 29 10:09:25.503635 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.503593 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.507096 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.507071 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 29 10:09:25.507916 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.507870 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 29 10:09:25.508231 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.508085 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p6zw6\"" May 29 10:09:25.508384 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.508365 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 29 10:09:25.528404 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.528361 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp"] May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.604705 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-textfile\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.604755 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6405c877-ede8-46fb-91c6-229696f2bcf5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.604788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j24x\" (UniqueName: \"kubernetes.io/projected/c994964f-15d7-4002-ae53-3ba077d06a33-kube-api-access-7j24x\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.604891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-tls\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.604921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c994964f-15d7-4002-ae53-3ba077d06a33-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.604971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.604997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxb6h\" (UniqueName: \"kubernetes.io/projected/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-api-access-gxb6h\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-root\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef88541a-f86a-418f-8d4b-f00f34a3325a-metrics-client-ca\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-wtmp\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605119 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6405c877-ede8-46fb-91c6-229696f2bcf5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-accelerators-collector-config\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.605697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.606686 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.606686 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-sys\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.606686 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.606686 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.605448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk9zt\" (UniqueName: \"kubernetes.io/projected/ef88541a-f86a-418f-8d4b-f00f34a3325a-kube-api-access-bk9zt\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.706618 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706557 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef88541a-f86a-418f-8d4b-f00f34a3325a-metrics-client-ca\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.706805 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706623 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-wtmp\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.706805 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706691 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.706805 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706726 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.706805 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706755 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6405c877-ede8-46fb-91c6-229696f2bcf5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.706805 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706786 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-accelerators-collector-config\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706817 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706868 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706900 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-sys\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706936 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.706966 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bk9zt\" (UniqueName: \"kubernetes.io/projected/ef88541a-f86a-418f-8d4b-f00f34a3325a-kube-api-access-bk9zt\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707008 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-textfile\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707031 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6405c877-ede8-46fb-91c6-229696f2bcf5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707064 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7j24x\" (UniqueName: \"kubernetes.io/projected/c994964f-15d7-4002-ae53-3ba077d06a33-kube-api-access-7j24x\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.707108 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707093 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-tls\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707117 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c994964f-15d7-4002-ae53-3ba077d06a33-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.707537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707168 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.707537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707196 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxb6h\" (UniqueName: \"kubernetes.io/projected/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-api-access-gxb6h\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.707537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707230 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-root\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707260 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef88541a-f86a-418f-8d4b-f00f34a3325a-metrics-client-ca\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707331 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-root\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707388 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-wtmp\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707933 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:09:25.707897 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 29 10:09:25.707992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.707962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-textfile\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.707992 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:09:25.707982 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-tls podName:c994964f-15d7-4002-ae53-3ba077d06a33 nodeName:}" failed. No retries permitted until 2026-05-29 10:09:26.207960831 +0000 UTC m=+87.841001967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-ft42h" (UID: "c994964f-15d7-4002-ae53-3ba077d06a33") : secret "openshift-state-metrics-tls" not found May 29 10:09:25.708214 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.708186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-accelerators-collector-config\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.708453 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.708429 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.708540 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.708517 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6405c877-ede8-46fb-91c6-229696f2bcf5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.708968 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.708877 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6405c877-ede8-46fb-91c6-229696f2bcf5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.708968 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.708942 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef88541a-f86a-418f-8d4b-f00f34a3325a-sys\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.709130 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.709088 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c994964f-15d7-4002-ae53-3ba077d06a33-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.711414 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.711297 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.711414 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.711352 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.712041 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.711607 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-tls\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.712041 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.711952 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef88541a-f86a-418f-8d4b-f00f34a3325a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.712041 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.712003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.717812 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.717784 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j24x\" (UniqueName: \"kubernetes.io/projected/c994964f-15d7-4002-ae53-3ba077d06a33-kube-api-access-7j24x\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:25.718903 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.718877 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxb6h\" (UniqueName: \"kubernetes.io/projected/6405c877-ede8-46fb-91c6-229696f2bcf5-kube-api-access-gxb6h\") pod \"kube-state-metrics-54fd6bc5c4-lvpcp\" (UID: \"6405c877-ede8-46fb-91c6-229696f2bcf5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.718992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.718919 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk9zt\" (UniqueName: \"kubernetes.io/projected/ef88541a-f86a-418f-8d4b-f00f34a3325a-kube-api-access-bk9zt\") pod \"node-exporter-scsx8\" (UID: \"ef88541a-f86a-418f-8d4b-f00f34a3325a\") " pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.793433 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.793390 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scsx8" May 29 10:09:25.801897 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:25.801861 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef88541a_f86a_418f_8d4b_f00f34a3325a.slice/crio-c26ae6aafddc8def7b125b3e17724d685161f6711affb16b877a3e5ffb07106d WatchSource:0}: Error finding container c26ae6aafddc8def7b125b3e17724d685161f6711affb16b877a3e5ffb07106d: Status 404 returned error can't find the container with id c26ae6aafddc8def7b125b3e17724d685161f6711affb16b877a3e5ffb07106d May 29 10:09:25.816973 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.816943 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" May 29 10:09:25.991598 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:25.991529 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp"] May 29 10:09:25.994091 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:25.994053 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6405c877_ede8_46fb_91c6_229696f2bcf5.slice/crio-77f1344eace830c8628a586a903a6543d223305af452efd827045488ce837e54 WatchSource:0}: Error finding container 77f1344eace830c8628a586a903a6543d223305af452efd827045488ce837e54: Status 404 returned error can't find the container with id 77f1344eace830c8628a586a903a6543d223305af452efd827045488ce837e54 May 29 10:09:26.213203 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:26.213163 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:26.216103 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:26.216068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c994964f-15d7-4002-ae53-3ba077d06a33-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ft42h\" (UID: \"c994964f-15d7-4002-ae53-3ba077d06a33\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:26.386771 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:26.386740 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" May 29 10:09:26.441489 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:26.441424 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" event={"ID":"6405c877-ede8-46fb-91c6-229696f2bcf5","Type":"ContainerStarted","Data":"77f1344eace830c8628a586a903a6543d223305af452efd827045488ce837e54"} May 29 10:09:26.443078 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:26.443026 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scsx8" event={"ID":"ef88541a-f86a-418f-8d4b-f00f34a3325a","Type":"ContainerStarted","Data":"c26ae6aafddc8def7b125b3e17724d685161f6711affb16b877a3e5ffb07106d"} May 29 10:09:26.572387 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:26.572354 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ft42h"] May 29 10:09:26.816366 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:26.813905 2575 patch_prober.go:28] interesting pod/image-registry-75b69bbb74-wd7zp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 10:09:26.816366 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:26.813990 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" podUID="7cca78f8-3a02-40a6-8923-3079d11740e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 10:09:27.329435 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.329407 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:09:27.447114 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.447075 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" event={"ID":"6405c877-ede8-46fb-91c6-229696f2bcf5","Type":"ContainerStarted","Data":"92044a25db2fc4e6bb9962fd8e2802448c974b940fb37683c99ddd9255c47002"} May 29 10:09:27.449728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.449699 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" event={"ID":"c994964f-15d7-4002-ae53-3ba077d06a33","Type":"ContainerStarted","Data":"8f0198fdfc9cb9d9cd78f38489b976a48abe56434f85e3da5541b67c63bab350"} May 29 10:09:27.449879 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.449748 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" event={"ID":"c994964f-15d7-4002-ae53-3ba077d06a33","Type":"ContainerStarted","Data":"73ea8e8b60c74e3f64227e4cbdef41c7a2a0f188ba9ecffc3c130734adfa03b0"} May 29 10:09:27.449879 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.449763 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" event={"ID":"c994964f-15d7-4002-ae53-3ba077d06a33","Type":"ContainerStarted","Data":"68b3d2c3c87599469a7e85154ce86cb2a0a026eae47874788f0ae8e46aa1fa50"} May 29 10:09:27.452107 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.452077 2575 generic.go:358] "Generic (PLEG): container finished" podID="ef88541a-f86a-418f-8d4b-f00f34a3325a" containerID="4554ce812d06112086ecbbcb0777ac19fbfccb75a37be75f2a0448c1ec2bc9dd" exitCode=0 May 29 10:09:27.452217 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.452165 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scsx8" event={"ID":"ef88541a-f86a-418f-8d4b-f00f34a3325a","Type":"ContainerDied","Data":"4554ce812d06112086ecbbcb0777ac19fbfccb75a37be75f2a0448c1ec2bc9dd"} May 29 10:09:27.931153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.931063 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dcc8f4b8-vpb8g"] May 29 10:09:27.933423 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.933395 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:27.947511 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.947484 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 29 10:09:27.947817 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.947755 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 29 10:09:27.948520 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.948171 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 29 10:09:27.948520 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.948319 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 29 10:09:27.948520 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.948389 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4c9fs\"" May 29 10:09:27.948520 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.948506 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 29 10:09:27.964089 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:27.964054 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcc8f4b8-vpb8g"] May 29 10:09:28.033977 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.033936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-service-ca\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.034173 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.033993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-serving-cert\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.034173 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.034070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-console-config\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.034173 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.034128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-oauth-serving-cert\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.034333 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.034212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt8km\" (UniqueName: \"kubernetes.io/projected/d15e4c2e-9367-4361-8b12-25016361c68a-kube-api-access-vt8km\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.034333 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.034291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-oauth-config\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.134956 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.134850 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt8km\" (UniqueName: \"kubernetes.io/projected/d15e4c2e-9367-4361-8b12-25016361c68a-kube-api-access-vt8km\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.134956 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.134890 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-oauth-config\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.134956 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.134916 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-service-ca\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.134956 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.134944 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-serving-cert\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.135176 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.134976 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-console-config\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.135176 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.135012 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-oauth-serving-cert\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.141169 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.136058 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-service-ca\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.141169 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.136281 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-console-config\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.141169 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.136744 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-oauth-serving-cert\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.141985 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.141961 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-oauth-config\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.143647 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.143616 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-serving-cert\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.144063 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.144041 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt8km\" (UniqueName: \"kubernetes.io/projected/d15e4c2e-9367-4361-8b12-25016361c68a-kube-api-access-vt8km\") pod \"console-7dcc8f4b8-vpb8g\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.247910 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.247747 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:28.388121 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.388086 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcc8f4b8-vpb8g"] May 29 10:09:28.391681 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:28.391646 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15e4c2e_9367_4361_8b12_25016361c68a.slice/crio-d6432b4d791d732d3f14e5d3cde2e9468d2f57181c37406d5991deab8d1a8065 WatchSource:0}: Error finding container d6432b4d791d732d3f14e5d3cde2e9468d2f57181c37406d5991deab8d1a8065: Status 404 returned error can't find the container with id d6432b4d791d732d3f14e5d3cde2e9468d2f57181c37406d5991deab8d1a8065 May 29 10:09:28.460642 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.460520 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scsx8" event={"ID":"ef88541a-f86a-418f-8d4b-f00f34a3325a","Type":"ContainerStarted","Data":"0884f69a0996d3d572fadcbb97aab1f6aaf2ae6b990a88f6d4543394bfb341fe"} May 29 10:09:28.460642 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.460567 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scsx8" event={"ID":"ef88541a-f86a-418f-8d4b-f00f34a3325a","Type":"ContainerStarted","Data":"8a5161ced06278f4de8a79bfd068378c1d2902087eea00cc8e461a077ad1045c"} May 29 10:09:28.462935 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.462900 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" event={"ID":"6405c877-ede8-46fb-91c6-229696f2bcf5","Type":"ContainerStarted","Data":"90395c6aa67247a6c8c163d8b45371a17d9bbb449e22290591e6d9d3b3e40c4d"} May 29 10:09:28.463060 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.462942 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" event={"ID":"6405c877-ede8-46fb-91c6-229696f2bcf5","Type":"ContainerStarted","Data":"b9bdf80253a21466c5994ae14f938a0eeadad1c9d3996538ca8bae8314540c60"} May 29 10:09:28.465128 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.465088 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" event={"ID":"c994964f-15d7-4002-ae53-3ba077d06a33","Type":"ContainerStarted","Data":"93151aa20be52a3a68aae0c2bcab3c866df3efef1592cb121aa5a4382393d716"} May 29 10:09:28.466299 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.466267 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcc8f4b8-vpb8g" event={"ID":"d15e4c2e-9367-4361-8b12-25016361c68a","Type":"ContainerStarted","Data":"d6432b4d791d732d3f14e5d3cde2e9468d2f57181c37406d5991deab8d1a8065"} May 29 10:09:28.489321 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.489176 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-scsx8" podStartSLOduration=2.4361149 podStartE2EDuration="3.489155404s" podCreationTimestamp="2026-05-29 10:09:25 +0000 UTC" firstStartedPulling="2026-05-29 10:09:25.80370635 +0000 UTC m=+87.436747483" lastFinishedPulling="2026-05-29 10:09:26.856746848 +0000 UTC m=+88.489787987" observedRunningTime="2026-05-29 10:09:28.488719486 +0000 UTC m=+90.121760641" watchObservedRunningTime="2026-05-29 10:09:28.489155404 +0000 UTC m=+90.122196560" May 29 10:09:28.559100 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.559037 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-lvpcp" podStartSLOduration=2.201041371 podStartE2EDuration="3.559022247s" podCreationTimestamp="2026-05-29 10:09:25 +0000 UTC" firstStartedPulling="2026-05-29 10:09:25.996254331 +0000 UTC m=+87.629295476" lastFinishedPulling="2026-05-29 10:09:27.354235211 +0000 UTC m=+88.987276352" observedRunningTime="2026-05-29 10:09:28.5586178 +0000 UTC m=+90.191658955" watchObservedRunningTime="2026-05-29 10:09:28.559022247 +0000 UTC m=+90.192063401" May 29 10:09:28.560156 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.560116 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ft42h" podStartSLOduration=2.444923652 podStartE2EDuration="3.560104191s" podCreationTimestamp="2026-05-29 10:09:25 +0000 UTC" firstStartedPulling="2026-05-29 10:09:27.015403308 +0000 UTC m=+88.648444447" lastFinishedPulling="2026-05-29 10:09:28.130583846 +0000 UTC m=+89.763624986" observedRunningTime="2026-05-29 10:09:28.524698322 +0000 UTC m=+90.157739478" watchObservedRunningTime="2026-05-29 10:09:28.560104191 +0000 UTC m=+90.193145347" May 29 10:09:28.570398 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.570364 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69767476ff-w86nb"] May 29 10:09:28.574510 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.574487 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.580216 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.580188 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 29 10:09:28.580342 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.580293 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 29 10:09:28.580469 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.580451 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 29 10:09:28.581306 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.581277 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 29 10:09:28.581737 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.581719 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 29 10:09:28.582173 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.582070 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a9qieghdai7ql\"" May 29 10:09:28.582173 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.582074 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-h5b6w\"" May 29 10:09:28.596878 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.596810 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69767476ff-w86nb"] May 29 10:09:28.640019 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.639501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.640019 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.639557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.640019 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.639594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-tls\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.640019 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.639648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.640019 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.639675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx6x4\" (UniqueName: \"kubernetes.io/projected/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-kube-api-access-mx6x4\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.640019 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.639705 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-metrics-client-ca\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.640019 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.639743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.640019 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.639791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-grpc-tls\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.740930 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.740815 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.740930 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.740896 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mx6x4\" (UniqueName: \"kubernetes.io/projected/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-kube-api-access-mx6x4\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.740930 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.740927 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-metrics-client-ca\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.741208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.740970 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.741208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.741020 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-grpc-tls\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.741208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.741059 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.741208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.741098 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.741208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.741135 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-tls\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.742018 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.741965 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-metrics-client-ca\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.744207 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.744176 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.744207 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.744246 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-tls\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.745001 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.744973 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-grpc-tls\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.745105 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.745022 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.745105 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.745027 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.746353 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.746327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.751072 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.751050 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx6x4\" (UniqueName: \"kubernetes.io/projected/0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50-kube-api-access-mx6x4\") pod \"thanos-querier-69767476ff-w86nb\" (UID: \"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50\") " pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:28.887704 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:28.887667 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:29.054854 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.054607 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69767476ff-w86nb"] May 29 10:09:29.057702 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:29.057666 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebd81a5_aa3e_4bf7_9351_d3acc5bb2d50.slice/crio-b3b8318e2a3f5f2a5c95532cb28e6f31effca13a56eda5ce532865177cfb6f87 WatchSource:0}: Error finding container b3b8318e2a3f5f2a5c95532cb28e6f31effca13a56eda5ce532865177cfb6f87: Status 404 returned error can't find the container with id b3b8318e2a3f5f2a5c95532cb28e6f31effca13a56eda5ce532865177cfb6f87 May 29 10:09:29.471353 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.471234 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" event={"ID":"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50","Type":"ContainerStarted","Data":"b3b8318e2a3f5f2a5c95532cb28e6f31effca13a56eda5ce532865177cfb6f87"} May 29 10:09:29.871390 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.871351 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-699b487f85-tcn66"] May 29 10:09:29.874383 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.874361 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:29.879754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.879542 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cr9nkelll32ga\"" May 29 10:09:29.879754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.879555 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 10:09:29.879754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.879542 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 29 10:09:29.879754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.879636 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8vlh4\"" May 29 10:09:29.879754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.879632 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 29 10:09:29.879754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.879709 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 29 10:09:29.887051 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.886990 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-699b487f85-tcn66"] May 29 10:09:29.952621 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.952582 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65b4ceb3-9b98-4a46-9888-f82141a2647d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:29.952808 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.952638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-secret-metrics-server-client-certs\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:29.952808 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.952694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/65b4ceb3-9b98-4a46-9888-f82141a2647d-metrics-server-audit-profiles\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:29.952808 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.952734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-client-ca-bundle\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:29.952808 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.952762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9g2v\" (UniqueName: \"kubernetes.io/projected/65b4ceb3-9b98-4a46-9888-f82141a2647d-kube-api-access-v9g2v\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:29.953037 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.952818 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/65b4ceb3-9b98-4a46-9888-f82141a2647d-audit-log\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:29.953037 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:29.952900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-secret-metrics-server-tls\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.053706 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.053660 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-secret-metrics-server-tls\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.054289 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.053867 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65b4ceb3-9b98-4a46-9888-f82141a2647d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.054289 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.053899 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-secret-metrics-server-client-certs\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.054289 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.053931 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/65b4ceb3-9b98-4a46-9888-f82141a2647d-metrics-server-audit-profiles\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.054289 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.053983 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-client-ca-bundle\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.054289 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.054013 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9g2v\" (UniqueName: \"kubernetes.io/projected/65b4ceb3-9b98-4a46-9888-f82141a2647d-kube-api-access-v9g2v\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.054289 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.054046 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/65b4ceb3-9b98-4a46-9888-f82141a2647d-audit-log\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.054684 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.054594 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65b4ceb3-9b98-4a46-9888-f82141a2647d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.055024 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.054980 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/65b4ceb3-9b98-4a46-9888-f82141a2647d-audit-log\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.055401 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.055054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/65b4ceb3-9b98-4a46-9888-f82141a2647d-metrics-server-audit-profiles\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.057904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.057878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-secret-metrics-server-tls\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.057986 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.057901 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-secret-metrics-server-client-certs\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.058804 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.058779 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b4ceb3-9b98-4a46-9888-f82141a2647d-client-ca-bundle\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.064353 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.064316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9g2v\" (UniqueName: \"kubernetes.io/projected/65b4ceb3-9b98-4a46-9888-f82141a2647d-kube-api-access-v9g2v\") pod \"metrics-server-699b487f85-tcn66\" (UID: \"65b4ceb3-9b98-4a46-9888-f82141a2647d\") " pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.188878 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.188772 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:30.389269 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:30.389202 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75b69bbb74-wd7zp" May 29 10:09:31.930602 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.930561 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:09:31.935788 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.935762 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.937941 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.937917 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 10:09:31.938081 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.938030 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 10:09:31.938980 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.938950 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 10:09:31.939227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.939202 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 10:09:31.942992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.940057 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 10:09:31.942992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.940168 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 10:09:31.942992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.940960 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8bg8tous8rn7j\"" May 29 10:09:31.942992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.941086 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 10:09:31.942992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.941165 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 10:09:31.942992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.941390 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 10:09:31.942992 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.941787 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 10:09:31.945168 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.944603 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 10:09:31.945168 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.944639 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-htwgz\"" May 29 10:09:31.946731 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.946709 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 10:09:31.952275 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.952251 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:09:31.973591 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.973735 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.973735 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.973735 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973677 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.973735 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.973937 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973781 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.973937 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.973937 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.973937 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974077 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973939 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974077 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.973983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974077 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.974008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-web-config\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974077 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.974040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26ws7\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-kube-api-access-26ws7\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974077 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.974070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974275 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.974114 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974275 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.974155 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config-out\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974275 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.974190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:31.974275 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:31.974221 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075044 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075000 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075044 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075049 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075076 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075110 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075135 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075168 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075196 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075234 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075274 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075259 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-web-config\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075288 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26ws7\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-kube-api-access-26ws7\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075315 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075360 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075412 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config-out\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075448 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075478 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075562 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075526 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075920 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075565 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.075920 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.075602 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.077207 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.076856 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.078446 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.078348 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.078446 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.078398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.079315 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.078733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.079315 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.078777 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.079315 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.079194 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.079504 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.079405 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.079816 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.079693 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.080219 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.080125 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.080545 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.080516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.080720 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.080685 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-web-config\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.082009 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.081985 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.082469 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.082444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.082610 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.082585 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.082683 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.082665 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.082845 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.082812 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.082923 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.082901 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config-out\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.088018 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.087993 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26ws7\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-kube-api-access-26ws7\") pod \"prometheus-k8s-0\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.250356 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.250265 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:09:32.344157 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:32.344076 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" podUID="3f9391f8-e070-40eb-9587-cf5c0c1e8782" containerName="registry" containerID="cri-o://c0816df8c6b4de161de69829521329aaeb16235cc21686c0c6bd198cec8a6280" gracePeriod=30 May 29 10:09:36.497934 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:36.497891 2575 generic.go:358] "Generic (PLEG): container finished" podID="3f9391f8-e070-40eb-9587-cf5c0c1e8782" containerID="c0816df8c6b4de161de69829521329aaeb16235cc21686c0c6bd198cec8a6280" exitCode=0 May 29 10:09:36.498427 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:36.497974 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" event={"ID":"3f9391f8-e070-40eb-9587-cf5c0c1e8782","Type":"ContainerDied","Data":"c0816df8c6b4de161de69829521329aaeb16235cc21686c0c6bd198cec8a6280"} May 29 10:09:37.977887 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:37.977862 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:09:38.035246 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.035216 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f9391f8-e070-40eb-9587-cf5c0c1e8782-ca-trust-extracted\") pod \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " May 29 10:09:38.035904 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.035877 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-certificates\") pod \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " May 29 10:09:38.036028 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.035963 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-installation-pull-secrets\") pod \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " May 29 10:09:38.036028 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.035995 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-image-registry-private-configuration\") pod \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " May 29 10:09:38.036119 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.036031 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88t2r\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-kube-api-access-88t2r\") pod \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " May 29 10:09:38.036119 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.036063 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-bound-sa-token\") pod \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " May 29 10:09:38.036119 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.036098 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-trusted-ca\") pod \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " May 29 10:09:38.036220 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.036129 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") pod \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\" (UID: \"3f9391f8-e070-40eb-9587-cf5c0c1e8782\") " May 29 10:09:38.036965 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.036319 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3f9391f8-e070-40eb-9587-cf5c0c1e8782" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:09:38.036965 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.036453 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-certificates\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:09:38.037122 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.036961 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3f9391f8-e070-40eb-9587-cf5c0c1e8782" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:09:38.042495 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.042436 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3f9391f8-e070-40eb-9587-cf5c0c1e8782" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:09:38.042761 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.042682 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3f9391f8-e070-40eb-9587-cf5c0c1e8782" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:09:38.043115 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.043068 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3f9391f8-e070-40eb-9587-cf5c0c1e8782" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:09:38.043328 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.043293 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-kube-api-access-88t2r" (OuterVolumeSpecName: "kube-api-access-88t2r") pod "3f9391f8-e070-40eb-9587-cf5c0c1e8782" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782"). InnerVolumeSpecName "kube-api-access-88t2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:09:38.043926 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.043890 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3f9391f8-e070-40eb-9587-cf5c0c1e8782" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:09:38.053038 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.053006 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9391f8-e070-40eb-9587-cf5c0c1e8782-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3f9391f8-e070-40eb-9587-cf5c0c1e8782" (UID: "3f9391f8-e070-40eb-9587-cf5c0c1e8782"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:09:38.138227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.138098 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f9391f8-e070-40eb-9587-cf5c0c1e8782-ca-trust-extracted\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:09:38.138227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.138133 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-installation-pull-secrets\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:09:38.138227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.138149 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f9391f8-e070-40eb-9587-cf5c0c1e8782-image-registry-private-configuration\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:09:38.138227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.138163 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88t2r\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-kube-api-access-88t2r\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:09:38.138227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.138176 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-bound-sa-token\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:09:38.138227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.138191 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f9391f8-e070-40eb-9587-cf5c0c1e8782-trusted-ca\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:09:38.138227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.138203 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f9391f8-e070-40eb-9587-cf5c0c1e8782-registry-tls\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:09:38.161800 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.161626 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-699b487f85-tcn66"] May 29 10:09:38.199211 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.199181 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:09:38.509910 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.509869 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" event={"ID":"3f9391f8-e070-40eb-9587-cf5c0c1e8782","Type":"ContainerDied","Data":"94bf94a77f76ee02e0fc4701dc4e614cea4cf4935f3677643a1b1489f7cfc466"} May 29 10:09:38.510098 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.509926 2575 scope.go:117] "RemoveContainer" containerID="c0816df8c6b4de161de69829521329aaeb16235cc21686c0c6bd198cec8a6280" May 29 10:09:38.510098 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.509953 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" May 29 10:09:38.543642 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.543591 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-558f9567bc-x4nfr"] May 29 10:09:38.553257 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:38.553224 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-558f9567bc-x4nfr"] May 29 10:09:38.620136 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:38.620105 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda117b6bd_c1ca_4388_91d3_0ce820fb3df3.slice/crio-4df3207ce5f99115e20ed2385965b5abfe4a07196a8c7c0ae30d5df19727d8c5 WatchSource:0}: Error finding container 4df3207ce5f99115e20ed2385965b5abfe4a07196a8c7c0ae30d5df19727d8c5: Status 404 returned error can't find the container with id 4df3207ce5f99115e20ed2385965b5abfe4a07196a8c7c0ae30d5df19727d8c5 May 29 10:09:38.620846 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:09:38.620798 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b4ceb3_9b98_4a46_9888_f82141a2647d.slice/crio-54f14ee416ad2f155ed40153c23026401a97ab66083ff45d674dda1822b89b7e WatchSource:0}: Error finding container 54f14ee416ad2f155ed40153c23026401a97ab66083ff45d674dda1822b89b7e: Status 404 returned error can't find the container with id 54f14ee416ad2f155ed40153c23026401a97ab66083ff45d674dda1822b89b7e May 29 10:09:39.013997 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.013957 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f9391f8-e070-40eb-9587-cf5c0c1e8782" path="/var/lib/kubelet/pods/3f9391f8-e070-40eb-9587-cf5c0c1e8782/volumes" May 29 10:09:39.519996 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.519928 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcc8f4b8-vpb8g" event={"ID":"d15e4c2e-9367-4361-8b12-25016361c68a","Type":"ContainerStarted","Data":"9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f"} May 29 10:09:39.521805 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.521680 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" event={"ID":"65b4ceb3-9b98-4a46-9888-f82141a2647d","Type":"ContainerStarted","Data":"54f14ee416ad2f155ed40153c23026401a97ab66083ff45d674dda1822b89b7e"} May 29 10:09:39.526872 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.526185 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-qzmrm" event={"ID":"adb98195-4ca3-420e-b000-4241dd6934bb","Type":"ContainerStarted","Data":"4319dde4c7c28c3794545b2f46586489beba0525a64d7a461aa1fae3ea69a365"} May 29 10:09:39.529840 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.529654 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-qzmrm" May 29 10:09:39.539599 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.539561 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" event={"ID":"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50","Type":"ContainerStarted","Data":"36f274d1f34cefc330bb17fbb36039a8e6946a2dc3572b6a10cf23d9698ee532"} May 29 10:09:39.539809 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.539793 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" event={"ID":"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50","Type":"ContainerStarted","Data":"212faeceff03c49b65a7eed6327643b2e1ccca3ad6c23b92f9afc0597ca7224e"} May 29 10:09:39.539949 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.539935 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" event={"ID":"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50","Type":"ContainerStarted","Data":"fc8b5120c120421d6e4f69cf1ee26a366cb96a6843909eb832d5fd29ea841048"} May 29 10:09:39.543391 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.543211 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-qzmrm" May 29 10:09:39.544853 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.544778 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7dcc8f4b8-vpb8g" podStartSLOduration=2.312558702 podStartE2EDuration="12.544745685s" podCreationTimestamp="2026-05-29 10:09:27 +0000 UTC" firstStartedPulling="2026-05-29 10:09:28.393672651 +0000 UTC m=+90.026713783" lastFinishedPulling="2026-05-29 10:09:38.625859634 +0000 UTC m=+100.258900766" observedRunningTime="2026-05-29 10:09:39.536336661 +0000 UTC m=+101.169377817" watchObservedRunningTime="2026-05-29 10:09:39.544745685 +0000 UTC m=+101.177786838" May 29 10:09:39.546638 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.546607 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerStarted","Data":"4df3207ce5f99115e20ed2385965b5abfe4a07196a8c7c0ae30d5df19727d8c5"} May 29 10:09:39.558381 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:39.558261 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-qzmrm" podStartSLOduration=1.729537105 podStartE2EDuration="22.558240651s" podCreationTimestamp="2026-05-29 10:09:17 +0000 UTC" firstStartedPulling="2026-05-29 10:09:17.797147516 +0000 UTC m=+79.430188648" lastFinishedPulling="2026-05-29 10:09:38.625851046 +0000 UTC m=+100.258892194" observedRunningTime="2026-05-29 10:09:39.556298336 +0000 UTC m=+101.189339495" watchObservedRunningTime="2026-05-29 10:09:39.558240651 +0000 UTC m=+101.191281804" May 29 10:09:40.386846 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:40.386781 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f6vs6" May 29 10:09:42.323513 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.323469 2575 patch_prober.go:28] interesting pod/image-registry-558f9567bc-x4nfr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.133.0.5:5000/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= May 29 10:09:42.323977 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.323540 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-558f9567bc-x4nfr" podUID="3f9391f8-e070-40eb-9587-cf5c0c1e8782" containerName="registry" probeResult="failure" output="Get \"https://10.133.0.5:5000/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" May 29 10:09:42.568997 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.568959 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" event={"ID":"65b4ceb3-9b98-4a46-9888-f82141a2647d","Type":"ContainerStarted","Data":"d8b5f74dd57bc7f4a0c609b4d912c987586fdf8f4b81345a8c9ef8f093feb23c"} May 29 10:09:42.572230 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.572200 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" event={"ID":"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50","Type":"ContainerStarted","Data":"14d04f69754888ace6b0b9de6e2c438e8ec93431bf18820003c90a23fa746b16"} May 29 10:09:42.572367 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.572237 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" event={"ID":"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50","Type":"ContainerStarted","Data":"88248fb934a9ad7d463b30a9c2ba69a660b9561882e8ec2e4572f88df52c733c"} May 29 10:09:42.572367 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.572252 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" event={"ID":"0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50","Type":"ContainerStarted","Data":"0853f0d5ec7fe3ad1e8c14b5faa0c8b2e64fbeac79fe360488e125137e968ae4"} May 29 10:09:42.572466 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.572403 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:42.573854 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.573767 2575 generic.go:358] "Generic (PLEG): container finished" podID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" exitCode=0 May 29 10:09:42.573854 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.573811 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerDied","Data":"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50"} May 29 10:09:42.601766 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:42.601694 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" podStartSLOduration=10.686512068999999 podStartE2EDuration="13.601674918s" podCreationTimestamp="2026-05-29 10:09:29 +0000 UTC" firstStartedPulling="2026-05-29 10:09:38.624960754 +0000 UTC m=+100.258001890" lastFinishedPulling="2026-05-29 10:09:41.540123603 +0000 UTC m=+103.173164739" observedRunningTime="2026-05-29 10:09:42.598766453 +0000 UTC m=+104.231807609" watchObservedRunningTime="2026-05-29 10:09:42.601674918 +0000 UTC m=+104.234716073" May 29 10:09:43.585868 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:43.585817 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" May 29 10:09:43.621239 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:43.621184 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69767476ff-w86nb" podStartSLOduration=3.144030321 podStartE2EDuration="15.621166833s" podCreationTimestamp="2026-05-29 10:09:28 +0000 UTC" firstStartedPulling="2026-05-29 10:09:29.060069049 +0000 UTC m=+90.693110186" lastFinishedPulling="2026-05-29 10:09:41.53720555 +0000 UTC m=+103.170246698" observedRunningTime="2026-05-29 10:09:42.689096059 +0000 UTC m=+104.322137214" watchObservedRunningTime="2026-05-29 10:09:43.621166833 +0000 UTC m=+105.254207987" May 29 10:09:47.595229 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:47.595193 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerStarted","Data":"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284"} May 29 10:09:47.595229 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:47.595232 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerStarted","Data":"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87"} May 29 10:09:47.595797 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:47.595242 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerStarted","Data":"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2"} May 29 10:09:47.595797 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:47.595251 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerStarted","Data":"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe"} May 29 10:09:47.595797 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:47.595261 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerStarted","Data":"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65"} May 29 10:09:47.595797 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:47.595271 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerStarted","Data":"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02"} May 29 10:09:47.654154 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:47.654089 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.705580223 podStartE2EDuration="16.654072026s" podCreationTimestamp="2026-05-29 10:09:31 +0000 UTC" firstStartedPulling="2026-05-29 10:09:38.624938188 +0000 UTC m=+100.257979324" lastFinishedPulling="2026-05-29 10:09:46.573429992 +0000 UTC m=+108.206471127" observedRunningTime="2026-05-29 10:09:47.652161591 +0000 UTC m=+109.285202758" watchObservedRunningTime="2026-05-29 10:09:47.654072026 +0000 UTC m=+109.287113181" May 29 10:09:48.247994 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:48.247957 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:48.248238 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:48.248007 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:48.252890 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:48.252866 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:48.606440 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:48.606412 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:09:49.911564 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:49.911530 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcc8f4b8-vpb8g"] May 29 10:09:50.190412 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:50.190324 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:50.190412 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:50.190374 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:09:52.250974 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:09:52.250926 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:10.195154 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:10.195121 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:10:10.199126 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:10.199103 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-699b487f85-tcn66" May 29 10:10:15.623611 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.623539 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7dcc8f4b8-vpb8g" podUID="d15e4c2e-9367-4361-8b12-25016361c68a" containerName="console" containerID="cri-o://9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f" gracePeriod=15 May 29 10:10:15.930429 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.930402 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dcc8f4b8-vpb8g_d15e4c2e-9367-4361-8b12-25016361c68a/console/0.log" May 29 10:10:15.930570 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.930469 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:10:15.984225 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984187 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-console-config\") pod \"d15e4c2e-9367-4361-8b12-25016361c68a\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " May 29 10:10:15.984413 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984239 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-service-ca\") pod \"d15e4c2e-9367-4361-8b12-25016361c68a\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " May 29 10:10:15.984413 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984259 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-oauth-config\") pod \"d15e4c2e-9367-4361-8b12-25016361c68a\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " May 29 10:10:15.984413 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984387 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt8km\" (UniqueName: \"kubernetes.io/projected/d15e4c2e-9367-4361-8b12-25016361c68a-kube-api-access-vt8km\") pod \"d15e4c2e-9367-4361-8b12-25016361c68a\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " May 29 10:10:15.984571 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984461 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-oauth-serving-cert\") pod \"d15e4c2e-9367-4361-8b12-25016361c68a\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " May 29 10:10:15.984571 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984537 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-serving-cert\") pod \"d15e4c2e-9367-4361-8b12-25016361c68a\" (UID: \"d15e4c2e-9367-4361-8b12-25016361c68a\") " May 29 10:10:15.984779 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984736 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-console-config" (OuterVolumeSpecName: "console-config") pod "d15e4c2e-9367-4361-8b12-25016361c68a" (UID: "d15e4c2e-9367-4361-8b12-25016361c68a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:10:15.984948 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984787 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-service-ca" (OuterVolumeSpecName: "service-ca") pod "d15e4c2e-9367-4361-8b12-25016361c68a" (UID: "d15e4c2e-9367-4361-8b12-25016361c68a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:10:15.984948 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.984885 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d15e4c2e-9367-4361-8b12-25016361c68a" (UID: "d15e4c2e-9367-4361-8b12-25016361c68a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:10:15.986632 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.986600 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d15e4c2e-9367-4361-8b12-25016361c68a" (UID: "d15e4c2e-9367-4361-8b12-25016361c68a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:15.986632 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.986615 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d15e4c2e-9367-4361-8b12-25016361c68a-kube-api-access-vt8km" (OuterVolumeSpecName: "kube-api-access-vt8km") pod "d15e4c2e-9367-4361-8b12-25016361c68a" (UID: "d15e4c2e-9367-4361-8b12-25016361c68a"). InnerVolumeSpecName "kube-api-access-vt8km". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:10:15.986756 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:15.986678 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d15e4c2e-9367-4361-8b12-25016361c68a" (UID: "d15e4c2e-9367-4361-8b12-25016361c68a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:16.085906 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.085873 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-oauth-serving-cert\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:16.085906 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.085903 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-serving-cert\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:16.085906 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.085914 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-console-config\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:16.086140 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.085923 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d15e4c2e-9367-4361-8b12-25016361c68a-service-ca\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:16.086140 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.085931 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d15e4c2e-9367-4361-8b12-25016361c68a-console-oauth-config\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:16.086140 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.085941 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt8km\" (UniqueName: \"kubernetes.io/projected/d15e4c2e-9367-4361-8b12-25016361c68a-kube-api-access-vt8km\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:16.684766 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.684742 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dcc8f4b8-vpb8g_d15e4c2e-9367-4361-8b12-25016361c68a/console/0.log" May 29 10:10:16.685208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.684779 2575 generic.go:358] "Generic (PLEG): container finished" podID="d15e4c2e-9367-4361-8b12-25016361c68a" containerID="9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f" exitCode=2 May 29 10:10:16.685208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.684812 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcc8f4b8-vpb8g" event={"ID":"d15e4c2e-9367-4361-8b12-25016361c68a","Type":"ContainerDied","Data":"9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f"} May 29 10:10:16.685208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.684861 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcc8f4b8-vpb8g" event={"ID":"d15e4c2e-9367-4361-8b12-25016361c68a","Type":"ContainerDied","Data":"d6432b4d791d732d3f14e5d3cde2e9468d2f57181c37406d5991deab8d1a8065"} May 29 10:10:16.685208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.684878 2575 scope.go:117] "RemoveContainer" containerID="9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f" May 29 10:10:16.685208 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.684874 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcc8f4b8-vpb8g" May 29 10:10:16.693768 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.693743 2575 scope.go:117] "RemoveContainer" containerID="9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f" May 29 10:10:16.694089 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:10:16.694065 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f\": container with ID starting with 9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f not found: ID does not exist" containerID="9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f" May 29 10:10:16.694144 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.694098 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f"} err="failed to get container status \"9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f\": rpc error: code = NotFound desc = could not find container \"9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f\": container with ID starting with 9bed2bf697da9c956789a628ed2b2e7f9066804f0ac107f2069ada0721c7841f not found: ID does not exist" May 29 10:10:16.706267 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.706235 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcc8f4b8-vpb8g"] May 29 10:10:16.713668 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:16.713635 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dcc8f4b8-vpb8g"] May 29 10:10:17.011134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:17.011060 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d15e4c2e-9367-4361-8b12-25016361c68a" path="/var/lib/kubelet/pods/d15e4c2e-9367-4361-8b12-25016361c68a/volumes" May 29 10:10:32.251383 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:32.251340 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:32.271627 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:32.271598 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:32.747092 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:32.747060 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.305043 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.304948 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:10:50.305495 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.305440 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="prometheus" containerID="cri-o://e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" gracePeriod=600 May 29 10:10:50.305605 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.305504 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="config-reloader" containerID="cri-o://726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" gracePeriod=600 May 29 10:10:50.305605 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.305523 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" gracePeriod=600 May 29 10:10:50.305605 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.305440 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy" containerID="cri-o://ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" gracePeriod=600 May 29 10:10:50.305801 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.305504 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="thanos-sidecar" containerID="cri-o://f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" gracePeriod=600 May 29 10:10:50.305801 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.305681 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy-web" containerID="cri-o://5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" gracePeriod=600 May 29 10:10:50.547903 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.547877 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.607605 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607516 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config-out\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.607770 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607609 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-metrics-client-certs\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.607770 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607639 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-tls\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.607770 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607669 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-trusted-ca-bundle\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.607770 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607705 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-tls-assets\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.607770 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607738 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-metrics-client-ca\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607777 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-rulefiles-0\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607803 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-web-config\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607853 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-db\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607886 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-serving-certs-ca-bundle\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607924 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-kube-rbac-proxy\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.607965 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-kubelet-serving-ca-bundle\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.608000 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-grpc-tls\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.608035 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.608058 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608497 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.608087 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26ws7\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-kube-api-access-26ws7\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.608497 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.608112 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.609594 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.608985 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:10:50.609718 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.609664 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:10:50.610877 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.610590 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:10:50.610877 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.610771 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.610877 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.610808 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:10:50.610877 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.610867 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.611445 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.611163 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:10:50.611445 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.611336 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.611597 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.611573 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config-out" (OuterVolumeSpecName: "config-out") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:10:50.611896 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.611871 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:10:50.612112 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.612092 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.612473 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.612452 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:10:50.613126 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.613102 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config" (OuterVolumeSpecName: "config") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.613205 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.613126 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.613436 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.613417 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.613616 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.613591 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-kube-api-access-26ws7" (OuterVolumeSpecName: "kube-api-access-26ws7") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "kube-api-access-26ws7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:10:50.623218 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.623190 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-web-config" (OuterVolumeSpecName: "web-config") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.709327 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709284 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-thanos-prometheus-http-client-file\") pod \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\" (UID: \"a117b6bd-c1ca-4388-91d3-0ce820fb3df3\") " May 29 10:10:50.709527 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709481 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-metrics-client-certs\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709527 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709500 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709527 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709513 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709527 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709526 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-tls-assets\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709540 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-metrics-client-ca\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709555 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709570 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-web-config\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709583 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-prometheus-k8s-db\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709599 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709616 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-kube-rbac-proxy\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709634 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709649 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-grpc-tls\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709665 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709678 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709691 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26ws7\" (UniqueName: \"kubernetes.io/projected/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-kube-api-access-26ws7\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709706 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.709736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.709722 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-config-out\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.711310 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.711282 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a117b6bd-c1ca-4388-91d3-0ce820fb3df3" (UID: "a117b6bd-c1ca-4388-91d3-0ce820fb3df3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:10:50.789213 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789180 2575 generic.go:358] "Generic (PLEG): container finished" podID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" exitCode=0 May 29 10:10:50.789213 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789207 2575 generic.go:358] "Generic (PLEG): container finished" podID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" exitCode=0 May 29 10:10:50.789213 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789214 2575 generic.go:358] "Generic (PLEG): container finished" podID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" exitCode=0 May 29 10:10:50.789213 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789220 2575 generic.go:358] "Generic (PLEG): container finished" podID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" exitCode=0 May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789226 2575 generic.go:358] "Generic (PLEG): container finished" podID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" exitCode=0 May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789230 2575 generic.go:358] "Generic (PLEG): container finished" podID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" exitCode=0 May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789230 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerDied","Data":"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284"} May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789284 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerDied","Data":"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87"} May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789297 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789311 2575 scope.go:117] "RemoveContainer" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789300 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerDied","Data":"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2"} May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789419 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerDied","Data":"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe"} May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789439 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerDied","Data":"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65"} May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789453 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerDied","Data":"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02"} May 29 10:10:50.789514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.789466 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a117b6bd-c1ca-4388-91d3-0ce820fb3df3","Type":"ContainerDied","Data":"4df3207ce5f99115e20ed2385965b5abfe4a07196a8c7c0ae30d5df19727d8c5"} May 29 10:10:50.798457 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.798431 2575 scope.go:117] "RemoveContainer" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" May 29 10:10:50.805416 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.805396 2575 scope.go:117] "RemoveContainer" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" May 29 10:10:50.810771 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.810743 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a117b6bd-c1ca-4388-91d3-0ce820fb3df3-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:10:50.813521 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.813143 2575 scope.go:117] "RemoveContainer" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" May 29 10:10:50.814643 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.814615 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:10:50.819514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.819490 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:10:50.821027 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.821008 2575 scope.go:117] "RemoveContainer" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" May 29 10:10:50.827791 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.827773 2575 scope.go:117] "RemoveContainer" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" May 29 10:10:50.835241 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.835221 2575 scope.go:117] "RemoveContainer" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" May 29 10:10:50.843572 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.843551 2575 scope.go:117] "RemoveContainer" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" May 29 10:10:50.843852 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:10:50.843816 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": container with ID starting with 4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284 not found: ID does not exist" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" May 29 10:10:50.843940 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.843862 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284"} err="failed to get container status \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": rpc error: code = NotFound desc = could not find container \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": container with ID starting with 4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284 not found: ID does not exist" May 29 10:10:50.843940 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.843884 2575 scope.go:117] "RemoveContainer" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" May 29 10:10:50.844184 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:10:50.844166 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": container with ID starting with ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87 not found: ID does not exist" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" May 29 10:10:50.844242 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.844222 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87"} err="failed to get container status \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": rpc error: code = NotFound desc = could not find container \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": container with ID starting with ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87 not found: ID does not exist" May 29 10:10:50.844296 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.844243 2575 scope.go:117] "RemoveContainer" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" May 29 10:10:50.844543 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:10:50.844521 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": container with ID starting with 5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2 not found: ID does not exist" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" May 29 10:10:50.844722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.844551 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2"} err="failed to get container status \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": rpc error: code = NotFound desc = could not find container \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": container with ID starting with 5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2 not found: ID does not exist" May 29 10:10:50.844722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.844573 2575 scope.go:117] "RemoveContainer" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" May 29 10:10:50.845071 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:10:50.844957 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": container with ID starting with f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe not found: ID does not exist" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" May 29 10:10:50.845071 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.844993 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe"} err="failed to get container status \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": rpc error: code = NotFound desc = could not find container \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": container with ID starting with f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe not found: ID does not exist" May 29 10:10:50.845071 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.845020 2575 scope.go:117] "RemoveContainer" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" May 29 10:10:50.845571 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:10:50.845550 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": container with ID starting with 726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65 not found: ID does not exist" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" May 29 10:10:50.845652 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.845577 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65"} err="failed to get container status \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": rpc error: code = NotFound desc = could not find container \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": container with ID starting with 726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65 not found: ID does not exist" May 29 10:10:50.845652 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.845597 2575 scope.go:117] "RemoveContainer" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" May 29 10:10:50.845889 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:10:50.845873 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": container with ID starting with e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02 not found: ID does not exist" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" May 29 10:10:50.845953 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.845894 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02"} err="failed to get container status \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": rpc error: code = NotFound desc = could not find container \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": container with ID starting with e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02 not found: ID does not exist" May 29 10:10:50.845953 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.845911 2575 scope.go:117] "RemoveContainer" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" May 29 10:10:50.846164 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:10:50.846151 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": container with ID starting with 056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50 not found: ID does not exist" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" May 29 10:10:50.846212 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846170 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50"} err="failed to get container status \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": rpc error: code = NotFound desc = could not find container \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": container with ID starting with 056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50 not found: ID does not exist" May 29 10:10:50.846212 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846186 2575 scope.go:117] "RemoveContainer" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" May 29 10:10:50.846407 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846389 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284"} err="failed to get container status \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": rpc error: code = NotFound desc = could not find container \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": container with ID starting with 4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284 not found: ID does not exist" May 29 10:10:50.846407 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846407 2575 scope.go:117] "RemoveContainer" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" May 29 10:10:50.846650 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846616 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87"} err="failed to get container status \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": rpc error: code = NotFound desc = could not find container \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": container with ID starting with ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87 not found: ID does not exist" May 29 10:10:50.846650 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846639 2575 scope.go:117] "RemoveContainer" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" May 29 10:10:50.846793 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846772 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:10:50.846929 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846905 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2"} err="failed to get container status \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": rpc error: code = NotFound desc = could not find container \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": container with ID starting with 5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2 not found: ID does not exist" May 29 10:10:50.846981 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.846931 2575 scope.go:117] "RemoveContainer" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" May 29 10:10:50.847150 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847131 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe"} err="failed to get container status \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": rpc error: code = NotFound desc = could not find container \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": container with ID starting with f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe not found: ID does not exist" May 29 10:10:50.847204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847151 2575 scope.go:117] "RemoveContainer" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" May 29 10:10:50.847246 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847227 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="init-config-reloader" May 29 10:10:50.847293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847247 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="init-config-reloader" May 29 10:10:50.847293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847260 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="prometheus" May 29 10:10:50.847293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847268 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="prometheus" May 29 10:10:50.847293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847277 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy" May 29 10:10:50.847293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847288 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847321 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9391f8-e070-40eb-9587-cf5c0c1e8782" containerName="registry" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847331 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9391f8-e070-40eb-9587-cf5c0c1e8782" containerName="registry" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847344 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d15e4c2e-9367-4361-8b12-25016361c68a" containerName="console" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847352 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d15e4c2e-9367-4361-8b12-25016361c68a" containerName="console" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847370 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy-thanos" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847379 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy-thanos" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847389 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="config-reloader" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847398 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="config-reloader" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847407 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="thanos-sidecar" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847416 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="thanos-sidecar" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847431 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy-web" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847439 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy-web" May 29 10:10:50.847462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847348 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65"} err="failed to get container status \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": rpc error: code = NotFound desc = could not find container \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": container with ID starting with 726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65 not found: ID does not exist" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847481 2575 scope.go:117] "RemoveContainer" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847506 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy-web" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847518 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="config-reloader" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847529 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f9391f8-e070-40eb-9587-cf5c0c1e8782" containerName="registry" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847541 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="d15e4c2e-9367-4361-8b12-25016361c68a" containerName="console" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847549 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847560 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="thanos-sidecar" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847570 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="prometheus" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847579 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" containerName="kube-rbac-proxy-thanos" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847731 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02"} err="failed to get container status \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": rpc error: code = NotFound desc = could not find container \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": container with ID starting with e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02 not found: ID does not exist" May 29 10:10:50.847892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847754 2575 scope.go:117] "RemoveContainer" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" May 29 10:10:50.848293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847951 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50"} err="failed to get container status \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": rpc error: code = NotFound desc = could not find container \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": container with ID starting with 056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50 not found: ID does not exist" May 29 10:10:50.848293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.847974 2575 scope.go:117] "RemoveContainer" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" May 29 10:10:50.848293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.848207 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284"} err="failed to get container status \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": rpc error: code = NotFound desc = could not find container \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": container with ID starting with 4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284 not found: ID does not exist" May 29 10:10:50.848293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.848235 2575 scope.go:117] "RemoveContainer" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" May 29 10:10:50.848456 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.848437 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87"} err="failed to get container status \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": rpc error: code = NotFound desc = could not find container \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": container with ID starting with ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87 not found: ID does not exist" May 29 10:10:50.848492 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.848456 2575 scope.go:117] "RemoveContainer" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" May 29 10:10:50.848686 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.848668 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2"} err="failed to get container status \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": rpc error: code = NotFound desc = could not find container \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": container with ID starting with 5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2 not found: ID does not exist" May 29 10:10:50.848728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.848688 2575 scope.go:117] "RemoveContainer" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" May 29 10:10:50.848958 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.848940 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe"} err="failed to get container status \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": rpc error: code = NotFound desc = could not find container \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": container with ID starting with f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe not found: ID does not exist" May 29 10:10:50.849027 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.848958 2575 scope.go:117] "RemoveContainer" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" May 29 10:10:50.849178 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.849159 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65"} err="failed to get container status \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": rpc error: code = NotFound desc = could not find container \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": container with ID starting with 726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65 not found: ID does not exist" May 29 10:10:50.849220 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.849180 2575 scope.go:117] "RemoveContainer" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" May 29 10:10:50.849377 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.849355 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02"} err="failed to get container status \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": rpc error: code = NotFound desc = could not find container \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": container with ID starting with e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02 not found: ID does not exist" May 29 10:10:50.849418 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.849379 2575 scope.go:117] "RemoveContainer" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" May 29 10:10:50.849563 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.849544 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50"} err="failed to get container status \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": rpc error: code = NotFound desc = could not find container \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": container with ID starting with 056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50 not found: ID does not exist" May 29 10:10:50.849563 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.849561 2575 scope.go:117] "RemoveContainer" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" May 29 10:10:50.849782 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.849763 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284"} err="failed to get container status \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": rpc error: code = NotFound desc = could not find container \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": container with ID starting with 4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284 not found: ID does not exist" May 29 10:10:50.849860 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.849784 2575 scope.go:117] "RemoveContainer" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" May 29 10:10:50.850048 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850030 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87"} err="failed to get container status \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": rpc error: code = NotFound desc = could not find container \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": container with ID starting with ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87 not found: ID does not exist" May 29 10:10:50.850100 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850050 2575 scope.go:117] "RemoveContainer" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" May 29 10:10:50.850273 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850256 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2"} err="failed to get container status \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": rpc error: code = NotFound desc = could not find container \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": container with ID starting with 5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2 not found: ID does not exist" May 29 10:10:50.850345 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850276 2575 scope.go:117] "RemoveContainer" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" May 29 10:10:50.850516 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850498 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe"} err="failed to get container status \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": rpc error: code = NotFound desc = could not find container \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": container with ID starting with f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe not found: ID does not exist" May 29 10:10:50.850560 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850516 2575 scope.go:117] "RemoveContainer" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" May 29 10:10:50.850744 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850726 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65"} err="failed to get container status \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": rpc error: code = NotFound desc = could not find container \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": container with ID starting with 726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65 not found: ID does not exist" May 29 10:10:50.850798 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850745 2575 scope.go:117] "RemoveContainer" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" May 29 10:10:50.850974 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850954 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02"} err="failed to get container status \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": rpc error: code = NotFound desc = could not find container \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": container with ID starting with e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02 not found: ID does not exist" May 29 10:10:50.850974 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.850971 2575 scope.go:117] "RemoveContainer" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" May 29 10:10:50.851161 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851142 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50"} err="failed to get container status \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": rpc error: code = NotFound desc = could not find container \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": container with ID starting with 056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50 not found: ID does not exist" May 29 10:10:50.851206 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851162 2575 scope.go:117] "RemoveContainer" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" May 29 10:10:50.851372 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851354 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284"} err="failed to get container status \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": rpc error: code = NotFound desc = could not find container \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": container with ID starting with 4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284 not found: ID does not exist" May 29 10:10:50.851430 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851373 2575 scope.go:117] "RemoveContainer" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" May 29 10:10:50.851430 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851381 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.851633 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851608 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87"} err="failed to get container status \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": rpc error: code = NotFound desc = could not find container \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": container with ID starting with ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87 not found: ID does not exist" May 29 10:10:50.851730 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851635 2575 scope.go:117] "RemoveContainer" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" May 29 10:10:50.851874 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851848 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2"} err="failed to get container status \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": rpc error: code = NotFound desc = could not find container \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": container with ID starting with 5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2 not found: ID does not exist" May 29 10:10:50.851959 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.851876 2575 scope.go:117] "RemoveContainer" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" May 29 10:10:50.852145 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.852123 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe"} err="failed to get container status \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": rpc error: code = NotFound desc = could not find container \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": container with ID starting with f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe not found: ID does not exist" May 29 10:10:50.852211 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.852147 2575 scope.go:117] "RemoveContainer" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" May 29 10:10:50.852389 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.852368 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65"} err="failed to get container status \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": rpc error: code = NotFound desc = could not find container \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": container with ID starting with 726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65 not found: ID does not exist" May 29 10:10:50.852443 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.852390 2575 scope.go:117] "RemoveContainer" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" May 29 10:10:50.852607 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.852589 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02"} err="failed to get container status \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": rpc error: code = NotFound desc = could not find container \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": container with ID starting with e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02 not found: ID does not exist" May 29 10:10:50.852681 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.852609 2575 scope.go:117] "RemoveContainer" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" May 29 10:10:50.852891 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.852867 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50"} err="failed to get container status \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": rpc error: code = NotFound desc = could not find container \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": container with ID starting with 056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50 not found: ID does not exist" May 29 10:10:50.852945 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.852895 2575 scope.go:117] "RemoveContainer" containerID="4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284" May 29 10:10:50.853115 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853096 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284"} err="failed to get container status \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": rpc error: code = NotFound desc = could not find container \"4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284\": container with ID starting with 4e1aa8f9252c55e8fe801c285c272810010b4e7e931113a2c36768ee2cc3e284 not found: ID does not exist" May 29 10:10:50.853155 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853116 2575 scope.go:117] "RemoveContainer" containerID="ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87" May 29 10:10:50.853399 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853377 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87"} err="failed to get container status \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": rpc error: code = NotFound desc = could not find container \"ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87\": container with ID starting with ed9a4b552228c16a59cfbe8ef47960132cbd7205d3e49fef13c1dcdd14122b87 not found: ID does not exist" May 29 10:10:50.853468 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853401 2575 scope.go:117] "RemoveContainer" containerID="5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2" May 29 10:10:50.853646 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853623 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2"} err="failed to get container status \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": rpc error: code = NotFound desc = could not find container \"5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2\": container with ID starting with 5e266253f0a2c5dcc6242db1710f92633fc3452aded82572fb96bd57db3106d2 not found: ID does not exist" May 29 10:10:50.853646 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853645 2575 scope.go:117] "RemoveContainer" containerID="f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe" May 29 10:10:50.853822 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853681 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 10:10:50.853822 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853681 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 10:10:50.853822 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853728 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 10:10:50.853822 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853753 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 10:10:50.854202 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853949 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 10:10:50.854202 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.853953 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8bg8tous8rn7j\"" May 29 10:10:50.854202 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854032 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 10:10:50.854202 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854076 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 10:10:50.854202 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854088 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 10:10:50.854202 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854102 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 10:10:50.854480 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854301 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-htwgz\"" May 29 10:10:50.854480 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854380 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe"} err="failed to get container status \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": rpc error: code = NotFound desc = could not find container \"f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe\": container with ID starting with f19653667050a65ff967b75bf43f01eb70b838f4c7880c733c3bca6836400dbe not found: ID does not exist" May 29 10:10:50.854480 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854399 2575 scope.go:117] "RemoveContainer" containerID="726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65" May 29 10:10:50.854664 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854640 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65"} err="failed to get container status \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": rpc error: code = NotFound desc = could not find container \"726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65\": container with ID starting with 726dfd74c5566155319ca665a800193d03cff3fb9ecfba5effa3e2fc5ae05b65 not found: ID does not exist" May 29 10:10:50.854734 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854665 2575 scope.go:117] "RemoveContainer" containerID="e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02" May 29 10:10:50.854870 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.854855 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 10:10:50.855077 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.855049 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02"} err="failed to get container status \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": rpc error: code = NotFound desc = could not find container \"e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02\": container with ID starting with e026a09b9e4c7e0d128b8c89b0da38378c0f696243974149159f45d2feebce02 not found: ID does not exist" May 29 10:10:50.855216 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.855078 2575 scope.go:117] "RemoveContainer" containerID="056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50" May 29 10:10:50.855382 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.855364 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50"} err="failed to get container status \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": rpc error: code = NotFound desc = could not find container \"056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50\": container with ID starting with 056fda9b5ac445b2b709a41daf2fa3d398d15eec87e31cedeba0af19f059ba50 not found: ID does not exist" May 29 10:10:50.856731 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.856709 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 10:10:50.859815 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.859798 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 10:10:50.864951 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.864929 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:10:50.911689 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.911689 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.911922 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.911922 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.911922 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.911922 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.911922 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.911922 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-config\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912122 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912122 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.911976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912122 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.912014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912122 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.912033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912122 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.912047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912122 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.912064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9912973-1da0-42e4-aa18-bdb72f1218e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912122 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.912102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912324 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.912129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv6m6\" (UniqueName: \"kubernetes.io/projected/d9912973-1da0-42e4-aa18-bdb72f1218e6-kube-api-access-vv6m6\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912324 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.912158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9912973-1da0-42e4-aa18-bdb72f1218e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:50.912324 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:50.912195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.010997 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.010953 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a117b6bd-c1ca-4388-91d3-0ce820fb3df3" path="/var/lib/kubelet/pods/a117b6bd-c1ca-4388-91d3-0ce820fb3df3/volumes" May 29 10:10:51.013416 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013390 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013543 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013422 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013543 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013441 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013543 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013458 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013543 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013477 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9912973-1da0-42e4-aa18-bdb72f1218e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013543 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013505 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013784 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013638 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv6m6\" (UniqueName: \"kubernetes.io/projected/d9912973-1da0-42e4-aa18-bdb72f1218e6-kube-api-access-vv6m6\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013784 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013697 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9912973-1da0-42e4-aa18-bdb72f1218e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013784 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013740 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013905 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013782 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013905 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013813 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.013905 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013894 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.014040 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013920 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.014040 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013955 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.014040 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.013978 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.014173 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.014039 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.014173 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.014098 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-config\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.014173 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.014159 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.014799 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.014772 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.015491 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.015462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.016425 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.016395 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9912973-1da0-42e4-aa18-bdb72f1218e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.016593 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.016569 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.016741 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.016720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.016889 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.016867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.017104 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.017082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.017348 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.017279 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.017847 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.017808 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.018021 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.017998 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.018166 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.018067 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9912973-1da0-42e4-aa18-bdb72f1218e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.018166 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.018153 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.018590 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.018569 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.019088 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.019065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9912973-1da0-42e4-aa18-bdb72f1218e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.019203 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.019186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.019278 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.019258 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.019714 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.019695 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9912973-1da0-42e4-aa18-bdb72f1218e6-config\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.021504 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.021486 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv6m6\" (UniqueName: \"kubernetes.io/projected/d9912973-1da0-42e4-aa18-bdb72f1218e6-kube-api-access-vv6m6\") pod \"prometheus-k8s-0\" (UID: \"d9912973-1da0-42e4-aa18-bdb72f1218e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.161492 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.161378 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:10:51.300235 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.300118 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:10:51.303062 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:10:51.303029 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9912973_1da0_42e4_aa18_bdb72f1218e6.slice/crio-7be3a8d91927f20b199f8d789dd3c14c5c6d3507e0ab442ed8ad33a606dad505 WatchSource:0}: Error finding container 7be3a8d91927f20b199f8d789dd3c14c5c6d3507e0ab442ed8ad33a606dad505: Status 404 returned error can't find the container with id 7be3a8d91927f20b199f8d789dd3c14c5c6d3507e0ab442ed8ad33a606dad505 May 29 10:10:51.799336 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.799293 2575 generic.go:358] "Generic (PLEG): container finished" podID="d9912973-1da0-42e4-aa18-bdb72f1218e6" containerID="fd13a7191880b2316bb4daa95d0133a941c7fe0218d34ae7bc914c5dbb8ed30d" exitCode=0 May 29 10:10:51.799694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.799386 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9912973-1da0-42e4-aa18-bdb72f1218e6","Type":"ContainerDied","Data":"fd13a7191880b2316bb4daa95d0133a941c7fe0218d34ae7bc914c5dbb8ed30d"} May 29 10:10:51.799694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:51.799439 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9912973-1da0-42e4-aa18-bdb72f1218e6","Type":"ContainerStarted","Data":"7be3a8d91927f20b199f8d789dd3c14c5c6d3507e0ab442ed8ad33a606dad505"} May 29 10:10:52.805633 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:52.805597 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9912973-1da0-42e4-aa18-bdb72f1218e6","Type":"ContainerStarted","Data":"d21470ff7f02dba8142d0df8d03925483dcb81e677e775dc7163a5cd08e4f70f"} May 29 10:10:52.805633 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:52.805637 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9912973-1da0-42e4-aa18-bdb72f1218e6","Type":"ContainerStarted","Data":"d47a78fc0a7d62f3c71511176cb5c83b5b7e0b0e44c29a0b22304d371caa8746"} May 29 10:10:52.806168 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:52.805648 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9912973-1da0-42e4-aa18-bdb72f1218e6","Type":"ContainerStarted","Data":"a4b7231882eaa495d7bcd18458f05c45a30e2adc8da8fe113cbdae3fd8f85592"} May 29 10:10:52.806168 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:52.805657 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9912973-1da0-42e4-aa18-bdb72f1218e6","Type":"ContainerStarted","Data":"eb95a2bc0d4cbf7b44c7bebb98ff76c462029b513b88159747a0b0f10a785065"} May 29 10:10:52.806168 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:52.805666 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9912973-1da0-42e4-aa18-bdb72f1218e6","Type":"ContainerStarted","Data":"47d1204893b678b08637c72f07c7fe47e98c77d706629b71d087679079001a40"} May 29 10:10:52.806168 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:52.805674 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9912973-1da0-42e4-aa18-bdb72f1218e6","Type":"ContainerStarted","Data":"cd798aae7654a1b4046c800eebea90c81e2cf47f0b7b74030f8bf64005aea716"} May 29 10:10:52.835581 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:52.835522 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8355021799999998 podStartE2EDuration="2.83550218s" podCreationTimestamp="2026-05-29 10:10:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:10:52.832804359 +0000 UTC m=+174.465845513" watchObservedRunningTime="2026-05-29 10:10:52.83550218 +0000 UTC m=+174.468543335" May 29 10:10:56.161595 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:10:56.161531 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:11:51.161754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:11:51.161716 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:11:51.177438 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:11:51.177409 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:11:51.991347 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:11:51.991320 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:12:58.901236 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:12:58.901200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:12:58.903842 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:12:58.903811 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:12:58.904201 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:12:58.904184 2575 kubelet.go:1628] "Image garbage collection succeeded" May 29 10:15:27.611789 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.611706 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2"] May 29 10:15:27.619175 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.619144 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.621567 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.621537 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 29 10:15:27.621698 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.621613 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 29 10:15:27.621698 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.621694 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-49gk6\"" May 29 10:15:27.621800 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.621769 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 29 10:15:27.621936 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.621915 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 29 10:15:27.629091 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.629064 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2"] May 29 10:15:27.692535 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.692503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bfb4e98-4dfb-4343-9a30-15127407e730-webhook-cert\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.692689 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.692543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6bfb4e98-4dfb-4343-9a30-15127407e730-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.692689 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.692601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkml2\" (UniqueName: \"kubernetes.io/projected/6bfb4e98-4dfb-4343-9a30-15127407e730-kube-api-access-dkml2\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.793728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.793691 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6bfb4e98-4dfb-4343-9a30-15127407e730-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.793960 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.793749 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkml2\" (UniqueName: \"kubernetes.io/projected/6bfb4e98-4dfb-4343-9a30-15127407e730-kube-api-access-dkml2\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.793960 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.793802 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bfb4e98-4dfb-4343-9a30-15127407e730-webhook-cert\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.796302 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.796277 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6bfb4e98-4dfb-4343-9a30-15127407e730-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.796302 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.796297 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bfb4e98-4dfb-4343-9a30-15127407e730-webhook-cert\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.803131 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.803102 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkml2\" (UniqueName: \"kubernetes.io/projected/6bfb4e98-4dfb-4343-9a30-15127407e730-kube-api-access-dkml2\") pod \"opendatahub-operator-controller-manager-5569bfcb9-9qvp2\" (UID: \"6bfb4e98-4dfb-4343-9a30-15127407e730\") " pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:27.931392 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:27.931305 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:28.065101 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:28.065074 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2"] May 29 10:15:28.067895 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:15:28.067863 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfb4e98_4dfb_4343_9a30_15127407e730.slice/crio-390f8788beb4b6a36924bd0c2c6e998657aa3d547d6b948ef77fb86dcc5a3d12 WatchSource:0}: Error finding container 390f8788beb4b6a36924bd0c2c6e998657aa3d547d6b948ef77fb86dcc5a3d12: Status 404 returned error can't find the container with id 390f8788beb4b6a36924bd0c2c6e998657aa3d547d6b948ef77fb86dcc5a3d12 May 29 10:15:28.069554 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:28.069538 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 10:15:28.600860 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:28.600797 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" event={"ID":"6bfb4e98-4dfb-4343-9a30-15127407e730","Type":"ContainerStarted","Data":"390f8788beb4b6a36924bd0c2c6e998657aa3d547d6b948ef77fb86dcc5a3d12"} May 29 10:15:31.613681 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:31.613642 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" event={"ID":"6bfb4e98-4dfb-4343-9a30-15127407e730","Type":"ContainerStarted","Data":"88f0c217dd8a9b03bf6f54d38c1d8c620b20eb585fa1697827597863979c24f5"} May 29 10:15:31.614106 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:31.613705 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:31.634764 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:31.634711 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" podStartSLOduration=2.087668695 podStartE2EDuration="4.634693959s" podCreationTimestamp="2026-05-29 10:15:27 +0000 UTC" firstStartedPulling="2026-05-29 10:15:28.069658475 +0000 UTC m=+449.702699608" lastFinishedPulling="2026-05-29 10:15:30.616683739 +0000 UTC m=+452.249724872" observedRunningTime="2026-05-29 10:15:31.634259294 +0000 UTC m=+453.267300450" watchObservedRunningTime="2026-05-29 10:15:31.634693959 +0000 UTC m=+453.267735113" May 29 10:15:42.620178 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:42.620144 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5569bfcb9-9qvp2" May 29 10:15:46.145052 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.145015 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56b76bb456-wklws"] May 29 10:15:46.152183 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.152154 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.155266 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.155145 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 29 10:15:46.155266 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.155166 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 29 10:15:46.155266 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.155200 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 29 10:15:46.155266 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.155205 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z9rgc\"" May 29 10:15:46.155266 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.155166 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 29 10:15:46.162225 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.162200 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56b76bb456-wklws"] May 29 10:15:46.259991 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.259955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scsh2\" (UniqueName: \"kubernetes.io/projected/a931e694-1154-4ffa-ab0f-7c647f9ea785-kube-api-access-scsh2\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.260152 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.260034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a931e694-1154-4ffa-ab0f-7c647f9ea785-tls-certs\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.260152 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.260057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a931e694-1154-4ffa-ab0f-7c647f9ea785-tmp\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.361163 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.361113 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a931e694-1154-4ffa-ab0f-7c647f9ea785-tls-certs\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.361163 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.361169 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a931e694-1154-4ffa-ab0f-7c647f9ea785-tmp\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.361393 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.361203 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scsh2\" (UniqueName: \"kubernetes.io/projected/a931e694-1154-4ffa-ab0f-7c647f9ea785-kube-api-access-scsh2\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.363607 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.363582 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a931e694-1154-4ffa-ab0f-7c647f9ea785-tmp\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.363942 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.363917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a931e694-1154-4ffa-ab0f-7c647f9ea785-tls-certs\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.369561 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.369536 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scsh2\" (UniqueName: \"kubernetes.io/projected/a931e694-1154-4ffa-ab0f-7c647f9ea785-kube-api-access-scsh2\") pod \"kube-auth-proxy-56b76bb456-wklws\" (UID: \"a931e694-1154-4ffa-ab0f-7c647f9ea785\") " pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.463120 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.463033 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" May 29 10:15:46.600616 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.600549 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56b76bb456-wklws"] May 29 10:15:46.603035 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:15:46.603005 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda931e694_1154_4ffa_ab0f_7c647f9ea785.slice/crio-7fb7f796535bdb40eaeb07422db2ffe4742893dfa81fe7b13a7767caa8e3a9bb WatchSource:0}: Error finding container 7fb7f796535bdb40eaeb07422db2ffe4742893dfa81fe7b13a7767caa8e3a9bb: Status 404 returned error can't find the container with id 7fb7f796535bdb40eaeb07422db2ffe4742893dfa81fe7b13a7767caa8e3a9bb May 29 10:15:46.662560 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:46.662524 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" event={"ID":"a931e694-1154-4ffa-ab0f-7c647f9ea785","Type":"ContainerStarted","Data":"7fb7f796535bdb40eaeb07422db2ffe4742893dfa81fe7b13a7767caa8e3a9bb"} May 29 10:15:49.198720 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.198689 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tbx77"] May 29 10:15:49.202625 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.202605 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:49.204728 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.204709 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 29 10:15:49.204798 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.204768 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lfh2j\"" May 29 10:15:49.209801 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.209560 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tbx77"] May 29 10:15:49.390224 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.390171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h7kn\" (UniqueName: \"kubernetes.io/projected/82df93d8-cc2b-4f7b-9246-7cdf6b410645-kube-api-access-9h7kn\") pod \"odh-model-controller-858dbf95b8-tbx77\" (UID: \"82df93d8-cc2b-4f7b-9246-7cdf6b410645\") " pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:49.390409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.390329 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert\") pod \"odh-model-controller-858dbf95b8-tbx77\" (UID: \"82df93d8-cc2b-4f7b-9246-7cdf6b410645\") " pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:49.491865 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.491753 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert\") pod \"odh-model-controller-858dbf95b8-tbx77\" (UID: \"82df93d8-cc2b-4f7b-9246-7cdf6b410645\") " pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:49.492041 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.491889 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h7kn\" (UniqueName: \"kubernetes.io/projected/82df93d8-cc2b-4f7b-9246-7cdf6b410645-kube-api-access-9h7kn\") pod \"odh-model-controller-858dbf95b8-tbx77\" (UID: \"82df93d8-cc2b-4f7b-9246-7cdf6b410645\") " pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:49.492041 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:15:49.491933 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 29 10:15:49.492041 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:15:49.492011 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert podName:82df93d8-cc2b-4f7b-9246-7cdf6b410645 nodeName:}" failed. No retries permitted until 2026-05-29 10:15:49.991986609 +0000 UTC m=+471.625027746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert") pod "odh-model-controller-858dbf95b8-tbx77" (UID: "82df93d8-cc2b-4f7b-9246-7cdf6b410645") : secret "odh-model-controller-webhook-cert" not found May 29 10:15:49.503164 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.503136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h7kn\" (UniqueName: \"kubernetes.io/projected/82df93d8-cc2b-4f7b-9246-7cdf6b410645-kube-api-access-9h7kn\") pod \"odh-model-controller-858dbf95b8-tbx77\" (UID: \"82df93d8-cc2b-4f7b-9246-7cdf6b410645\") " pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:49.997080 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:49.997052 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert\") pod \"odh-model-controller-858dbf95b8-tbx77\" (UID: \"82df93d8-cc2b-4f7b-9246-7cdf6b410645\") " pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:49.997243 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:15:49.997204 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 29 10:15:49.997306 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:15:49.997292 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert podName:82df93d8-cc2b-4f7b-9246-7cdf6b410645 nodeName:}" failed. No retries permitted until 2026-05-29 10:15:50.997273985 +0000 UTC m=+472.630315119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert") pod "odh-model-controller-858dbf95b8-tbx77" (UID: "82df93d8-cc2b-4f7b-9246-7cdf6b410645") : secret "odh-model-controller-webhook-cert" not found May 29 10:15:50.679725 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:50.679685 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" event={"ID":"a931e694-1154-4ffa-ab0f-7c647f9ea785","Type":"ContainerStarted","Data":"3a8a2537ccad71bde75cd39ca3aa60449b160650dfefcc37ef7fc134251c305b"} May 29 10:15:50.697005 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:50.696955 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56b76bb456-wklws" podStartSLOduration=1.354418845 podStartE2EDuration="4.696939909s" podCreationTimestamp="2026-05-29 10:15:46 +0000 UTC" firstStartedPulling="2026-05-29 10:15:46.604716836 +0000 UTC m=+468.237757969" lastFinishedPulling="2026-05-29 10:15:49.947237894 +0000 UTC m=+471.580279033" observedRunningTime="2026-05-29 10:15:50.695591194 +0000 UTC m=+472.328632350" watchObservedRunningTime="2026-05-29 10:15:50.696939909 +0000 UTC m=+472.329981064" May 29 10:15:51.005334 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:51.005238 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert\") pod \"odh-model-controller-858dbf95b8-tbx77\" (UID: \"82df93d8-cc2b-4f7b-9246-7cdf6b410645\") " pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:51.007793 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:51.007760 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82df93d8-cc2b-4f7b-9246-7cdf6b410645-cert\") pod \"odh-model-controller-858dbf95b8-tbx77\" (UID: \"82df93d8-cc2b-4f7b-9246-7cdf6b410645\") " pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:51.015542 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:51.015518 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:51.143280 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:51.143191 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tbx77"] May 29 10:15:51.145915 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:15:51.145885 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82df93d8_cc2b_4f7b_9246_7cdf6b410645.slice/crio-b3889c10f7e386ac3401863fe7996c59134fda27fc465a647c89055b371b84bc WatchSource:0}: Error finding container b3889c10f7e386ac3401863fe7996c59134fda27fc465a647c89055b371b84bc: Status 404 returned error can't find the container with id b3889c10f7e386ac3401863fe7996c59134fda27fc465a647c89055b371b84bc May 29 10:15:51.683733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:51.683693 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" event={"ID":"82df93d8-cc2b-4f7b-9246-7cdf6b410645","Type":"ContainerStarted","Data":"b3889c10f7e386ac3401863fe7996c59134fda27fc465a647c89055b371b84bc"} May 29 10:15:54.702793 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:54.702758 2575 generic.go:358] "Generic (PLEG): container finished" podID="82df93d8-cc2b-4f7b-9246-7cdf6b410645" containerID="7e25d3f266c7a5787b7a02031868d0771bb4319a5a7f257ebf8d5d0912b5e1a2" exitCode=1 May 29 10:15:54.703317 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:54.702862 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" event={"ID":"82df93d8-cc2b-4f7b-9246-7cdf6b410645","Type":"ContainerDied","Data":"7e25d3f266c7a5787b7a02031868d0771bb4319a5a7f257ebf8d5d0912b5e1a2"} May 29 10:15:54.703317 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:54.703041 2575 scope.go:117] "RemoveContainer" containerID="7e25d3f266c7a5787b7a02031868d0771bb4319a5a7f257ebf8d5d0912b5e1a2" May 29 10:15:55.032745 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.032704 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4nfxm"] May 29 10:15:55.036203 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.036178 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:55.038238 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.038213 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 29 10:15:55.038378 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.038280 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-stqsd\"" May 29 10:15:55.041123 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.041099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/478430c9-880d-466b-ad2a-ac6edc3e2c38-cert\") pod \"kserve-controller-manager-856948b99f-4nfxm\" (UID: \"478430c9-880d-466b-ad2a-ac6edc3e2c38\") " pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:55.041303 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.041280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dnw8\" (UniqueName: \"kubernetes.io/projected/478430c9-880d-466b-ad2a-ac6edc3e2c38-kube-api-access-5dnw8\") pod \"kserve-controller-manager-856948b99f-4nfxm\" (UID: \"478430c9-880d-466b-ad2a-ac6edc3e2c38\") " pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:55.044277 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.044253 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4nfxm"] May 29 10:15:55.142516 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.142481 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnw8\" (UniqueName: \"kubernetes.io/projected/478430c9-880d-466b-ad2a-ac6edc3e2c38-kube-api-access-5dnw8\") pod \"kserve-controller-manager-856948b99f-4nfxm\" (UID: \"478430c9-880d-466b-ad2a-ac6edc3e2c38\") " pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:55.142693 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.142528 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/478430c9-880d-466b-ad2a-ac6edc3e2c38-cert\") pod \"kserve-controller-manager-856948b99f-4nfxm\" (UID: \"478430c9-880d-466b-ad2a-ac6edc3e2c38\") " pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:55.142693 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:15:55.142661 2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 29 10:15:55.142778 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:15:55.142720 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478430c9-880d-466b-ad2a-ac6edc3e2c38-cert podName:478430c9-880d-466b-ad2a-ac6edc3e2c38 nodeName:}" failed. No retries permitted until 2026-05-29 10:15:55.64270296 +0000 UTC m=+477.275744093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/478430c9-880d-466b-ad2a-ac6edc3e2c38-cert") pod "kserve-controller-manager-856948b99f-4nfxm" (UID: "478430c9-880d-466b-ad2a-ac6edc3e2c38") : secret "kserve-webhook-server-cert" not found May 29 10:15:55.151631 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.151602 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dnw8\" (UniqueName: \"kubernetes.io/projected/478430c9-880d-466b-ad2a-ac6edc3e2c38-kube-api-access-5dnw8\") pod \"kserve-controller-manager-856948b99f-4nfxm\" (UID: \"478430c9-880d-466b-ad2a-ac6edc3e2c38\") " pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:55.647796 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.647756 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/478430c9-880d-466b-ad2a-ac6edc3e2c38-cert\") pod \"kserve-controller-manager-856948b99f-4nfxm\" (UID: \"478430c9-880d-466b-ad2a-ac6edc3e2c38\") " pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:55.650229 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.650196 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/478430c9-880d-466b-ad2a-ac6edc3e2c38-cert\") pod \"kserve-controller-manager-856948b99f-4nfxm\" (UID: \"478430c9-880d-466b-ad2a-ac6edc3e2c38\") " pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:55.707961 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.707906 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" event={"ID":"82df93d8-cc2b-4f7b-9246-7cdf6b410645","Type":"ContainerStarted","Data":"e2f9c69b224cc2128a73d4d60a51d5e0efaf22f3c3058d3a62de49a5d308e9fe"} May 29 10:15:55.708356 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.708011 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:15:55.724567 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.724508 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" podStartSLOduration=2.909181797 podStartE2EDuration="6.724486891s" podCreationTimestamp="2026-05-29 10:15:49 +0000 UTC" firstStartedPulling="2026-05-29 10:15:51.1474972 +0000 UTC m=+472.780538333" lastFinishedPulling="2026-05-29 10:15:54.962802292 +0000 UTC m=+476.595843427" observedRunningTime="2026-05-29 10:15:55.723867956 +0000 UTC m=+477.356909113" watchObservedRunningTime="2026-05-29 10:15:55.724486891 +0000 UTC m=+477.357528058" May 29 10:15:55.950495 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:55.950401 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:56.095040 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:56.095000 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4nfxm"] May 29 10:15:56.712360 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:56.712324 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" event={"ID":"478430c9-880d-466b-ad2a-ac6edc3e2c38","Type":"ContainerStarted","Data":"f4014067ad3a68b91d43f65415a0bc4c05cdd40053e01728bcc55a095cf2566d"} May 29 10:15:59.729718 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:59.729620 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" event={"ID":"478430c9-880d-466b-ad2a-ac6edc3e2c38","Type":"ContainerStarted","Data":"96b4c4cdf3ce167aa2657c6ed6b486d5139f5a8eb831283d72698a59e484a085"} May 29 10:15:59.730195 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:59.729794 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:15:59.883247 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:15:59.883178 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" podStartSLOduration=1.53699147 podStartE2EDuration="4.883164276s" podCreationTimestamp="2026-05-29 10:15:55 +0000 UTC" firstStartedPulling="2026-05-29 10:15:56.101806869 +0000 UTC m=+477.734848010" lastFinishedPulling="2026-05-29 10:15:59.447979682 +0000 UTC m=+481.081020816" observedRunningTime="2026-05-29 10:15:59.881140533 +0000 UTC m=+481.514181690" watchObservedRunningTime="2026-05-29 10:15:59.883164276 +0000 UTC m=+481.516205431" May 29 10:16:06.715404 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:06.715372 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-tbx77" May 29 10:16:10.084432 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.084394 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c"] May 29 10:16:10.088036 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.088015 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.090143 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.090118 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 29 10:16:10.090244 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.090225 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m2mj6\"" May 29 10:16:10.098323 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.098299 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c"] May 29 10:16:10.179412 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.179412 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.179663 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.179663 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179511 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rzw5\" (UniqueName: \"kubernetes.io/projected/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-kube-api-access-8rzw5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.179663 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.179663 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179577 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.179663 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.179663 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.179953 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.179695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280181 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280139 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rzw5\" (UniqueName: \"kubernetes.io/projected/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-kube-api-access-8rzw5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280381 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280188 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280381 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280323 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280404 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280434 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280478 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280711 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280525 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280711 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280553 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.280711 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280609 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.281016 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.280962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.281130 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.281015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.281130 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.281081 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.281246 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.281224 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.281288 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.281239 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.283149 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.283129 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.283354 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.283338 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.288565 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.288537 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.288658 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.288614 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rzw5\" (UniqueName: \"kubernetes.io/projected/042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9-kube-api-access-8rzw5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b4j26c\" (UID: \"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.400040 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.399941 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:10.546228 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.546181 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c"] May 29 10:16:10.549304 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:16:10.549274 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042ad68c_39e8_45b0_9fa9_0fd4b2e51ce9.slice/crio-ca662d2e9a76120cbc9870231f4ec3e19643b4652ae4c956c9b4d837f858cec7 WatchSource:0}: Error finding container ca662d2e9a76120cbc9870231f4ec3e19643b4652ae4c956c9b4d837f858cec7: Status 404 returned error can't find the container with id ca662d2e9a76120cbc9870231f4ec3e19643b4652ae4c956c9b4d837f858cec7 May 29 10:16:10.767375 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:10.767336 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" event={"ID":"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9","Type":"ContainerStarted","Data":"ca662d2e9a76120cbc9870231f4ec3e19643b4652ae4c956c9b4d837f858cec7"} May 29 10:16:13.139377 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:13.139336 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 10:16:13.139743 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:13.139424 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 10:16:13.139743 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:13.139471 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 10:16:13.779135 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:13.779090 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" event={"ID":"042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9","Type":"ContainerStarted","Data":"3b1b9ef61f08f4dc85b157114688b7f374165e86ae21d04e6dc047141266ceea"} May 29 10:16:13.799151 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:13.799098 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" podStartSLOduration=1.211858142 podStartE2EDuration="3.799083229s" podCreationTimestamp="2026-05-29 10:16:10 +0000 UTC" firstStartedPulling="2026-05-29 10:16:10.551863984 +0000 UTC m=+492.184905116" lastFinishedPulling="2026-05-29 10:16:13.139089066 +0000 UTC m=+494.772130203" observedRunningTime="2026-05-29 10:16:13.797253536 +0000 UTC m=+495.430294692" watchObservedRunningTime="2026-05-29 10:16:13.799083229 +0000 UTC m=+495.432124384" May 29 10:16:14.400706 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:14.400665 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:14.405421 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:14.405395 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:14.782702 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:14.782672 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:14.783809 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:14.783789 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b4j26c" May 29 10:16:30.738204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:30.738172 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-4nfxm" May 29 10:16:45.847921 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:45.847821 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2sq"] May 29 10:16:45.857395 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:45.857372 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" May 29 10:16:45.859626 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:45.859599 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 29 10:16:45.859865 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:45.859735 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 29 10:16:45.860262 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:45.860239 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fmcp8\"" May 29 10:16:45.860422 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:45.860400 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2sq"] May 29 10:16:45.904022 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:45.903988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwrzd\" (UniqueName: \"kubernetes.io/projected/b8330e6a-83f2-4cc0-a2f5-eab5950932cf-kube-api-access-nwrzd\") pod \"kuadrant-operator-catalog-rv2sq\" (UID: \"b8330e6a-83f2-4cc0-a2f5-eab5950932cf\") " pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" May 29 10:16:46.004886 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.004850 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwrzd\" (UniqueName: \"kubernetes.io/projected/b8330e6a-83f2-4cc0-a2f5-eab5950932cf-kube-api-access-nwrzd\") pod \"kuadrant-operator-catalog-rv2sq\" (UID: \"b8330e6a-83f2-4cc0-a2f5-eab5950932cf\") " pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" May 29 10:16:46.012377 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.012353 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwrzd\" (UniqueName: \"kubernetes.io/projected/b8330e6a-83f2-4cc0-a2f5-eab5950932cf-kube-api-access-nwrzd\") pod \"kuadrant-operator-catalog-rv2sq\" (UID: \"b8330e6a-83f2-4cc0-a2f5-eab5950932cf\") " pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" May 29 10:16:46.169619 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.169531 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" May 29 10:16:46.216936 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.216905 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2sq"] May 29 10:16:46.303061 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.303035 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2sq"] May 29 10:16:46.305337 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:16:46.305309 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8330e6a_83f2_4cc0_a2f5_eab5950932cf.slice/crio-4a97ea0aa38c90e31ac55c476f71cb4b625860f08d3f65db9b9c787e71773ccf WatchSource:0}: Error finding container 4a97ea0aa38c90e31ac55c476f71cb4b625860f08d3f65db9b9c787e71773ccf: Status 404 returned error can't find the container with id 4a97ea0aa38c90e31ac55c476f71cb4b625860f08d3f65db9b9c787e71773ccf May 29 10:16:46.423852 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.423747 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42cbm"] May 29 10:16:46.428683 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.428664 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:16:46.434736 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.434710 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42cbm"] May 29 10:16:46.508744 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.508708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tck2m\" (UniqueName: \"kubernetes.io/projected/a7384ebc-2828-4ed2-9140-5b783166762b-kube-api-access-tck2m\") pod \"kuadrant-operator-catalog-42cbm\" (UID: \"a7384ebc-2828-4ed2-9140-5b783166762b\") " pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:16:46.609635 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.609590 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tck2m\" (UniqueName: \"kubernetes.io/projected/a7384ebc-2828-4ed2-9140-5b783166762b-kube-api-access-tck2m\") pod \"kuadrant-operator-catalog-42cbm\" (UID: \"a7384ebc-2828-4ed2-9140-5b783166762b\") " pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:16:46.617463 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.617432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tck2m\" (UniqueName: \"kubernetes.io/projected/a7384ebc-2828-4ed2-9140-5b783166762b-kube-api-access-tck2m\") pod \"kuadrant-operator-catalog-42cbm\" (UID: \"a7384ebc-2828-4ed2-9140-5b783166762b\") " pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:16:46.739591 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.739509 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:16:46.896147 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.896105 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" event={"ID":"b8330e6a-83f2-4cc0-a2f5-eab5950932cf","Type":"ContainerStarted","Data":"4a97ea0aa38c90e31ac55c476f71cb4b625860f08d3f65db9b9c787e71773ccf"} May 29 10:16:46.920221 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:46.920197 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42cbm"] May 29 10:16:46.991125 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:16:46.991045 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7384ebc_2828_4ed2_9140_5b783166762b.slice/crio-2a827bfb45ca3c3ebefe07e6b64de09c59b64d6593bf08d7e6a0488d25ebe8db WatchSource:0}: Error finding container 2a827bfb45ca3c3ebefe07e6b64de09c59b64d6593bf08d7e6a0488d25ebe8db: Status 404 returned error can't find the container with id 2a827bfb45ca3c3ebefe07e6b64de09c59b64d6593bf08d7e6a0488d25ebe8db May 29 10:16:47.901505 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:47.901469 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" event={"ID":"a7384ebc-2828-4ed2-9140-5b783166762b","Type":"ContainerStarted","Data":"2a827bfb45ca3c3ebefe07e6b64de09c59b64d6593bf08d7e6a0488d25ebe8db"} May 29 10:16:48.906724 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:48.906677 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" event={"ID":"b8330e6a-83f2-4cc0-a2f5-eab5950932cf","Type":"ContainerStarted","Data":"14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab"} May 29 10:16:48.907216 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:48.906823 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" podUID="b8330e6a-83f2-4cc0-a2f5-eab5950932cf" containerName="registry-server" containerID="cri-o://14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab" gracePeriod=2 May 29 10:16:48.908210 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:48.908169 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" event={"ID":"a7384ebc-2828-4ed2-9140-5b783166762b","Type":"ContainerStarted","Data":"95c71a7b58216cf3416037c61268d8edaca25c11423b8f1a1d8638dd7670d989"} May 29 10:16:48.924669 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:48.924617 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" podStartSLOduration=1.839039307 podStartE2EDuration="3.9245909s" podCreationTimestamp="2026-05-29 10:16:45 +0000 UTC" firstStartedPulling="2026-05-29 10:16:46.306564908 +0000 UTC m=+527.939606040" lastFinishedPulling="2026-05-29 10:16:48.392116493 +0000 UTC m=+530.025157633" observedRunningTime="2026-05-29 10:16:48.922226617 +0000 UTC m=+530.555267773" watchObservedRunningTime="2026-05-29 10:16:48.9245909 +0000 UTC m=+530.557632055" May 29 10:16:49.155147 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.155116 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" May 29 10:16:49.169990 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.169893 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" podStartSLOduration=1.767344612 podStartE2EDuration="3.169875896s" podCreationTimestamp="2026-05-29 10:16:46 +0000 UTC" firstStartedPulling="2026-05-29 10:16:46.992513892 +0000 UTC m=+528.625555041" lastFinishedPulling="2026-05-29 10:16:48.395045187 +0000 UTC m=+530.028086325" observedRunningTime="2026-05-29 10:16:48.94546435 +0000 UTC m=+530.578505506" watchObservedRunningTime="2026-05-29 10:16:49.169875896 +0000 UTC m=+530.802917053" May 29 10:16:49.236608 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.236568 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwrzd\" (UniqueName: \"kubernetes.io/projected/b8330e6a-83f2-4cc0-a2f5-eab5950932cf-kube-api-access-nwrzd\") pod \"b8330e6a-83f2-4cc0-a2f5-eab5950932cf\" (UID: \"b8330e6a-83f2-4cc0-a2f5-eab5950932cf\") " May 29 10:16:49.238751 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.238726 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8330e6a-83f2-4cc0-a2f5-eab5950932cf-kube-api-access-nwrzd" (OuterVolumeSpecName: "kube-api-access-nwrzd") pod "b8330e6a-83f2-4cc0-a2f5-eab5950932cf" (UID: "b8330e6a-83f2-4cc0-a2f5-eab5950932cf"). InnerVolumeSpecName "kube-api-access-nwrzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:16:49.337883 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.337817 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwrzd\" (UniqueName: \"kubernetes.io/projected/b8330e6a-83f2-4cc0-a2f5-eab5950932cf-kube-api-access-nwrzd\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:16:49.912867 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.912805 2575 generic.go:358] "Generic (PLEG): container finished" podID="b8330e6a-83f2-4cc0-a2f5-eab5950932cf" containerID="14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab" exitCode=0 May 29 10:16:49.913323 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.912864 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" event={"ID":"b8330e6a-83f2-4cc0-a2f5-eab5950932cf","Type":"ContainerDied","Data":"14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab"} May 29 10:16:49.913323 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.912893 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" May 29 10:16:49.913323 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.912911 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rv2sq" event={"ID":"b8330e6a-83f2-4cc0-a2f5-eab5950932cf","Type":"ContainerDied","Data":"4a97ea0aa38c90e31ac55c476f71cb4b625860f08d3f65db9b9c787e71773ccf"} May 29 10:16:49.913323 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.912932 2575 scope.go:117] "RemoveContainer" containerID="14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab" May 29 10:16:49.921392 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.921374 2575 scope.go:117] "RemoveContainer" containerID="14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab" May 29 10:16:49.921635 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:16:49.921620 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab\": container with ID starting with 14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab not found: ID does not exist" containerID="14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab" May 29 10:16:49.921681 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.921642 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab"} err="failed to get container status \"14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab\": rpc error: code = NotFound desc = could not find container \"14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab\": container with ID starting with 14666c8fbab271306ef1e292013dfea7c12937982c4d19c69b34e3ad532d6bab not found: ID does not exist" May 29 10:16:49.933772 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.933741 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2sq"] May 29 10:16:49.936917 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:49.936896 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2sq"] May 29 10:16:51.012418 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:51.012380 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8330e6a-83f2-4cc0-a2f5-eab5950932cf" path="/var/lib/kubelet/pods/b8330e6a-83f2-4cc0-a2f5-eab5950932cf/volumes" May 29 10:16:56.739741 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:56.739702 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:16:56.739741 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:56.739743 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:16:56.761750 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:56.761720 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:16:56.959335 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:16:56.959303 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-42cbm" May 29 10:17:12.259153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.259119 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq"] May 29 10:17:12.259629 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.259478 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8330e6a-83f2-4cc0-a2f5-eab5950932cf" containerName="registry-server" May 29 10:17:12.259629 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.259490 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8330e6a-83f2-4cc0-a2f5-eab5950932cf" containerName="registry-server" May 29 10:17:12.259629 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.259548 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="b8330e6a-83f2-4cc0-a2f5-eab5950932cf" containerName="registry-server" May 29 10:17:12.262549 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.262527 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" May 29 10:17:12.264500 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.264482 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 29 10:17:12.264603 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.264581 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sw92q\"" May 29 10:17:12.278761 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.278733 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq"] May 29 10:17:12.353656 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.353614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hznd5\" (UniqueName: \"kubernetes.io/projected/9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f-kube-api-access-hznd5\") pod \"dns-operator-controller-manager-648d5c98bc-bklkq\" (UID: \"9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" May 29 10:17:12.455042 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.455003 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hznd5\" (UniqueName: \"kubernetes.io/projected/9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f-kube-api-access-hznd5\") pod \"dns-operator-controller-manager-648d5c98bc-bklkq\" (UID: \"9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" May 29 10:17:12.475314 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.475281 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hznd5\" (UniqueName: \"kubernetes.io/projected/9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f-kube-api-access-hznd5\") pod \"dns-operator-controller-manager-648d5c98bc-bklkq\" (UID: \"9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" May 29 10:17:12.572955 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.572918 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" May 29 10:17:12.730761 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.730703 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq"] May 29 10:17:12.741916 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:17:12.741876 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c198a7b_8e94_4c3b_bd21_41fa2b7dde7f.slice/crio-aa523b26a608ac28bf7f5f460157f786267afa9fc6e7552fbe0a15eb779810b7 WatchSource:0}: Error finding container aa523b26a608ac28bf7f5f460157f786267afa9fc6e7552fbe0a15eb779810b7: Status 404 returned error can't find the container with id aa523b26a608ac28bf7f5f460157f786267afa9fc6e7552fbe0a15eb779810b7 May 29 10:17:12.990860 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:12.990751 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" event={"ID":"9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f","Type":"ContainerStarted","Data":"aa523b26a608ac28bf7f5f460157f786267afa9fc6e7552fbe0a15eb779810b7"} May 29 10:17:15.000016 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:14.999978 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" event={"ID":"9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f","Type":"ContainerStarted","Data":"119500f985395736a34ee29b20721cf245920d9ba71d57d99fe81986b2ae2a98"} May 29 10:17:15.000406 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:15.000118 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" May 29 10:17:15.019147 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:15.019097 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" podStartSLOduration=0.892534003 podStartE2EDuration="3.019082882s" podCreationTimestamp="2026-05-29 10:17:12 +0000 UTC" firstStartedPulling="2026-05-29 10:17:12.744273269 +0000 UTC m=+554.377314401" lastFinishedPulling="2026-05-29 10:17:14.870822133 +0000 UTC m=+556.503863280" observedRunningTime="2026-05-29 10:17:15.01750144 +0000 UTC m=+556.650542619" watchObservedRunningTime="2026-05-29 10:17:15.019082882 +0000 UTC m=+556.652124036" May 29 10:17:17.860442 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:17.860406 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4"] May 29 10:17:17.866993 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:17.866964 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:17.869222 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:17.869200 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rm65w\"" May 29 10:17:17.876787 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:17.876761 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4"] May 29 10:17:18.005532 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:18.005492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dwws\" (UniqueName: \"kubernetes.io/projected/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-kube-api-access-6dwws\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7ts4\" (UID: \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:18.005708 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:18.005563 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7ts4\" (UID: \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:18.106556 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:18.106515 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dwws\" (UniqueName: \"kubernetes.io/projected/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-kube-api-access-6dwws\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7ts4\" (UID: \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:18.106734 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:18.106596 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7ts4\" (UID: \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:18.107026 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:18.107005 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7ts4\" (UID: \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:18.118564 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:18.118496 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dwws\" (UniqueName: \"kubernetes.io/projected/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-kube-api-access-6dwws\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7ts4\" (UID: \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:18.178486 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:18.178446 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:18.325802 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:18.325774 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4"] May 29 10:17:18.328721 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:17:18.328690 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2b58c5_ba22_47ce_9954_d2fca95f3b12.slice/crio-d92759e9cffaa041e3bfcd0ddb5bd0dbdf9d91e28e1da85126a56fa496f9d818 WatchSource:0}: Error finding container d92759e9cffaa041e3bfcd0ddb5bd0dbdf9d91e28e1da85126a56fa496f9d818: Status 404 returned error can't find the container with id d92759e9cffaa041e3bfcd0ddb5bd0dbdf9d91e28e1da85126a56fa496f9d818 May 29 10:17:19.015488 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:19.015457 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" event={"ID":"0c2b58c5-ba22-47ce-9954-d2fca95f3b12","Type":"ContainerStarted","Data":"d92759e9cffaa041e3bfcd0ddb5bd0dbdf9d91e28e1da85126a56fa496f9d818"} May 29 10:17:21.830760 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:21.830727 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-59g7n"] May 29 10:17:21.834614 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:21.834582 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-59g7n" May 29 10:17:21.837190 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:21.837161 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-x6z9k\"" May 29 10:17:21.841540 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:21.841506 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8mrh\" (UniqueName: \"kubernetes.io/projected/39f6c830-fd64-41bd-869f-99c65bf3b56b-kube-api-access-p8mrh\") pod \"authorino-operator-657f44b778-59g7n\" (UID: \"39f6c830-fd64-41bd-869f-99c65bf3b56b\") " pod="kuadrant-system/authorino-operator-657f44b778-59g7n" May 29 10:17:21.848813 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:21.848782 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-59g7n"] May 29 10:17:21.942188 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:21.942149 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8mrh\" (UniqueName: \"kubernetes.io/projected/39f6c830-fd64-41bd-869f-99c65bf3b56b-kube-api-access-p8mrh\") pod \"authorino-operator-657f44b778-59g7n\" (UID: \"39f6c830-fd64-41bd-869f-99c65bf3b56b\") " pod="kuadrant-system/authorino-operator-657f44b778-59g7n" May 29 10:17:21.964079 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:21.964049 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8mrh\" (UniqueName: \"kubernetes.io/projected/39f6c830-fd64-41bd-869f-99c65bf3b56b-kube-api-access-p8mrh\") pod \"authorino-operator-657f44b778-59g7n\" (UID: \"39f6c830-fd64-41bd-869f-99c65bf3b56b\") " pod="kuadrant-system/authorino-operator-657f44b778-59g7n" May 29 10:17:22.148001 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:22.147913 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-59g7n" May 29 10:17:22.285812 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:22.285777 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-59g7n"] May 29 10:17:22.287596 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:17:22.287561 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f6c830_fd64_41bd_869f_99c65bf3b56b.slice/crio-e846d555cb143938c790d6e76aa56b3950ef79b98d73069992a232f2a7c291e7 WatchSource:0}: Error finding container e846d555cb143938c790d6e76aa56b3950ef79b98d73069992a232f2a7c291e7: Status 404 returned error can't find the container with id e846d555cb143938c790d6e76aa56b3950ef79b98d73069992a232f2a7c291e7 May 29 10:17:23.032358 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:23.032317 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-59g7n" event={"ID":"39f6c830-fd64-41bd-869f-99c65bf3b56b","Type":"ContainerStarted","Data":"e846d555cb143938c790d6e76aa56b3950ef79b98d73069992a232f2a7c291e7"} May 29 10:17:24.037616 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.037578 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" event={"ID":"0c2b58c5-ba22-47ce-9954-d2fca95f3b12","Type":"ContainerStarted","Data":"214134f9ee2d9d31e94de290a67c346afda8d4cbbc73951e3025691f88534175"} May 29 10:17:24.038069 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.037668 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:24.060242 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.060181 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" podStartSLOduration=1.770682947 podStartE2EDuration="7.060165339s" podCreationTimestamp="2026-05-29 10:17:17 +0000 UTC" firstStartedPulling="2026-05-29 10:17:18.331179763 +0000 UTC m=+559.964220896" lastFinishedPulling="2026-05-29 10:17:23.620662152 +0000 UTC m=+565.253703288" observedRunningTime="2026-05-29 10:17:24.057869139 +0000 UTC m=+565.690910288" watchObservedRunningTime="2026-05-29 10:17:24.060165339 +0000 UTC m=+565.693206493" May 29 10:17:24.641464 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.641425 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr"] May 29 10:17:24.645472 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.645444 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:24.647880 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.647791 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ghwmq\"" May 29 10:17:24.662677 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.662188 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr"] May 29 10:17:24.669795 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.669766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms458\" (UniqueName: \"kubernetes.io/projected/461f1e1e-dae7-4a80-92db-da5f4caa9891-kube-api-access-ms458\") pod \"limitador-operator-controller-manager-85c4996f8c-tlxrr\" (UID: \"461f1e1e-dae7-4a80-92db-da5f4caa9891\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:24.770652 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.770593 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ms458\" (UniqueName: \"kubernetes.io/projected/461f1e1e-dae7-4a80-92db-da5f4caa9891-kube-api-access-ms458\") pod \"limitador-operator-controller-manager-85c4996f8c-tlxrr\" (UID: \"461f1e1e-dae7-4a80-92db-da5f4caa9891\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:24.778398 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.778374 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms458\" (UniqueName: \"kubernetes.io/projected/461f1e1e-dae7-4a80-92db-da5f4caa9891-kube-api-access-ms458\") pod \"limitador-operator-controller-manager-85c4996f8c-tlxrr\" (UID: \"461f1e1e-dae7-4a80-92db-da5f4caa9891\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:24.968211 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:24.968117 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:25.112719 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:25.112696 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr"] May 29 10:17:25.115112 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:17:25.115083 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461f1e1e_dae7_4a80_92db_da5f4caa9891.slice/crio-82437048b71fe3402c6ef4e455b1abc581502f9b558ea9b684d5677940514210 WatchSource:0}: Error finding container 82437048b71fe3402c6ef4e455b1abc581502f9b558ea9b684d5677940514210: Status 404 returned error can't find the container with id 82437048b71fe3402c6ef4e455b1abc581502f9b558ea9b684d5677940514210 May 29 10:17:26.007248 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:26.007159 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bklkq" May 29 10:17:26.048645 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:26.048600 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" event={"ID":"461f1e1e-dae7-4a80-92db-da5f4caa9891","Type":"ContainerStarted","Data":"82437048b71fe3402c6ef4e455b1abc581502f9b558ea9b684d5677940514210"} May 29 10:17:27.055307 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:27.055261 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-59g7n" event={"ID":"39f6c830-fd64-41bd-869f-99c65bf3b56b","Type":"ContainerStarted","Data":"85ba97143013c5aa59321dbf64d5d4dd18f827675d86678a1d50808220e16e18"} May 29 10:17:27.055779 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:27.055416 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-59g7n" May 29 10:17:27.074486 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:27.074424 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-59g7n" podStartSLOduration=2.531529451 podStartE2EDuration="6.074409304s" podCreationTimestamp="2026-05-29 10:17:21 +0000 UTC" firstStartedPulling="2026-05-29 10:17:22.290023139 +0000 UTC m=+563.923064271" lastFinishedPulling="2026-05-29 10:17:25.832902986 +0000 UTC m=+567.465944124" observedRunningTime="2026-05-29 10:17:27.071785827 +0000 UTC m=+568.704826984" watchObservedRunningTime="2026-05-29 10:17:27.074409304 +0000 UTC m=+568.707450460" May 29 10:17:28.059972 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:28.059917 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" event={"ID":"461f1e1e-dae7-4a80-92db-da5f4caa9891","Type":"ContainerStarted","Data":"33b10a38129c0b6a952fc6b7bd23e4fd210bfa000ae49c062bba2e5c67372bd5"} May 29 10:17:28.060445 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:28.060020 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:28.083919 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:28.083859 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" podStartSLOduration=2.005297873 podStartE2EDuration="4.083821386s" podCreationTimestamp="2026-05-29 10:17:24 +0000 UTC" firstStartedPulling="2026-05-29 10:17:25.117460469 +0000 UTC m=+566.750501602" lastFinishedPulling="2026-05-29 10:17:27.195983973 +0000 UTC m=+568.829025115" observedRunningTime="2026-05-29 10:17:28.081348849 +0000 UTC m=+569.714390001" watchObservedRunningTime="2026-05-29 10:17:28.083821386 +0000 UTC m=+569.716862544" May 29 10:17:35.045239 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:35.045205 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:36.796362 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.796314 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q"] May 29 10:17:36.800081 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.800061 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:36.825050 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.825013 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q"] May 29 10:17:36.874510 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.874471 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q"] May 29 10:17:36.874767 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:17:36.874748 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-pdm5z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" May 29 10:17:36.883667 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.883629 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q"] May 29 10:17:36.884585 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.884556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdm5z\" (UniqueName: \"kubernetes.io/projected/b21c720d-1de6-4f79-9738-93c66b84d71c-kube-api-access-pdm5z\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" (UID: \"b21c720d-1de6-4f79-9738-93c66b84d71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:36.884718 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.884616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b21c720d-1de6-4f79-9738-93c66b84d71c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" (UID: \"b21c720d-1de6-4f79-9738-93c66b84d71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:36.898276 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.898245 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4"] May 29 10:17:36.898583 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.898550 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" podUID="0c2b58c5-ba22-47ce-9954-d2fca95f3b12" containerName="manager" containerID="cri-o://214134f9ee2d9d31e94de290a67c346afda8d4cbbc73951e3025691f88534175" gracePeriod=2 May 29 10:17:36.901243 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.901216 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc"] May 29 10:17:36.905127 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.905100 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:36.911370 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.911335 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4"] May 29 10:17:36.947261 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.947214 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc"] May 29 10:17:36.949760 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.949729 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr"] May 29 10:17:36.950063 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.950028 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" podUID="461f1e1e-dae7-4a80-92db-da5f4caa9891" containerName="manager" containerID="cri-o://33b10a38129c0b6a952fc6b7bd23e4fd210bfa000ae49c062bba2e5c67372bd5" gracePeriod=2 May 29 10:17:36.951967 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.951938 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:36.974804 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.974722 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr"] May 29 10:17:36.976723 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.976694 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh"] May 29 10:17:36.977225 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.977206 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c2b58c5-ba22-47ce-9954-d2fca95f3b12" containerName="manager" May 29 10:17:36.977225 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.977227 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c2b58c5-ba22-47ce-9954-d2fca95f3b12" containerName="manager" May 29 10:17:36.977384 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.977245 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461f1e1e-dae7-4a80-92db-da5f4caa9891" containerName="manager" May 29 10:17:36.977384 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.977252 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="461f1e1e-dae7-4a80-92db-da5f4caa9891" containerName="manager" May 29 10:17:36.977384 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.977326 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="461f1e1e-dae7-4a80-92db-da5f4caa9891" containerName="manager" May 29 10:17:36.977384 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.977343 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c2b58c5-ba22-47ce-9954-d2fca95f3b12" containerName="manager" May 29 10:17:36.980547 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.980527 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:36.985492 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.985455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49f73270-3bac-4f6d-866a-ce91ba1b28a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bzfwc\" (UID: \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:36.985621 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.985588 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdm5z\" (UniqueName: \"kubernetes.io/projected/b21c720d-1de6-4f79-9738-93c66b84d71c-kube-api-access-pdm5z\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" (UID: \"b21c720d-1de6-4f79-9738-93c66b84d71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:36.985707 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.985692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zsgr\" (UniqueName: \"kubernetes.io/projected/49f73270-3bac-4f6d-866a-ce91ba1b28a7-kube-api-access-9zsgr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bzfwc\" (UID: \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:36.985766 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.985735 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b21c720d-1de6-4f79-9738-93c66b84d71c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" (UID: \"b21c720d-1de6-4f79-9738-93c66b84d71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:36.986191 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:36.986157 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b21c720d-1de6-4f79-9738-93c66b84d71c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" (UID: \"b21c720d-1de6-4f79-9738-93c66b84d71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:36.994800 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:17:36.994699 2575 projected.go:194] Error preparing data for projected volume kube-api-access-pdm5z for pod kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q: failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-sq85q" not found May 29 10:17:36.994800 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:17:36.994773 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b21c720d-1de6-4f79-9738-93c66b84d71c-kube-api-access-pdm5z podName:b21c720d-1de6-4f79-9738-93c66b84d71c nodeName:}" failed. No retries permitted until 2026-05-29 10:17:37.49475043 +0000 UTC m=+579.127791563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pdm5z" (UniqueName: "kubernetes.io/projected/b21c720d-1de6-4f79-9738-93c66b84d71c-kube-api-access-pdm5z") pod "kuadrant-operator-controller-manager-55c7f4c975-sq85q" (UID: "b21c720d-1de6-4f79-9738-93c66b84d71c") : failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-sq85q" not found May 29 10:17:37.001235 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.000387 2575 status_manager.go:895] "Failed to get status for pod" podUID="0c2b58c5-ba22-47ce-9954-d2fca95f3b12" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c7ts4\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:37.001235 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.000458 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh"] May 29 10:17:37.003860 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.003080 2575 status_manager.go:895] "Failed to get status for pod" podUID="0c2b58c5-ba22-47ce-9954-d2fca95f3b12" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c7ts4\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:37.008755 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.008708 2575 status_manager.go:895] "Failed to get status for pod" podUID="461f1e1e-dae7-4a80-92db-da5f4caa9891" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" err="pods \"limitador-operator-controller-manager-85c4996f8c-tlxrr\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:37.086504 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.086468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc52k\" (UniqueName: \"kubernetes.io/projected/a853f9cd-61e3-4363-a388-c6c8222d7172-kube-api-access-dc52k\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vfxmh\" (UID: \"a853f9cd-61e3-4363-a388-c6c8222d7172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:37.086626 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.086524 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsgr\" (UniqueName: \"kubernetes.io/projected/49f73270-3bac-4f6d-866a-ce91ba1b28a7-kube-api-access-9zsgr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bzfwc\" (UID: \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:37.086626 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.086565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a853f9cd-61e3-4363-a388-c6c8222d7172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vfxmh\" (UID: \"a853f9cd-61e3-4363-a388-c6c8222d7172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:37.086700 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.086636 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49f73270-3bac-4f6d-866a-ce91ba1b28a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bzfwc\" (UID: \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:37.087310 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.087259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49f73270-3bac-4f6d-866a-ce91ba1b28a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bzfwc\" (UID: \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:37.098532 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.097865 2575 generic.go:358] "Generic (PLEG): container finished" podID="461f1e1e-dae7-4a80-92db-da5f4caa9891" containerID="33b10a38129c0b6a952fc6b7bd23e4fd210bfa000ae49c062bba2e5c67372bd5" exitCode=0 May 29 10:17:37.100679 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.100646 2575 generic.go:358] "Generic (PLEG): container finished" podID="0c2b58c5-ba22-47ce-9954-d2fca95f3b12" containerID="214134f9ee2d9d31e94de290a67c346afda8d4cbbc73951e3025691f88534175" exitCode=0 May 29 10:17:37.100776 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.100768 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:37.102171 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.102127 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zsgr\" (UniqueName: \"kubernetes.io/projected/49f73270-3bac-4f6d-866a-ce91ba1b28a7-kube-api-access-9zsgr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bzfwc\" (UID: \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:37.115759 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.115728 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:37.118022 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.117983 2575 status_manager.go:895] "Failed to get status for pod" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:37.159443 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.159420 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:37.162025 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.161997 2575 status_manager.go:895] "Failed to get status for pod" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:37.180952 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.180929 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:37.183237 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.183211 2575 status_manager.go:895] "Failed to get status for pod" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:37.187543 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.187523 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b21c720d-1de6-4f79-9738-93c66b84d71c-extensions-socket-volume\") pod \"b21c720d-1de6-4f79-9738-93c66b84d71c\" (UID: \"b21c720d-1de6-4f79-9738-93c66b84d71c\") " May 29 10:17:37.187725 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.187711 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc52k\" (UniqueName: \"kubernetes.io/projected/a853f9cd-61e3-4363-a388-c6c8222d7172-kube-api-access-dc52k\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vfxmh\" (UID: \"a853f9cd-61e3-4363-a388-c6c8222d7172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:37.187774 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.187742 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a853f9cd-61e3-4363-a388-c6c8222d7172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vfxmh\" (UID: \"a853f9cd-61e3-4363-a388-c6c8222d7172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:37.187818 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.187766 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b21c720d-1de6-4f79-9738-93c66b84d71c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b21c720d-1de6-4f79-9738-93c66b84d71c" (UID: "b21c720d-1de6-4f79-9738-93c66b84d71c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:17:37.187818 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.187784 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdm5z\" (UniqueName: \"kubernetes.io/projected/b21c720d-1de6-4f79-9738-93c66b84d71c-kube-api-access-pdm5z\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:17:37.188078 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.188063 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a853f9cd-61e3-4363-a388-c6c8222d7172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vfxmh\" (UID: \"a853f9cd-61e3-4363-a388-c6c8222d7172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:37.197609 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.197583 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc52k\" (UniqueName: \"kubernetes.io/projected/a853f9cd-61e3-4363-a388-c6c8222d7172-kube-api-access-dc52k\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vfxmh\" (UID: \"a853f9cd-61e3-4363-a388-c6c8222d7172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:37.289078 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.289036 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms458\" (UniqueName: \"kubernetes.io/projected/461f1e1e-dae7-4a80-92db-da5f4caa9891-kube-api-access-ms458\") pod \"461f1e1e-dae7-4a80-92db-da5f4caa9891\" (UID: \"461f1e1e-dae7-4a80-92db-da5f4caa9891\") " May 29 10:17:37.289270 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.289120 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-extensions-socket-volume\") pod \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\" (UID: \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\") " May 29 10:17:37.289270 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.289172 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dwws\" (UniqueName: \"kubernetes.io/projected/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-kube-api-access-6dwws\") pod \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\" (UID: \"0c2b58c5-ba22-47ce-9954-d2fca95f3b12\") " May 29 10:17:37.289392 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.289308 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b21c720d-1de6-4f79-9738-93c66b84d71c-extensions-socket-volume\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:17:37.289690 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.289659 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0c2b58c5-ba22-47ce-9954-d2fca95f3b12" (UID: "0c2b58c5-ba22-47ce-9954-d2fca95f3b12"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:17:37.291308 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.291286 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-kube-api-access-6dwws" (OuterVolumeSpecName: "kube-api-access-6dwws") pod "0c2b58c5-ba22-47ce-9954-d2fca95f3b12" (UID: "0c2b58c5-ba22-47ce-9954-d2fca95f3b12"). InnerVolumeSpecName "kube-api-access-6dwws". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:17:37.291375 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.291299 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461f1e1e-dae7-4a80-92db-da5f4caa9891-kube-api-access-ms458" (OuterVolumeSpecName: "kube-api-access-ms458") pod "461f1e1e-dae7-4a80-92db-da5f4caa9891" (UID: "461f1e1e-dae7-4a80-92db-da5f4caa9891"). InnerVolumeSpecName "kube-api-access-ms458". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:17:37.321584 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.321495 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:37.329457 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.329437 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:37.390751 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.390673 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dwws\" (UniqueName: \"kubernetes.io/projected/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-kube-api-access-6dwws\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:17:37.390751 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.390709 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms458\" (UniqueName: \"kubernetes.io/projected/461f1e1e-dae7-4a80-92db-da5f4caa9891-kube-api-access-ms458\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:17:37.390751 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.390725 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2b58c5-ba22-47ce-9954-d2fca95f3b12-extensions-socket-volume\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:17:37.505912 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.505886 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc"] May 29 10:17:37.508815 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:17:37.508785 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f73270_3bac_4f6d_866a_ce91ba1b28a7.slice/crio-b3ea55347eed4d7c7c5635d196c71babf9ca13b9a7316d990a1ff6c285824a8f WatchSource:0}: Error finding container b3ea55347eed4d7c7c5635d196c71babf9ca13b9a7316d990a1ff6c285824a8f: Status 404 returned error can't find the container with id b3ea55347eed4d7c7c5635d196c71babf9ca13b9a7316d990a1ff6c285824a8f May 29 10:17:37.518570 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:37.518549 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh"] May 29 10:17:37.522211 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:17:37.522185 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda853f9cd_61e3_4363_a388_c6c8222d7172.slice/crio-aa0728ecd56038b07402fd5b396b26e26e58bdcde3ecaea4db4e521b1afbde33 WatchSource:0}: Error finding container aa0728ecd56038b07402fd5b396b26e26e58bdcde3ecaea4db4e521b1afbde33: Status 404 returned error can't find the container with id aa0728ecd56038b07402fd5b396b26e26e58bdcde3ecaea4db4e521b1afbde33 May 29 10:17:38.062941 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.062907 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-59g7n" May 29 10:17:38.088638 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.088602 2575 status_manager.go:895] "Failed to get status for pod" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:38.105700 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.105674 2575 scope.go:117] "RemoveContainer" containerID="33b10a38129c0b6a952fc6b7bd23e4fd210bfa000ae49c062bba2e5c67372bd5" May 29 10:17:38.105879 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.105670 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" May 29 10:17:38.107654 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.107616 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" event={"ID":"49f73270-3bac-4f6d-866a-ce91ba1b28a7","Type":"ContainerStarted","Data":"5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0"} May 29 10:17:38.107654 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.107657 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" event={"ID":"49f73270-3bac-4f6d-866a-ce91ba1b28a7","Type":"ContainerStarted","Data":"b3ea55347eed4d7c7c5635d196c71babf9ca13b9a7316d990a1ff6c285824a8f"} May 29 10:17:38.107932 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.107889 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:38.108135 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.108107 2575 status_manager.go:895] "Failed to get status for pod" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:38.109489 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.109461 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7ts4" May 29 10:17:38.114864 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.113191 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" May 29 10:17:38.114864 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.113928 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" event={"ID":"a853f9cd-61e3-4363-a388-c6c8222d7172","Type":"ContainerStarted","Data":"16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f"} May 29 10:17:38.114864 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.113959 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" event={"ID":"a853f9cd-61e3-4363-a388-c6c8222d7172","Type":"ContainerStarted","Data":"aa0728ecd56038b07402fd5b396b26e26e58bdcde3ecaea4db4e521b1afbde33"} May 29 10:17:38.114864 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.114005 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:38.117463 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.117440 2575 scope.go:117] "RemoveContainer" containerID="214134f9ee2d9d31e94de290a67c346afda8d4cbbc73951e3025691f88534175" May 29 10:17:38.167262 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.167202 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" podStartSLOduration=2.167182703 podStartE2EDuration="2.167182703s" podCreationTimestamp="2026-05-29 10:17:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:17:38.166463191 +0000 UTC m=+579.799504375" watchObservedRunningTime="2026-05-29 10:17:38.167182703 +0000 UTC m=+579.800223862" May 29 10:17:38.169205 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.169170 2575 status_manager.go:895] "Failed to get status for pod" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:38.171201 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.171174 2575 status_manager.go:895] "Failed to get status for pod" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:38.184427 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.184353 2575 status_manager.go:895] "Failed to get status for pod" podUID="461f1e1e-dae7-4a80-92db-da5f4caa9891" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" err="pods \"limitador-operator-controller-manager-85c4996f8c-tlxrr\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:38.236014 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:38.235921 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" podStartSLOduration=2.23589909 podStartE2EDuration="2.23589909s" podCreationTimestamp="2026-05-29 10:17:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:17:38.224130813 +0000 UTC m=+579.857171968" watchObservedRunningTime="2026-05-29 10:17:38.23589909 +0000 UTC m=+579.868940248" May 29 10:17:39.011432 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:39.011390 2575 status_manager.go:895] "Failed to get status for pod" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sq85q" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-sq85q\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:39.012670 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:39.012640 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c2b58c5-ba22-47ce-9954-d2fca95f3b12" path="/var/lib/kubelet/pods/0c2b58c5-ba22-47ce-9954-d2fca95f3b12/volumes" May 29 10:17:39.012985 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:39.012960 2575 status_manager.go:895] "Failed to get status for pod" podUID="461f1e1e-dae7-4a80-92db-da5f4caa9891" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tlxrr" err="pods \"limitador-operator-controller-manager-85c4996f8c-tlxrr\" is forbidden: User \"system:node:ip-10-0-136-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-71.ec2.internal' and this object" May 29 10:17:39.013109 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:39.013090 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461f1e1e-dae7-4a80-92db-da5f4caa9891" path="/var/lib/kubelet/pods/461f1e1e-dae7-4a80-92db-da5f4caa9891/volumes" May 29 10:17:39.013440 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:39.013423 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b21c720d-1de6-4f79-9738-93c66b84d71c" path="/var/lib/kubelet/pods/b21c720d-1de6-4f79-9738-93c66b84d71c/volumes" May 29 10:17:49.120650 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.120619 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:17:49.121156 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.120672 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:49.195596 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.195549 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh"] May 29 10:17:49.195818 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.195787 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" podUID="a853f9cd-61e3-4363-a388-c6c8222d7172" containerName="manager" containerID="cri-o://16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f" gracePeriod=10 May 29 10:17:49.437260 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.437237 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:49.602276 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.602247 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc52k\" (UniqueName: \"kubernetes.io/projected/a853f9cd-61e3-4363-a388-c6c8222d7172-kube-api-access-dc52k\") pod \"a853f9cd-61e3-4363-a388-c6c8222d7172\" (UID: \"a853f9cd-61e3-4363-a388-c6c8222d7172\") " May 29 10:17:49.602471 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.602320 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a853f9cd-61e3-4363-a388-c6c8222d7172-extensions-socket-volume\") pod \"a853f9cd-61e3-4363-a388-c6c8222d7172\" (UID: \"a853f9cd-61e3-4363-a388-c6c8222d7172\") " May 29 10:17:49.602693 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.602668 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a853f9cd-61e3-4363-a388-c6c8222d7172-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a853f9cd-61e3-4363-a388-c6c8222d7172" (UID: "a853f9cd-61e3-4363-a388-c6c8222d7172"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:17:49.604281 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.604265 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a853f9cd-61e3-4363-a388-c6c8222d7172-kube-api-access-dc52k" (OuterVolumeSpecName: "kube-api-access-dc52k") pod "a853f9cd-61e3-4363-a388-c6c8222d7172" (UID: "a853f9cd-61e3-4363-a388-c6c8222d7172"). InnerVolumeSpecName "kube-api-access-dc52k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:17:49.703674 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.703573 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a853f9cd-61e3-4363-a388-c6c8222d7172-extensions-socket-volume\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:17:49.703674 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:49.703612 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc52k\" (UniqueName: \"kubernetes.io/projected/a853f9cd-61e3-4363-a388-c6c8222d7172-kube-api-access-dc52k\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:17:50.160763 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.160725 2575 generic.go:358] "Generic (PLEG): container finished" podID="a853f9cd-61e3-4363-a388-c6c8222d7172" containerID="16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f" exitCode=0 May 29 10:17:50.161250 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.160798 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" May 29 10:17:50.161250 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.160807 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" event={"ID":"a853f9cd-61e3-4363-a388-c6c8222d7172","Type":"ContainerDied","Data":"16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f"} May 29 10:17:50.161250 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.160857 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh" event={"ID":"a853f9cd-61e3-4363-a388-c6c8222d7172","Type":"ContainerDied","Data":"aa0728ecd56038b07402fd5b396b26e26e58bdcde3ecaea4db4e521b1afbde33"} May 29 10:17:50.161250 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.160879 2575 scope.go:117] "RemoveContainer" containerID="16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f" May 29 10:17:50.169897 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.169877 2575 scope.go:117] "RemoveContainer" containerID="16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f" May 29 10:17:50.170161 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:17:50.170143 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f\": container with ID starting with 16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f not found: ID does not exist" containerID="16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f" May 29 10:17:50.170207 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.170170 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f"} err="failed to get container status \"16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f\": rpc error: code = NotFound desc = could not find container \"16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f\": container with ID starting with 16874c59d95d3fdf44f96521e197e043f9372e4d864f9f668b7b86dcfe6cac2f not found: ID does not exist" May 29 10:17:50.183712 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.183683 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh"] May 29 10:17:50.194990 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:50.194965 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vfxmh"] May 29 10:17:51.011787 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:51.011756 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a853f9cd-61e3-4363-a388-c6c8222d7172" path="/var/lib/kubelet/pods/a853f9cd-61e3-4363-a388-c6c8222d7172/volumes" May 29 10:17:58.928024 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:58.927983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:17:58.928440 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:17:58.928130 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:18:05.508321 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.508284 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4"] May 29 10:18:05.509251 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.509222 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a853f9cd-61e3-4363-a388-c6c8222d7172" containerName="manager" May 29 10:18:05.509251 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.509247 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a853f9cd-61e3-4363-a388-c6c8222d7172" containerName="manager" May 29 10:18:05.509428 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.509323 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a853f9cd-61e3-4363-a388-c6c8222d7172" containerName="manager" May 29 10:18:05.512455 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.512431 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.514774 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.514750 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t8zfk\"" May 29 10:18:05.524674 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.524644 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4"] May 29 10:18:05.545114 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545081 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.545268 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/562d5be3-666a-49d1-abe8-f33955d22168-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.545268 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/562d5be3-666a-49d1-abe8-f33955d22168-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.545364 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/562d5be3-666a-49d1-abe8-f33955d22168-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.545364 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.545364 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.545517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qss7\" (UniqueName: \"kubernetes.io/projected/562d5be3-666a-49d1-abe8-f33955d22168-kube-api-access-8qss7\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.545517 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.545608 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.545513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646388 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646356 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646388 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646391 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646656 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646415 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646656 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646460 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/562d5be3-666a-49d1-abe8-f33955d22168-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646656 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646558 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/562d5be3-666a-49d1-abe8-f33955d22168-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646656 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646582 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/562d5be3-666a-49d1-abe8-f33955d22168-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646656 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646611 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646964 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646678 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646964 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646770 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qss7\" (UniqueName: \"kubernetes.io/projected/562d5be3-666a-49d1-abe8-f33955d22168-kube-api-access-8qss7\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.646964 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.646921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.647114 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.647037 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.647197 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.647162 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.647255 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.647186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.647330 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.647309 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/562d5be3-666a-49d1-abe8-f33955d22168-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.648963 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.648938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/562d5be3-666a-49d1-abe8-f33955d22168-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.649189 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.649168 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/562d5be3-666a-49d1-abe8-f33955d22168-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.654408 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.654387 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/562d5be3-666a-49d1-abe8-f33955d22168-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.654511 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.654474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qss7\" (UniqueName: \"kubernetes.io/projected/562d5be3-666a-49d1-abe8-f33955d22168-kube-api-access-8qss7\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mfgp4\" (UID: \"562d5be3-666a-49d1-abe8-f33955d22168\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.826226 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.826188 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:05.959595 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.959560 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4"] May 29 10:18:05.963240 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:18:05.963205 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562d5be3_666a_49d1_abe8_f33955d22168.slice/crio-ff757d28a8b8082447dcf542aa7edfe9100011d036617a583247eb30ae5f901b WatchSource:0}: Error finding container ff757d28a8b8082447dcf542aa7edfe9100011d036617a583247eb30ae5f901b: Status 404 returned error can't find the container with id ff757d28a8b8082447dcf542aa7edfe9100011d036617a583247eb30ae5f901b May 29 10:18:05.965337 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.965299 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 10:18:05.965436 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.965388 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 10:18:05.965436 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:05.965429 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 10:18:06.216892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:06.216788 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" event={"ID":"562d5be3-666a-49d1-abe8-f33955d22168","Type":"ContainerStarted","Data":"afaf1597ce4986a0268baee62d9c575b2c7f6e71e7ef4ef61f3befda4aae7b18"} May 29 10:18:06.216892 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:06.216855 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" event={"ID":"562d5be3-666a-49d1-abe8-f33955d22168","Type":"ContainerStarted","Data":"ff757d28a8b8082447dcf542aa7edfe9100011d036617a583247eb30ae5f901b"} May 29 10:18:06.239040 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:06.238982 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" podStartSLOduration=1.238963207 podStartE2EDuration="1.238963207s" podCreationTimestamp="2026-05-29 10:18:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:18:06.235919304 +0000 UTC m=+607.868960460" watchObservedRunningTime="2026-05-29 10:18:06.238963207 +0000 UTC m=+607.872004366" May 29 10:18:06.826731 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:06.826685 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:07.832221 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:07.832188 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:08.223694 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:08.223606 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:08.224711 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:08.224698 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mfgp4" May 29 10:18:10.415138 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.415104 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-dpz79"] May 29 10:18:10.418897 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.418876 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:10.420920 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.420898 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 29 10:18:10.421027 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.420996 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b7cgm\"" May 29 10:18:10.428497 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.428469 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-dpz79"] May 29 10:18:10.493045 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.493011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-config-file\") pod \"limitador-limitador-7d549b5b-dpz79\" (UID: \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:10.493226 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.493059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sgvt\" (UniqueName: \"kubernetes.io/projected/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-kube-api-access-7sgvt\") pod \"limitador-limitador-7d549b5b-dpz79\" (UID: \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:10.512068 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.512037 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-dpz79"] May 29 10:18:10.594526 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.594491 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-config-file\") pod \"limitador-limitador-7d549b5b-dpz79\" (UID: \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:10.594733 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.594545 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgvt\" (UniqueName: \"kubernetes.io/projected/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-kube-api-access-7sgvt\") pod \"limitador-limitador-7d549b5b-dpz79\" (UID: \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:10.595225 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.595198 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-config-file\") pod \"limitador-limitador-7d549b5b-dpz79\" (UID: \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:10.603034 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.603011 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sgvt\" (UniqueName: \"kubernetes.io/projected/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-kube-api-access-7sgvt\") pod \"limitador-limitador-7d549b5b-dpz79\" (UID: \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:10.730759 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.730672 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:10.870899 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.870868 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:18:10.876169 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.876139 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:10.883931 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.883891 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:18:10.897502 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.897467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l59xn\" (UniqueName: \"kubernetes.io/projected/d9ea83fc-a214-4c07-8bc7-1bb445c200cf-kube-api-access-l59xn\") pod \"limitador-limitador-78c99df468-j75jg\" (UID: \"d9ea83fc-a214-4c07-8bc7-1bb445c200cf\") " pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:10.897660 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.897595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9ea83fc-a214-4c07-8bc7-1bb445c200cf-config-file\") pod \"limitador-limitador-78c99df468-j75jg\" (UID: \"d9ea83fc-a214-4c07-8bc7-1bb445c200cf\") " pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:10.909580 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.909547 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:18:10.912600 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.912577 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-dpz79"] May 29 10:18:10.915585 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:18:10.915548 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5deefe5f_ae99_4a4f_84bf_bb1e8016e22d.slice/crio-d0951ab93f5796aff559c512038169ac94530e3e1d179c1c02ffaf2dd84bf1f6 WatchSource:0}: Error finding container d0951ab93f5796aff559c512038169ac94530e3e1d179c1c02ffaf2dd84bf1f6: Status 404 returned error can't find the container with id d0951ab93f5796aff559c512038169ac94530e3e1d179c1c02ffaf2dd84bf1f6 May 29 10:18:10.998959 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.998863 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9ea83fc-a214-4c07-8bc7-1bb445c200cf-config-file\") pod \"limitador-limitador-78c99df468-j75jg\" (UID: \"d9ea83fc-a214-4c07-8bc7-1bb445c200cf\") " pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:10.999111 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.998982 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l59xn\" (UniqueName: \"kubernetes.io/projected/d9ea83fc-a214-4c07-8bc7-1bb445c200cf-kube-api-access-l59xn\") pod \"limitador-limitador-78c99df468-j75jg\" (UID: \"d9ea83fc-a214-4c07-8bc7-1bb445c200cf\") " pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:10.999623 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:10.999592 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9ea83fc-a214-4c07-8bc7-1bb445c200cf-config-file\") pod \"limitador-limitador-78c99df468-j75jg\" (UID: \"d9ea83fc-a214-4c07-8bc7-1bb445c200cf\") " pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:11.007603 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:11.007573 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l59xn\" (UniqueName: \"kubernetes.io/projected/d9ea83fc-a214-4c07-8bc7-1bb445c200cf-kube-api-access-l59xn\") pod \"limitador-limitador-78c99df468-j75jg\" (UID: \"d9ea83fc-a214-4c07-8bc7-1bb445c200cf\") " pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:11.190541 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:11.190502 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:11.236255 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:11.236221 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" event={"ID":"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d","Type":"ContainerStarted","Data":"d0951ab93f5796aff559c512038169ac94530e3e1d179c1c02ffaf2dd84bf1f6"} May 29 10:18:11.326007 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:11.325973 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:18:11.329359 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:18:11.329327 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ea83fc_a214_4c07_8bc7_1bb445c200cf.slice/crio-60d4087099ef5230f5f5a204120ece7cf956dc1c0c5f6300c791345afde0cb1f WatchSource:0}: Error finding container 60d4087099ef5230f5f5a204120ece7cf956dc1c0c5f6300c791345afde0cb1f: Status 404 returned error can't find the container with id 60d4087099ef5230f5f5a204120ece7cf956dc1c0c5f6300c791345afde0cb1f May 29 10:18:12.247607 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:12.247561 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" event={"ID":"d9ea83fc-a214-4c07-8bc7-1bb445c200cf","Type":"ContainerStarted","Data":"60d4087099ef5230f5f5a204120ece7cf956dc1c0c5f6300c791345afde0cb1f"} May 29 10:18:14.260786 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:14.260695 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" event={"ID":"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d","Type":"ContainerStarted","Data":"e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad"} May 29 10:18:14.261377 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:14.260806 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:14.262115 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:14.262088 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" event={"ID":"d9ea83fc-a214-4c07-8bc7-1bb445c200cf","Type":"ContainerStarted","Data":"36fd67e300996bc0433d7fff25555008dfe0106fcafcd01761ced332784d3d4f"} May 29 10:18:14.262271 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:14.262257 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:14.281078 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:14.281032 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" podStartSLOduration=1.293819196 podStartE2EDuration="4.281017677s" podCreationTimestamp="2026-05-29 10:18:10 +0000 UTC" firstStartedPulling="2026-05-29 10:18:10.917869246 +0000 UTC m=+612.550910379" lastFinishedPulling="2026-05-29 10:18:13.905067723 +0000 UTC m=+615.538108860" observedRunningTime="2026-05-29 10:18:14.279590722 +0000 UTC m=+615.912631877" watchObservedRunningTime="2026-05-29 10:18:14.281017677 +0000 UTC m=+615.914058831" May 29 10:18:14.299518 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:14.299463 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" podStartSLOduration=1.718089988 podStartE2EDuration="4.299448689s" podCreationTimestamp="2026-05-29 10:18:10 +0000 UTC" firstStartedPulling="2026-05-29 10:18:11.331068875 +0000 UTC m=+612.964110011" lastFinishedPulling="2026-05-29 10:18:13.912427558 +0000 UTC m=+615.545468712" observedRunningTime="2026-05-29 10:18:14.29750689 +0000 UTC m=+615.930548046" watchObservedRunningTime="2026-05-29 10:18:14.299448689 +0000 UTC m=+615.932489875" May 29 10:18:25.267293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:25.267260 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:25.267753 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:25.267314 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-j75jg" May 29 10:18:25.328271 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:25.328232 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-dpz79"] May 29 10:18:25.328472 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:25.328450 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" podUID="5deefe5f-ae99-4a4f-84bf-bb1e8016e22d" containerName="limitador" containerID="cri-o://e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad" gracePeriod=30 May 29 10:18:25.888775 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:25.888698 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:26.046615 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.046579 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sgvt\" (UniqueName: \"kubernetes.io/projected/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-kube-api-access-7sgvt\") pod \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\" (UID: \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\") " May 29 10:18:26.046793 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.046721 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-config-file\") pod \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\" (UID: \"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d\") " May 29 10:18:26.047134 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.047104 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-config-file" (OuterVolumeSpecName: "config-file") pod "5deefe5f-ae99-4a4f-84bf-bb1e8016e22d" (UID: "5deefe5f-ae99-4a4f-84bf-bb1e8016e22d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:18:26.048754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.048731 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-kube-api-access-7sgvt" (OuterVolumeSpecName: "kube-api-access-7sgvt") pod "5deefe5f-ae99-4a4f-84bf-bb1e8016e22d" (UID: "5deefe5f-ae99-4a4f-84bf-bb1e8016e22d"). InnerVolumeSpecName "kube-api-access-7sgvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:18:26.147897 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.147797 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-config-file\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:18:26.147897 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.147858 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sgvt\" (UniqueName: \"kubernetes.io/projected/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d-kube-api-access-7sgvt\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:18:26.304510 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.304473 2575 generic.go:358] "Generic (PLEG): container finished" podID="5deefe5f-ae99-4a4f-84bf-bb1e8016e22d" containerID="e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad" exitCode=0 May 29 10:18:26.304952 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.304527 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" event={"ID":"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d","Type":"ContainerDied","Data":"e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad"} May 29 10:18:26.304952 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.304557 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" event={"ID":"5deefe5f-ae99-4a4f-84bf-bb1e8016e22d","Type":"ContainerDied","Data":"d0951ab93f5796aff559c512038169ac94530e3e1d179c1c02ffaf2dd84bf1f6"} May 29 10:18:26.304952 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.304572 2575 scope.go:117] "RemoveContainer" containerID="e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad" May 29 10:18:26.304952 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.304531 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-dpz79" May 29 10:18:26.313444 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.313424 2575 scope.go:117] "RemoveContainer" containerID="e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad" May 29 10:18:26.313724 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:18:26.313699 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad\": container with ID starting with e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad not found: ID does not exist" containerID="e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad" May 29 10:18:26.313816 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.313731 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad"} err="failed to get container status \"e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad\": rpc error: code = NotFound desc = could not find container \"e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad\": container with ID starting with e303d16d1523ec013a03a7efe095a899ad6511aaca60fc03a9e6cf2a0b3b1dad not found: ID does not exist" May 29 10:18:26.325450 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.325421 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-dpz79"] May 29 10:18:26.331089 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.331062 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-dpz79"] May 29 10:18:26.408137 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.408057 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-77k59"] May 29 10:18:26.408649 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.408628 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5deefe5f-ae99-4a4f-84bf-bb1e8016e22d" containerName="limitador" May 29 10:18:26.408649 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.408650 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5deefe5f-ae99-4a4f-84bf-bb1e8016e22d" containerName="limitador" May 29 10:18:26.408851 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.408759 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="5deefe5f-ae99-4a4f-84bf-bb1e8016e22d" containerName="limitador" May 29 10:18:26.413292 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.413270 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:26.415480 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.415460 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 29 10:18:26.415592 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.415561 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sfbnk\"" May 29 10:18:26.420605 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.420559 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-77k59"] May 29 10:18:26.551443 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.551401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t54fz\" (UniqueName: \"kubernetes.io/projected/64a62e89-f6a8-4d1a-967b-cc316501933c-kube-api-access-t54fz\") pod \"postgres-68c4fbbd6f-77k59\" (UID: \"64a62e89-f6a8-4d1a-967b-cc316501933c\") " pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:26.551624 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.551524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/64a62e89-f6a8-4d1a-967b-cc316501933c-data\") pod \"postgres-68c4fbbd6f-77k59\" (UID: \"64a62e89-f6a8-4d1a-967b-cc316501933c\") " pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:26.652179 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.652141 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t54fz\" (UniqueName: \"kubernetes.io/projected/64a62e89-f6a8-4d1a-967b-cc316501933c-kube-api-access-t54fz\") pod \"postgres-68c4fbbd6f-77k59\" (UID: \"64a62e89-f6a8-4d1a-967b-cc316501933c\") " pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:26.652409 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.652201 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/64a62e89-f6a8-4d1a-967b-cc316501933c-data\") pod \"postgres-68c4fbbd6f-77k59\" (UID: \"64a62e89-f6a8-4d1a-967b-cc316501933c\") " pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:26.652561 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.652545 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/64a62e89-f6a8-4d1a-967b-cc316501933c-data\") pod \"postgres-68c4fbbd6f-77k59\" (UID: \"64a62e89-f6a8-4d1a-967b-cc316501933c\") " pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:26.660094 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.660023 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t54fz\" (UniqueName: \"kubernetes.io/projected/64a62e89-f6a8-4d1a-967b-cc316501933c-kube-api-access-t54fz\") pod \"postgres-68c4fbbd6f-77k59\" (UID: \"64a62e89-f6a8-4d1a-967b-cc316501933c\") " pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:26.726722 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.726674 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:26.856799 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:26.856772 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-77k59"] May 29 10:18:26.859164 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:18:26.859139 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a62e89_f6a8_4d1a_967b_cc316501933c.slice/crio-0f4b4fc36f1cda094800a827809e9a22bf9afb1115333da77bc5cf86dbda5d1e WatchSource:0}: Error finding container 0f4b4fc36f1cda094800a827809e9a22bf9afb1115333da77bc5cf86dbda5d1e: Status 404 returned error can't find the container with id 0f4b4fc36f1cda094800a827809e9a22bf9afb1115333da77bc5cf86dbda5d1e May 29 10:18:27.012176 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:27.012089 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5deefe5f-ae99-4a4f-84bf-bb1e8016e22d" path="/var/lib/kubelet/pods/5deefe5f-ae99-4a4f-84bf-bb1e8016e22d/volumes" May 29 10:18:27.308621 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:27.308583 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-77k59" event={"ID":"64a62e89-f6a8-4d1a-967b-cc316501933c","Type":"ContainerStarted","Data":"0f4b4fc36f1cda094800a827809e9a22bf9afb1115333da77bc5cf86dbda5d1e"} May 29 10:18:32.329648 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:32.329611 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-77k59" event={"ID":"64a62e89-f6a8-4d1a-967b-cc316501933c","Type":"ContainerStarted","Data":"68d0ed0d21c1010b8ab3a3598c7ae6fe641e81f09d5d3f67eae99bf93a3a8a74"} May 29 10:18:32.330119 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:32.329727 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:32.346052 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:32.346000 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-77k59" podStartSLOduration=1.362109558 podStartE2EDuration="6.345985228s" podCreationTimestamp="2026-05-29 10:18:26 +0000 UTC" firstStartedPulling="2026-05-29 10:18:26.860418454 +0000 UTC m=+628.493459588" lastFinishedPulling="2026-05-29 10:18:31.844294122 +0000 UTC m=+633.477335258" observedRunningTime="2026-05-29 10:18:32.344604694 +0000 UTC m=+633.977645850" watchObservedRunningTime="2026-05-29 10:18:32.345985228 +0000 UTC m=+633.979026384" May 29 10:18:38.362697 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:38.362653 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-77k59" May 29 10:18:43.816102 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:43.816063 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c6996d756-s6hcd"] May 29 10:18:43.857510 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:43.857474 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c6996d756-s6hcd"] May 29 10:18:43.857676 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:43.857617 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:43.859940 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:43.859916 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bmjxh\"" May 29 10:18:43.860074 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:43.859916 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 29 10:18:43.915349 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:43.915312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkbbz\" (UniqueName: \"kubernetes.io/projected/85e82945-25b2-4955-82ac-3516a149f486-kube-api-access-qkbbz\") pod \"maas-controller-c6996d756-s6hcd\" (UID: \"85e82945-25b2-4955-82ac-3516a149f486\") " pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:44.016266 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:44.016225 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkbbz\" (UniqueName: \"kubernetes.io/projected/85e82945-25b2-4955-82ac-3516a149f486-kube-api-access-qkbbz\") pod \"maas-controller-c6996d756-s6hcd\" (UID: \"85e82945-25b2-4955-82ac-3516a149f486\") " pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:44.023984 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:44.023950 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkbbz\" (UniqueName: \"kubernetes.io/projected/85e82945-25b2-4955-82ac-3516a149f486-kube-api-access-qkbbz\") pod \"maas-controller-c6996d756-s6hcd\" (UID: \"85e82945-25b2-4955-82ac-3516a149f486\") " pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:44.169150 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:44.169054 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:44.303383 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:44.303346 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c6996d756-s6hcd"] May 29 10:18:44.306584 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:18:44.306555 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e82945_25b2_4955_82ac_3516a149f486.slice/crio-226fbf80a08b39077a2e8aff100e0d3533f1e9b1194aab8c5c4c7838d8dc980b WatchSource:0}: Error finding container 226fbf80a08b39077a2e8aff100e0d3533f1e9b1194aab8c5c4c7838d8dc980b: Status 404 returned error can't find the container with id 226fbf80a08b39077a2e8aff100e0d3533f1e9b1194aab8c5c4c7838d8dc980b May 29 10:18:44.376732 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:44.376694 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6996d756-s6hcd" event={"ID":"85e82945-25b2-4955-82ac-3516a149f486","Type":"ContainerStarted","Data":"226fbf80a08b39077a2e8aff100e0d3533f1e9b1194aab8c5c4c7838d8dc980b"} May 29 10:18:47.390433 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:47.390399 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6996d756-s6hcd" event={"ID":"85e82945-25b2-4955-82ac-3516a149f486","Type":"ContainerStarted","Data":"40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624"} May 29 10:18:47.390882 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:47.390477 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:47.426342 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:47.426286 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-c6996d756-s6hcd" podStartSLOduration=1.888576034 podStartE2EDuration="4.426264004s" podCreationTimestamp="2026-05-29 10:18:43 +0000 UTC" firstStartedPulling="2026-05-29 10:18:44.307873738 +0000 UTC m=+645.940914873" lastFinishedPulling="2026-05-29 10:18:46.845561697 +0000 UTC m=+648.478602843" observedRunningTime="2026-05-29 10:18:47.424250448 +0000 UTC m=+649.057291601" watchObservedRunningTime="2026-05-29 10:18:47.426264004 +0000 UTC m=+649.059305158" May 29 10:18:58.399855 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:58.399799 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:58.652032 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:58.651937 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c6996d756-s6hcd"] May 29 10:18:58.652222 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:58.652178 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-c6996d756-s6hcd" podUID="85e82945-25b2-4955-82ac-3516a149f486" containerName="manager" containerID="cri-o://40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624" gracePeriod=30 May 29 10:18:58.901462 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:58.901433 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:58.960215 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:58.960133 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkbbz\" (UniqueName: \"kubernetes.io/projected/85e82945-25b2-4955-82ac-3516a149f486-kube-api-access-qkbbz\") pod \"85e82945-25b2-4955-82ac-3516a149f486\" (UID: \"85e82945-25b2-4955-82ac-3516a149f486\") " May 29 10:18:58.962604 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:58.962570 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e82945-25b2-4955-82ac-3516a149f486-kube-api-access-qkbbz" (OuterVolumeSpecName: "kube-api-access-qkbbz") pod "85e82945-25b2-4955-82ac-3516a149f486" (UID: "85e82945-25b2-4955-82ac-3516a149f486"). InnerVolumeSpecName "kube-api-access-qkbbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:18:59.061136 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.061101 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkbbz\" (UniqueName: \"kubernetes.io/projected/85e82945-25b2-4955-82ac-3516a149f486-kube-api-access-qkbbz\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:18:59.436713 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.436674 2575 generic.go:358] "Generic (PLEG): container finished" podID="85e82945-25b2-4955-82ac-3516a149f486" containerID="40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624" exitCode=0 May 29 10:18:59.437197 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.436734 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6996d756-s6hcd" May 29 10:18:59.437197 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.436733 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6996d756-s6hcd" event={"ID":"85e82945-25b2-4955-82ac-3516a149f486","Type":"ContainerDied","Data":"40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624"} May 29 10:18:59.437197 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.436880 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6996d756-s6hcd" event={"ID":"85e82945-25b2-4955-82ac-3516a149f486","Type":"ContainerDied","Data":"226fbf80a08b39077a2e8aff100e0d3533f1e9b1194aab8c5c4c7838d8dc980b"} May 29 10:18:59.437197 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.436912 2575 scope.go:117] "RemoveContainer" containerID="40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624" May 29 10:18:59.444740 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.444724 2575 scope.go:117] "RemoveContainer" containerID="40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624" May 29 10:18:59.445004 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:18:59.444985 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624\": container with ID starting with 40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624 not found: ID does not exist" containerID="40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624" May 29 10:18:59.445079 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.445016 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624"} err="failed to get container status \"40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624\": rpc error: code = NotFound desc = could not find container \"40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624\": container with ID starting with 40c88818d2567ea59a34d0e7142be39970c27e342f7213f3b28de579c342e624 not found: ID does not exist" May 29 10:18:59.454349 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.454162 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c6996d756-s6hcd"] May 29 10:18:59.456009 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:18:59.455989 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c6996d756-s6hcd"] May 29 10:19:01.012301 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:01.012268 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85e82945-25b2-4955-82ac-3516a149f486" path="/var/lib/kubelet/pods/85e82945-25b2-4955-82ac-3516a149f486/volumes" May 29 10:19:18.834426 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:18.834381 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:19:50.493212 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.493115 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86"] May 29 10:19:50.493900 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.493866 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e82945-25b2-4955-82ac-3516a149f486" containerName="manager" May 29 10:19:50.493900 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.493893 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e82945-25b2-4955-82ac-3516a149f486" containerName="manager" May 29 10:19:50.494073 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.494016 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="85e82945-25b2-4955-82ac-3516a149f486" containerName="manager" May 29 10:19:50.497471 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.497451 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.499434 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.499395 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 29 10:19:50.499963 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.499944 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pbcwq\"" May 29 10:19:50.500057 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.499954 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 29 10:19:50.500222 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.500196 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 29 10:19:50.507627 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.507591 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86"] May 29 10:19:50.564629 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.564590 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.564629 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.564645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.564935 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.564669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.564935 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.564753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnvtq\" (UniqueName: \"kubernetes.io/projected/6cc3d857-a837-4946-8091-a4718d417799-kube-api-access-cnvtq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.564935 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.564813 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cc3d857-a837-4946-8091-a4718d417799-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.564935 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.564892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.665893 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.665849 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.666089 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.665909 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.666089 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.665958 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnvtq\" (UniqueName: \"kubernetes.io/projected/6cc3d857-a837-4946-8091-a4718d417799-kube-api-access-cnvtq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.666089 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.666008 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cc3d857-a837-4946-8091-a4718d417799-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.666089 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.666043 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.666296 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.666123 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.666296 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.666214 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.666296 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.666266 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.666494 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.666474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.668754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.668410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cc3d857-a837-4946-8091-a4718d417799-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.668754 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.668657 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cc3d857-a837-4946-8091-a4718d417799-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.671357 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.671330 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55"] May 29 10:19:50.676204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.676184 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.679167 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.679144 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 29 10:19:50.679344 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.679320 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnvtq\" (UniqueName: \"kubernetes.io/projected/6cc3d857-a837-4946-8091-a4718d417799-kube-api-access-cnvtq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86\" (UID: \"6cc3d857-a837-4946-8091-a4718d417799\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.684532 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.684510 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55"] May 29 10:19:50.766708 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.766678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88ttw\" (UniqueName: \"kubernetes.io/projected/5d1b02db-2bf3-47cd-9f17-0908835759a1-kube-api-access-88ttw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.766883 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.766732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d1b02db-2bf3-47cd-9f17-0908835759a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.766931 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.766880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.766967 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.766927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.767038 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.766975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.767038 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.766991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.809807 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.809768 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:19:50.868359 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.868326 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d1b02db-2bf3-47cd-9f17-0908835759a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.868501 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.868385 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.868501 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.868412 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.868501 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.868441 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.868501 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.868457 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.868501 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.868498 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88ttw\" (UniqueName: \"kubernetes.io/projected/5d1b02db-2bf3-47cd-9f17-0908835759a1-kube-api-access-88ttw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.869218 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.869194 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.869338 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.869285 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.869564 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.869539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.873441 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.872103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d1b02db-2bf3-47cd-9f17-0908835759a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.873441 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.872360 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d1b02db-2bf3-47cd-9f17-0908835759a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.877244 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.877197 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88ttw\" (UniqueName: \"kubernetes.io/projected/5d1b02db-2bf3-47cd-9f17-0908835759a1-kube-api-access-88ttw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n8k55\" (UID: \"5d1b02db-2bf3-47cd-9f17-0908835759a1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:50.969686 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.969470 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86"] May 29 10:19:50.979268 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:19:50.979229 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc3d857_a837_4946_8091_a4718d417799.slice/crio-ef0c8a752f0b6acfbe94fb27872b612e4173ef71ef18b081f2623e7b44862f23 WatchSource:0}: Error finding container ef0c8a752f0b6acfbe94fb27872b612e4173ef71ef18b081f2623e7b44862f23: Status 404 returned error can't find the container with id ef0c8a752f0b6acfbe94fb27872b612e4173ef71ef18b081f2623e7b44862f23 May 29 10:19:51.000027 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:50.999996 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:19:51.141588 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:51.139966 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55"] May 29 10:19:51.142288 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:19:51.142249 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1b02db_2bf3_47cd_9f17_0908835759a1.slice/crio-bd7b4b91b4ef8a79d8c2cd513cde143f09dd6c43dd0a213e13b667d4958fcd72 WatchSource:0}: Error finding container bd7b4b91b4ef8a79d8c2cd513cde143f09dd6c43dd0a213e13b667d4958fcd72: Status 404 returned error can't find the container with id bd7b4b91b4ef8a79d8c2cd513cde143f09dd6c43dd0a213e13b667d4958fcd72 May 29 10:19:51.311226 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:51.311142 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:19:51.639081 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:51.638979 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" event={"ID":"5d1b02db-2bf3-47cd-9f17-0908835759a1","Type":"ContainerStarted","Data":"bd7b4b91b4ef8a79d8c2cd513cde143f09dd6c43dd0a213e13b667d4958fcd72"} May 29 10:19:51.640349 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:51.640319 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" event={"ID":"6cc3d857-a837-4946-8091-a4718d417799","Type":"ContainerStarted","Data":"ef0c8a752f0b6acfbe94fb27872b612e4173ef71ef18b081f2623e7b44862f23"} May 29 10:19:54.640442 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:54.640392 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:19:57.674895 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:57.674854 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" event={"ID":"5d1b02db-2bf3-47cd-9f17-0908835759a1","Type":"ContainerStarted","Data":"61931e569572ba8d37a8526ccf607784db0711b1558d81cc2016e6dfd9db3ad0"} May 29 10:19:57.676509 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:19:57.676476 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" event={"ID":"6cc3d857-a837-4946-8091-a4718d417799","Type":"ContainerStarted","Data":"8a12a0dc9aa6d48eb4ef2451ae1ee006b9c95cfcf6502ee0a34c5756ba5234d0"} May 29 10:20:01.893961 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:01.893899 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:20:03.704850 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:03.704735 2575 generic.go:358] "Generic (PLEG): container finished" podID="5d1b02db-2bf3-47cd-9f17-0908835759a1" containerID="61931e569572ba8d37a8526ccf607784db0711b1558d81cc2016e6dfd9db3ad0" exitCode=0 May 29 10:20:03.705284 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:03.704817 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" event={"ID":"5d1b02db-2bf3-47cd-9f17-0908835759a1","Type":"ContainerDied","Data":"61931e569572ba8d37a8526ccf607784db0711b1558d81cc2016e6dfd9db3ad0"} May 29 10:20:03.706371 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:03.706352 2575 generic.go:358] "Generic (PLEG): container finished" podID="6cc3d857-a837-4946-8091-a4718d417799" containerID="8a12a0dc9aa6d48eb4ef2451ae1ee006b9c95cfcf6502ee0a34c5756ba5234d0" exitCode=0 May 29 10:20:03.706455 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:03.706435 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" event={"ID":"6cc3d857-a837-4946-8091-a4718d417799","Type":"ContainerDied","Data":"8a12a0dc9aa6d48eb4ef2451ae1ee006b9c95cfcf6502ee0a34c5756ba5234d0"} May 29 10:20:05.716059 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:05.716018 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" event={"ID":"5d1b02db-2bf3-47cd-9f17-0908835759a1","Type":"ContainerStarted","Data":"d52366f1a85acc29fea5f7a00bc8f94e5f12238ef5d201a07714a1a5514b5d1c"} May 29 10:20:05.716556 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:05.716271 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:20:05.717688 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:05.717662 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" event={"ID":"6cc3d857-a837-4946-8091-a4718d417799","Type":"ContainerStarted","Data":"697060e7ebfb718eae9645fc9a091c14fc0d11fd7404fa904374c0e761cc0a89"} May 29 10:20:05.717881 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:05.717865 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:20:05.735016 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:05.734957 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" podStartSLOduration=1.777293038 podStartE2EDuration="15.734939339s" podCreationTimestamp="2026-05-29 10:19:50 +0000 UTC" firstStartedPulling="2026-05-29 10:19:51.145031344 +0000 UTC m=+712.778072493" lastFinishedPulling="2026-05-29 10:20:05.10267765 +0000 UTC m=+726.735718794" observedRunningTime="2026-05-29 10:20:05.73312709 +0000 UTC m=+727.366168246" watchObservedRunningTime="2026-05-29 10:20:05.734939339 +0000 UTC m=+727.367980497" May 29 10:20:05.753293 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:05.753232 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" podStartSLOduration=1.6266757809999999 podStartE2EDuration="15.753213799s" podCreationTimestamp="2026-05-29 10:19:50 +0000 UTC" firstStartedPulling="2026-05-29 10:19:50.980556669 +0000 UTC m=+712.613597815" lastFinishedPulling="2026-05-29 10:20:05.107094683 +0000 UTC m=+726.740135833" observedRunningTime="2026-05-29 10:20:05.751535266 +0000 UTC m=+727.384576417" watchObservedRunningTime="2026-05-29 10:20:05.753213799 +0000 UTC m=+727.386254955" May 29 10:20:06.197540 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:06.197501 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:20:07.181418 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.181379 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc"] May 29 10:20:07.185490 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.185463 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.187662 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.187640 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 29 10:20:07.196400 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.196368 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc"] May 29 10:20:07.241365 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.241321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.241532 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.241420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.241532 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.241499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.241532 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.241524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.241660 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.241603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.241660 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.241627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wksck\" (UniqueName: \"kubernetes.io/projected/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-kube-api-access-wksck\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.342708 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.342669 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.342708 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.342707 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wksck\" (UniqueName: \"kubernetes.io/projected/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-kube-api-access-wksck\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.343065 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.342744 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.343065 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.342775 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.343065 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.342838 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.343065 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.342896 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.343259 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.343167 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.343295 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.343257 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.343339 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.343309 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.345175 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.345154 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.345362 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.345345 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.350901 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.350880 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wksck\" (UniqueName: \"kubernetes.io/projected/56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f-kube-api-access-wksck\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc\" (UID: \"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.499266 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.499170 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:07.640685 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.640655 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc"] May 29 10:20:07.642570 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:20:07.642545 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b7a3d7_fadb_43fd_8a9d_a80e7aaad70f.slice/crio-54d3b8aa72a498e1f30624dcaeaafd01bbb99934e98ed580aa36c8249d5bad4d WatchSource:0}: Error finding container 54d3b8aa72a498e1f30624dcaeaafd01bbb99934e98ed580aa36c8249d5bad4d: Status 404 returned error can't find the container with id 54d3b8aa72a498e1f30624dcaeaafd01bbb99934e98ed580aa36c8249d5bad4d May 29 10:20:07.728068 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.728035 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" event={"ID":"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f","Type":"ContainerStarted","Data":"6d661f465df057b86d06d62fd0c2916159ebf8e88478dd07f975027e0f3d1e5e"} May 29 10:20:07.728068 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:07.728076 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" event={"ID":"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f","Type":"ContainerStarted","Data":"54d3b8aa72a498e1f30624dcaeaafd01bbb99934e98ed580aa36c8249d5bad4d"} May 29 10:20:12.294119 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:12.294084 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:20:13.755066 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:13.754978 2575 generic.go:358] "Generic (PLEG): container finished" podID="56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f" containerID="6d661f465df057b86d06d62fd0c2916159ebf8e88478dd07f975027e0f3d1e5e" exitCode=0 May 29 10:20:13.755066 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:13.755017 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" event={"ID":"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f","Type":"ContainerDied","Data":"6d661f465df057b86d06d62fd0c2916159ebf8e88478dd07f975027e0f3d1e5e"} May 29 10:20:15.763291 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:15.763249 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" event={"ID":"56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f","Type":"ContainerStarted","Data":"f7e5d886d7eb22852c322c50c80b20b5f2a21742300eb98a4ef0edc44d795093"} May 29 10:20:15.763669 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:15.763495 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:20:15.782883 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:15.782812 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" podStartSLOduration=7.795657254 podStartE2EDuration="8.782799445s" podCreationTimestamp="2026-05-29 10:20:07 +0000 UTC" firstStartedPulling="2026-05-29 10:20:13.75567147 +0000 UTC m=+735.388712603" lastFinishedPulling="2026-05-29 10:20:14.742813656 +0000 UTC m=+736.375854794" observedRunningTime="2026-05-29 10:20:15.780979138 +0000 UTC m=+737.414020294" watchObservedRunningTime="2026-05-29 10:20:15.782799445 +0000 UTC m=+737.415840599" May 29 10:20:16.741397 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:16.741340 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86" May 29 10:20:16.745958 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:16.745928 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n8k55" May 29 10:20:26.779360 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:20:26.779324 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc" May 29 10:21:01.904659 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:21:01.904621 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:21:07.696644 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:21:07.696607 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:21:14.306100 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:21:14.306014 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:21:24.197277 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:21:24.197240 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:21:33.012297 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:21:33.012266 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:21:44.024472 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:21:44.024430 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:21:52.096621 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:21:52.096586 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:22:03.213340 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:03.213297 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:22:11.154673 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.154637 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-698d7fb568-lv7zv"] May 29 10:22:11.158931 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.158910 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698d7fb568-lv7zv" May 29 10:22:11.161361 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.161336 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 29 10:22:11.161593 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.161574 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bmjxh\"" May 29 10:22:11.171581 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.171551 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698d7fb568-lv7zv"] May 29 10:22:11.193153 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.193123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xwqv\" (UniqueName: \"kubernetes.io/projected/35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf-kube-api-access-5xwqv\") pod \"maas-controller-698d7fb568-lv7zv\" (UID: \"35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf\") " pod="opendatahub/maas-controller-698d7fb568-lv7zv" May 29 10:22:11.294164 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.294119 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xwqv\" (UniqueName: \"kubernetes.io/projected/35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf-kube-api-access-5xwqv\") pod \"maas-controller-698d7fb568-lv7zv\" (UID: \"35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf\") " pod="opendatahub/maas-controller-698d7fb568-lv7zv" May 29 10:22:11.306912 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.306886 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xwqv\" (UniqueName: \"kubernetes.io/projected/35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf-kube-api-access-5xwqv\") pod \"maas-controller-698d7fb568-lv7zv\" (UID: \"35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf\") " pod="opendatahub/maas-controller-698d7fb568-lv7zv" May 29 10:22:11.469383 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.469282 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698d7fb568-lv7zv" May 29 10:22:11.608602 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.608569 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698d7fb568-lv7zv"] May 29 10:22:11.610792 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:22:11.610765 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c45199_fa2e_48b0_9ca6_3dc9ebd0e9cf.slice/crio-66f20d88b7c94c4f33c1b146efeb8801b391a913df3e18186fb43121f1451569 WatchSource:0}: Error finding container 66f20d88b7c94c4f33c1b146efeb8801b391a913df3e18186fb43121f1451569: Status 404 returned error can't find the container with id 66f20d88b7c94c4f33c1b146efeb8801b391a913df3e18186fb43121f1451569 May 29 10:22:11.612081 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:11.612064 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 10:22:12.195994 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:12.195956 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698d7fb568-lv7zv" event={"ID":"35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf","Type":"ContainerStarted","Data":"aaa6cb4c1a8b7fc6eee8153edfc9664cadb574c2c9ccb1ceb3998eacac7452f1"} May 29 10:22:12.195994 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:12.196001 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698d7fb568-lv7zv" event={"ID":"35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf","Type":"ContainerStarted","Data":"66f20d88b7c94c4f33c1b146efeb8801b391a913df3e18186fb43121f1451569"} May 29 10:22:12.196397 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:12.196047 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-698d7fb568-lv7zv" May 29 10:22:12.217140 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:12.217091 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-698d7fb568-lv7zv" podStartSLOduration=0.727818495 podStartE2EDuration="1.217069745s" podCreationTimestamp="2026-05-29 10:22:11 +0000 UTC" firstStartedPulling="2026-05-29 10:22:11.612192616 +0000 UTC m=+853.245233763" lastFinishedPulling="2026-05-29 10:22:12.101443875 +0000 UTC m=+853.734485013" observedRunningTime="2026-05-29 10:22:12.215768014 +0000 UTC m=+853.848809170" watchObservedRunningTime="2026-05-29 10:22:12.217069745 +0000 UTC m=+853.850110900" May 29 10:22:23.205762 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:23.205722 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-698d7fb568-lv7zv" May 29 10:22:34.692760 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:34.692720 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:22:39.583227 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:39.583137 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:22:58.961140 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:58.961108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:22:58.961802 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:22:58.961779 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:23:15.287269 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:23:15.287231 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:23:30.792976 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:23:30.792928 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:24:09.310556 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:24:09.310472 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:24:25.187117 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:24:25.187082 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:24:40.195735 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:24:40.195692 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:24:57.489418 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:24:57.489376 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:25:53.589735 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:25:53.589655 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:26:02.197215 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:26:02.197180 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:26:19.294076 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:26:19.294029 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:26:27.485954 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:26:27.485916 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:26:44.189011 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:26:44.188973 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:26:52.592213 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:26:52.592172 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:27:25.079970 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:27:25.079876 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:27:34.387975 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:27:34.387933 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:27:42.686819 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:27:42.686768 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:27:51.097255 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:27:51.097216 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:27:58.990326 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:27:58.990296 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:27:58.992152 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:27:58.992130 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:27:59.895163 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:27:59.895127 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:28:16.615514 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:28:16.615470 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:28:26.791357 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:28:26.791318 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:29:14.601046 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:29:14.601007 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:29:20.284352 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:29:20.284311 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:29:26.890336 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:29:26.890298 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:29:35.082759 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:29:35.082716 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:29:44.932120 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:29:44.932082 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:29:51.687233 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:29:51.687193 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:30:00.486851 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:30:00.486790 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:30:06.888270 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:30:06.888225 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:30:12.590636 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:30:12.590543 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:30:19.096329 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:30:19.096288 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:30:27.688026 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:30:27.687989 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:30:37.182424 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:30:37.182385 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:30:44.683004 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:30:44.682957 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:30:53.586186 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:30:53.586148 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:31:02.388380 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:31:02.388333 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:31:11.312559 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:31:11.312518 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:31:19.279202 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:31:19.279163 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:31:28.295166 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:31:28.295132 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:31:36.689369 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:31:36.689331 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:32:28.500643 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:28.500607 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc"] May 29 10:32:28.501204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:28.500883 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" podUID="49f73270-3bac-4f6d-866a-ce91ba1b28a7" containerName="manager" containerID="cri-o://5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0" gracePeriod=10 May 29 10:32:28.858132 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:28.858106 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:32:28.971127 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:28.971086 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zsgr\" (UniqueName: \"kubernetes.io/projected/49f73270-3bac-4f6d-866a-ce91ba1b28a7-kube-api-access-9zsgr\") pod \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\" (UID: \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\") " May 29 10:32:28.971299 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:28.971197 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49f73270-3bac-4f6d-866a-ce91ba1b28a7-extensions-socket-volume\") pod \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\" (UID: \"49f73270-3bac-4f6d-866a-ce91ba1b28a7\") " May 29 10:32:28.971577 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:28.971550 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f73270-3bac-4f6d-866a-ce91ba1b28a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "49f73270-3bac-4f6d-866a-ce91ba1b28a7" (UID: "49f73270-3bac-4f6d-866a-ce91ba1b28a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:32:28.973439 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:28.973414 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49f73270-3bac-4f6d-866a-ce91ba1b28a7-kube-api-access-9zsgr" (OuterVolumeSpecName: "kube-api-access-9zsgr") pod "49f73270-3bac-4f6d-866a-ce91ba1b28a7" (UID: "49f73270-3bac-4f6d-866a-ce91ba1b28a7"). InnerVolumeSpecName "kube-api-access-9zsgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:32:29.072213 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.072172 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49f73270-3bac-4f6d-866a-ce91ba1b28a7-extensions-socket-volume\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:32:29.072213 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.072205 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zsgr\" (UniqueName: \"kubernetes.io/projected/49f73270-3bac-4f6d-866a-ce91ba1b28a7-kube-api-access-9zsgr\") on node \"ip-10-0-136-71.ec2.internal\" DevicePath \"\"" May 29 10:32:29.495966 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.495866 2575 generic.go:358] "Generic (PLEG): container finished" podID="49f73270-3bac-4f6d-866a-ce91ba1b28a7" containerID="5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0" exitCode=0 May 29 10:32:29.495966 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.495931 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" May 29 10:32:29.495966 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.495951 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" event={"ID":"49f73270-3bac-4f6d-866a-ce91ba1b28a7","Type":"ContainerDied","Data":"5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0"} May 29 10:32:29.496233 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.495987 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc" event={"ID":"49f73270-3bac-4f6d-866a-ce91ba1b28a7","Type":"ContainerDied","Data":"b3ea55347eed4d7c7c5635d196c71babf9ca13b9a7316d990a1ff6c285824a8f"} May 29 10:32:29.496233 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.496002 2575 scope.go:117] "RemoveContainer" containerID="5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0" May 29 10:32:29.505882 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.505721 2575 scope.go:117] "RemoveContainer" containerID="5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0" May 29 10:32:29.506097 ip-10-0-136-71 kubenswrapper[2575]: E0529 10:32:29.506029 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0\": container with ID starting with 5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0 not found: ID does not exist" containerID="5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0" May 29 10:32:29.506097 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.506057 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0"} err="failed to get container status \"5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0\": rpc error: code = NotFound desc = could not find container \"5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0\": container with ID starting with 5260642e78a9040915326ca913dfb5bf6a7db789db628300709103bbad3404b0 not found: ID does not exist" May 29 10:32:29.512342 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.512312 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc"] May 29 10:32:29.516484 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:29.516458 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bzfwc"] May 29 10:32:31.011784 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:31.011750 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49f73270-3bac-4f6d-866a-ce91ba1b28a7" path="/var/lib/kubelet/pods/49f73270-3bac-4f6d-866a-ce91ba1b28a7/volumes" May 29 10:32:59.024698 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:59.024668 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:32:59.026196 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:32:59.026174 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:33:34.573612 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.573576 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m"] May 29 10:33:34.574104 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.574008 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49f73270-3bac-4f6d-866a-ce91ba1b28a7" containerName="manager" May 29 10:33:34.574104 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.574019 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="49f73270-3bac-4f6d-866a-ce91ba1b28a7" containerName="manager" May 29 10:33:34.574104 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.574097 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="49f73270-3bac-4f6d-866a-ce91ba1b28a7" containerName="manager" May 29 10:33:34.577138 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.577121 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:34.579017 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.578999 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rm65w\"" May 29 10:33:34.585440 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.585415 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m"] May 29 10:33:34.609727 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.609693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58c90ac5-8ed6-4356-bc19-3e84741ea2d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hwd4m\" (UID: \"58c90ac5-8ed6-4356-bc19-3e84741ea2d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:34.609889 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.609735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q5fd\" (UniqueName: \"kubernetes.io/projected/58c90ac5-8ed6-4356-bc19-3e84741ea2d7-kube-api-access-2q5fd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hwd4m\" (UID: \"58c90ac5-8ed6-4356-bc19-3e84741ea2d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:34.711218 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.711165 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58c90ac5-8ed6-4356-bc19-3e84741ea2d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hwd4m\" (UID: \"58c90ac5-8ed6-4356-bc19-3e84741ea2d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:34.711218 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.711217 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q5fd\" (UniqueName: \"kubernetes.io/projected/58c90ac5-8ed6-4356-bc19-3e84741ea2d7-kube-api-access-2q5fd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hwd4m\" (UID: \"58c90ac5-8ed6-4356-bc19-3e84741ea2d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:34.711608 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.711583 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58c90ac5-8ed6-4356-bc19-3e84741ea2d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hwd4m\" (UID: \"58c90ac5-8ed6-4356-bc19-3e84741ea2d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:34.730229 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.730195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q5fd\" (UniqueName: \"kubernetes.io/projected/58c90ac5-8ed6-4356-bc19-3e84741ea2d7-kube-api-access-2q5fd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hwd4m\" (UID: \"58c90ac5-8ed6-4356-bc19-3e84741ea2d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:34.888513 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:34.888421 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:35.028745 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:35.028708 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m"] May 29 10:33:35.032136 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:33:35.032102 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c90ac5_8ed6_4356_bc19_3e84741ea2d7.slice/crio-a9414e877da6c5f9684e3afd0669ccceecd9645cf7c3a6f2e901cc796db9da99 WatchSource:0}: Error finding container a9414e877da6c5f9684e3afd0669ccceecd9645cf7c3a6f2e901cc796db9da99: Status 404 returned error can't find the container with id a9414e877da6c5f9684e3afd0669ccceecd9645cf7c3a6f2e901cc796db9da99 May 29 10:33:35.034536 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:35.034513 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 10:33:35.752999 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:35.752964 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" event={"ID":"58c90ac5-8ed6-4356-bc19-3e84741ea2d7","Type":"ContainerStarted","Data":"c9d3c13d3e6891f5e1dc27e32c06835cf222201b3645b2f1a17335655f2e7881"} May 29 10:33:35.752999 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:35.753001 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" event={"ID":"58c90ac5-8ed6-4356-bc19-3e84741ea2d7","Type":"ContainerStarted","Data":"a9414e877da6c5f9684e3afd0669ccceecd9645cf7c3a6f2e901cc796db9da99"} May 29 10:33:35.753447 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:35.753125 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:35.777942 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:35.777892 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" podStartSLOduration=1.7778784490000001 podStartE2EDuration="1.777878449s" podCreationTimestamp="2026-05-29 10:33:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:33:35.776745827 +0000 UTC m=+1537.409786983" watchObservedRunningTime="2026-05-29 10:33:35.777878449 +0000 UTC m=+1537.410919603" May 29 10:33:46.758983 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:46.758951 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hwd4m" May 29 10:33:55.477087 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:33:55.477045 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:34:00.582711 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:34:00.582662 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:34:25.887369 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:34:25.887331 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:34:32.882820 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:34:32.882784 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:34:41.984649 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:34:41.984540 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:34:51.884798 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:34:51.884765 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:35:01.183556 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:35:01.183523 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:35:12.077814 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:35:12.077774 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:35:20.188387 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:35:20.188349 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:35:31.385489 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:35:31.385449 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:35:40.285716 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:35:40.285661 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:35:50.787631 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:35:50.787591 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:35:58.684317 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:35:58.684276 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:36:04.486882 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:36:04.486837 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:36:32.589664 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:36:32.589579 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:37:16.177958 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:37:16.177922 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:37:23.994537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:37:23.994499 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:37:32.190766 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:37:32.190723 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:37:40.482322 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:37:40.482228 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:37:50.488183 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:37:50.488145 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:37:59.053621 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:37:59.053588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:37:59.056393 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:37:59.056370 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:37:59.986398 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:37:59.986359 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:38:09.983047 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:38:09.983003 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:38:16.001983 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:38:16.001948 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:38:25.090080 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:38:25.090041 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:38:34.188419 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:38:34.188383 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:38:42.188167 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:38:42.188126 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:38:52.790658 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:38:52.790613 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:39:10.386907 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:39:10.386808 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:39:18.988530 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:39:18.988493 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:39:28.084526 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:39:28.084488 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:39:35.684446 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:39:35.684407 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:39:52.912615 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:39:52.912577 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:40:00.995204 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:40:00.995157 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:40:10.395587 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:40:10.395543 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:40:19.264475 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:40:19.264438 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:40:27.085222 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:40:27.085173 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:40:35.616372 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:40:35.616327 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:40:44.987410 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:40:44.987370 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:40:57.900121 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:40:57.900064 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:41:07.385965 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:41:07.385924 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:41:20.782363 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:41:20.782324 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:41:29.005947 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:41:29.005910 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:41:36.393074 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:41:36.393032 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:41:45.192461 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:41:45.192419 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:41:51.085473 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:41:51.085437 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:41:56.000730 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:41:56.000693 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:42:10.382251 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:42:10.382164 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:42:19.084537 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:42:19.084499 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:42:27.781648 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:42:27.781603 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:42:37.480092 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:42:37.480049 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:42:59.083980 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:42:59.083944 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:42:59.086433 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:42:59.086408 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:43:02.287915 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:02.287876 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:43:15.286098 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:15.286061 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j75jg"] May 29 10:43:22.393286 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:22.393242 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-4nfxm_478430c9-880d-466b-ad2a-ac6edc3e2c38/manager/0.log" May 29 10:43:22.646896 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:22.646794 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-698d7fb568-lv7zv_35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf/manager/0.log" May 29 10:43:22.768555 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:22.768512 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tbx77_82df93d8-cc2b-4f7b-9246-7cdf6b410645/manager/1.log" May 29 10:43:23.011381 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:23.011289 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5569bfcb9-9qvp2_6bfb4e98-4dfb-4343-9a30-15127407e730/manager/0.log" May 29 10:43:23.244531 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:23.244501 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-77k59_64a62e89-f6a8-4d1a-967b-cc316501933c/postgres/0.log" May 29 10:43:24.607351 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:24.607309 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-59g7n_39f6c830-fd64-41bd-869f-99c65bf3b56b/manager/0.log" May 29 10:43:24.714792 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:24.714758 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-bklkq_9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f/manager/0.log" May 29 10:43:24.940572 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:24.940481 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-42cbm_a7384ebc-2828-4ed2-9140-5b783166762b/registry-server/0.log" May 29 10:43:25.054850 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:25.054799 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-hwd4m_58c90ac5-8ed6-4356-bc19-3e84741ea2d7/manager/0.log" May 29 10:43:25.175984 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:25.175954 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-j75jg_d9ea83fc-a214-4c07-8bc7-1bb445c200cf/limitador/0.log" May 29 10:43:25.633815 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:25.633787 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b4j26c_042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9/istio-proxy/0.log" May 29 10:43:25.985040 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:25.984959 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b76bb456-wklws_a931e694-1154-4ffa-ab0f-7c647f9ea785/kube-auth-proxy/0.log" May 29 10:43:26.103757 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:26.103733 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-mfgp4_562d5be3-666a-49d1-abe8-f33955d22168/istio-proxy/0.log" May 29 10:43:26.680493 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:26.680462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86_6cc3d857-a837-4946-8091-a4718d417799/main/0.log" May 29 10:43:26.686932 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:26.686909 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-zjm86_6cc3d857-a837-4946-8091-a4718d417799/storage-initializer/0.log" May 29 10:43:26.795490 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:26.795463 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc_56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f/storage-initializer/0.log" May 29 10:43:26.801491 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:26.801469 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-z44qc_56b7a3d7-fadb-43fd-8a9d-a80e7aaad70f/main/0.log" May 29 10:43:26.907194 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:26.907165 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-n8k55_5d1b02db-2bf3-47cd-9f17-0908835759a1/storage-initializer/0.log" May 29 10:43:26.916367 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:26.916341 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-n8k55_5d1b02db-2bf3-47cd-9f17-0908835759a1/main/0.log" May 29 10:43:34.170774 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:34.170740 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hk7nq_41fde825-3bee-419f-8c77-b89b667c2148/global-pull-secret-syncer/0.log" May 29 10:43:34.320884 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:34.320848 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t4tvr_ee4f8337-3c9e-43a0-bb2d-2094b6545e4f/konnectivity-agent/0.log" May 29 10:43:34.360265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:34.360235 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-71.ec2.internal_a7e4a7adf99a1fd4c9ab0a27defd1d89/haproxy/0.log" May 29 10:43:38.772998 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:38.772916 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-59g7n_39f6c830-fd64-41bd-869f-99c65bf3b56b/manager/0.log" May 29 10:43:38.793738 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:38.793711 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-bklkq_9c198a7b-8e94-4c3b-bd21-41fa2b7dde7f/manager/0.log" May 29 10:43:38.859118 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:38.859086 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-42cbm_a7384ebc-2828-4ed2-9140-5b783166762b/registry-server/0.log" May 29 10:43:38.915849 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:38.915792 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-hwd4m_58c90ac5-8ed6-4356-bc19-3e84741ea2d7/manager/0.log" May 29 10:43:38.940064 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:38.940029 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-j75jg_d9ea83fc-a214-4c07-8bc7-1bb445c200cf/limitador/0.log" May 29 10:43:40.919960 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:40.919884 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-lvpcp_6405c877-ede8-46fb-91c6-229696f2bcf5/kube-state-metrics/0.log" May 29 10:43:40.939050 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:40.939017 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-lvpcp_6405c877-ede8-46fb-91c6-229696f2bcf5/kube-rbac-proxy-main/0.log" May 29 10:43:40.957497 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:40.957466 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-lvpcp_6405c877-ede8-46fb-91c6-229696f2bcf5/kube-rbac-proxy-self/0.log" May 29 10:43:40.981177 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:40.981148 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-699b487f85-tcn66_65b4ceb3-9b98-4a46-9888-f82141a2647d/metrics-server/0.log" May 29 10:43:41.274601 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.274572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scsx8_ef88541a-f86a-418f-8d4b-f00f34a3325a/node-exporter/0.log" May 29 10:43:41.293734 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.293702 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scsx8_ef88541a-f86a-418f-8d4b-f00f34a3325a/kube-rbac-proxy/0.log" May 29 10:43:41.324104 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.324078 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scsx8_ef88541a-f86a-418f-8d4b-f00f34a3325a/init-textfile/0.log" May 29 10:43:41.350102 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.350077 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ft42h_c994964f-15d7-4002-ae53-3ba077d06a33/kube-rbac-proxy-main/0.log" May 29 10:43:41.368957 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.368933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ft42h_c994964f-15d7-4002-ae53-3ba077d06a33/kube-rbac-proxy-self/0.log" May 29 10:43:41.387412 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.387384 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ft42h_c994964f-15d7-4002-ae53-3ba077d06a33/openshift-state-metrics/0.log" May 29 10:43:41.422930 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.422902 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9912973-1da0-42e4-aa18-bdb72f1218e6/prometheus/0.log" May 29 10:43:41.442764 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.442737 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9912973-1da0-42e4-aa18-bdb72f1218e6/config-reloader/0.log" May 29 10:43:41.461883 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.461853 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9912973-1da0-42e4-aa18-bdb72f1218e6/thanos-sidecar/0.log" May 29 10:43:41.487586 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.487557 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9912973-1da0-42e4-aa18-bdb72f1218e6/kube-rbac-proxy-web/0.log" May 29 10:43:41.506529 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.506501 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9912973-1da0-42e4-aa18-bdb72f1218e6/kube-rbac-proxy/0.log" May 29 10:43:41.525927 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.525817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9912973-1da0-42e4-aa18-bdb72f1218e6/kube-rbac-proxy-thanos/0.log" May 29 10:43:41.545263 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.545240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9912973-1da0-42e4-aa18-bdb72f1218e6/init-config-reloader/0.log" May 29 10:43:41.619655 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.619629 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-d4pcm_7127f5cd-245a-4a9e-a1fb-f322c89306b7/prometheus-operator-admission-webhook/0.log" May 29 10:43:41.734011 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.733984 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69767476ff-w86nb_0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50/thanos-query/0.log" May 29 10:43:41.755870 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.755819 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69767476ff-w86nb_0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50/kube-rbac-proxy-web/0.log" May 29 10:43:41.776186 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.776110 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69767476ff-w86nb_0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50/kube-rbac-proxy/0.log" May 29 10:43:41.795220 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.795188 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69767476ff-w86nb_0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50/prom-label-proxy/0.log" May 29 10:43:41.814370 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.814341 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69767476ff-w86nb_0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50/kube-rbac-proxy-rules/0.log" May 29 10:43:41.833477 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:41.833450 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69767476ff-w86nb_0ebd81a5-aa3e-4bf7-9351-d3acc5bb2d50/kube-rbac-proxy-metrics/0.log" May 29 10:43:42.977301 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:42.977265 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn"] May 29 10:43:42.980103 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:42.980076 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:42.982051 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:42.982026 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49m8t\"/\"kube-root-ca.crt\"" May 29 10:43:42.982171 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:42.982062 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49m8t\"/\"openshift-service-ca.crt\"" May 29 10:43:42.982585 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:42.982565 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-49m8t\"/\"default-dockercfg-m7j75\"" May 29 10:43:42.988484 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:42.988459 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn"] May 29 10:43:43.099460 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.099423 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-lib-modules\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.099669 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.099491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fd5r\" (UniqueName: \"kubernetes.io/projected/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-kube-api-access-2fd5r\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.099669 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.099578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-sys\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.099669 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.099605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-proc\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.099879 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.099803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-podres\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201025 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.200985 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-lib-modules\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201228 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.201058 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fd5r\" (UniqueName: \"kubernetes.io/projected/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-kube-api-access-2fd5r\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201228 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.201117 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-sys\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201228 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.201139 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-proc\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201228 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.201170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-lib-modules\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201228 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.201215 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-podres\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201467 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.201245 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-proc\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201467 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.201264 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-sys\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.201467 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.201361 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-podres\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.207973 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.207945 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fd5r\" (UniqueName: \"kubernetes.io/projected/c3412f1d-7f1e-4f25-97c9-6bbe986205e7-kube-api-access-2fd5r\") pod \"perf-node-gather-daemonset-s2ldn\" (UID: \"c3412f1d-7f1e-4f25-97c9-6bbe986205e7\") " pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.292120 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.292064 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:43.457946 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.457919 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn"] May 29 10:43:43.459942 ip-10-0-136-71 kubenswrapper[2575]: W0529 10:43:43.459909 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3412f1d_7f1e_4f25_97c9_6bbe986205e7.slice/crio-6aea9c6edf159780e2be5f398280047d37e14545428258fc24286a7f689844c4 WatchSource:0}: Error finding container 6aea9c6edf159780e2be5f398280047d37e14545428258fc24286a7f689844c4: Status 404 returned error can't find the container with id 6aea9c6edf159780e2be5f398280047d37e14545428258fc24286a7f689844c4 May 29 10:43:43.461711 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.461691 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 10:43:43.878936 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:43.878906 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-qzmrm_adb98195-4ca3-420e-b000-4241dd6934bb/download-server/0.log" May 29 10:43:44.075309 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:44.075266 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" event={"ID":"c3412f1d-7f1e-4f25-97c9-6bbe986205e7","Type":"ContainerStarted","Data":"b3860532dc886fd8e375ac825e40344b9a9e7af50361418c07c6b83734a0a7fa"} May 29 10:43:44.075309 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:44.075304 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" event={"ID":"c3412f1d-7f1e-4f25-97c9-6bbe986205e7","Type":"ContainerStarted","Data":"6aea9c6edf159780e2be5f398280047d37e14545428258fc24286a7f689844c4"} May 29 10:43:44.075745 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:44.075396 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:44.090765 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:44.090709 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" podStartSLOduration=2.090693276 podStartE2EDuration="2.090693276s" podCreationTimestamp="2026-05-29 10:43:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:43:44.089454106 +0000 UTC m=+2145.722495274" watchObservedRunningTime="2026-05-29 10:43:44.090693276 +0000 UTC m=+2145.723734430" May 29 10:43:45.191620 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:45.191589 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tgw6k_52ee49d5-2c65-4f14-8f87-532905395c93/dns/0.log" May 29 10:43:45.209150 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:45.209124 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tgw6k_52ee49d5-2c65-4f14-8f87-532905395c93/kube-rbac-proxy/0.log" May 29 10:43:45.228774 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:45.228751 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8tlwz_6667d0fa-d378-45d0-955f-8aa8f9fe328a/dns-node-resolver/0.log" May 29 10:43:45.820509 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:45.820457 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75b69bbb74-wd7zp_7cca78f8-3a02-40a6-8923-3079d11740e2/registry/0.log" May 29 10:43:45.866711 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:45.866680 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njxbt_39da41c1-61f6-4523-9e9a-8dd76b2cc723/node-ca/0.log" May 29 10:43:46.701047 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:46.701016 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b4j26c_042ad68c-39e8-45b0-9fa9-0fd4b2e51ce9/istio-proxy/0.log" May 29 10:43:46.823217 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:46.823181 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b76bb456-wklws_a931e694-1154-4ffa-ab0f-7c647f9ea785/kube-auth-proxy/0.log" May 29 10:43:46.879608 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:46.879573 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-mfgp4_562d5be3-666a-49d1-abe8-f33955d22168/istio-proxy/0.log" May 29 10:43:47.446905 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:47.446866 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6ns82_de5c0b31-fdf4-46a5-a840-861369481f5a/serve-healthcheck-canary/0.log" May 29 10:43:48.085239 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:48.085198 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ng7kp_0d570318-317d-4f5d-8431-9b6fc9f7d9a3/kube-rbac-proxy/0.log" May 29 10:43:48.104399 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:48.104373 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ng7kp_0d570318-317d-4f5d-8431-9b6fc9f7d9a3/exporter/0.log" May 29 10:43:48.123188 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:48.123164 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ng7kp_0d570318-317d-4f5d-8431-9b6fc9f7d9a3/extractor/0.log" May 29 10:43:49.938127 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:49.938097 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-4nfxm_478430c9-880d-466b-ad2a-ac6edc3e2c38/manager/0.log" May 29 10:43:50.042177 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:50.042138 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-698d7fb568-lv7zv_35c45199-fa2e-48b0-9ca6-3dc9ebd0e9cf/manager/0.log" May 29 10:43:50.060265 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:50.060235 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tbx77_82df93d8-cc2b-4f7b-9246-7cdf6b410645/manager/0.log" May 29 10:43:50.071808 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:50.071779 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tbx77_82df93d8-cc2b-4f7b-9246-7cdf6b410645/manager/1.log" May 29 10:43:50.089194 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:50.089170 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-49m8t/perf-node-gather-daemonset-s2ldn" May 29 10:43:50.121968 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:50.121943 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5569bfcb9-9qvp2_6bfb4e98-4dfb-4343-9a30-15127407e730/manager/0.log" May 29 10:43:50.183816 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:50.183782 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-77k59_64a62e89-f6a8-4d1a-967b-cc316501933c/postgres/0.log" May 29 10:43:55.745691 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:55.745657 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-5cfzh_aa1523df-34df-46f6-ab5a-175945b369b4/migrator/0.log" May 29 10:43:55.763672 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:55.763637 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-5cfzh_aa1523df-34df-46f6-ab5a-175945b369b4/graceful-termination/0.log" May 29 10:43:57.264954 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.264924 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ks5bs_44666ece-c940-4772-a965-70e4879c1abf/kube-multus-additional-cni-plugins/0.log" May 29 10:43:57.287147 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.287116 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ks5bs_44666ece-c940-4772-a965-70e4879c1abf/egress-router-binary-copy/0.log" May 29 10:43:57.304737 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.304711 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ks5bs_44666ece-c940-4772-a965-70e4879c1abf/cni-plugins/0.log" May 29 10:43:57.322575 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.322547 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ks5bs_44666ece-c940-4772-a965-70e4879c1abf/bond-cni-plugin/0.log" May 29 10:43:57.341883 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.341856 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ks5bs_44666ece-c940-4772-a965-70e4879c1abf/routeoverride-cni/0.log" May 29 10:43:57.359695 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.359665 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ks5bs_44666ece-c940-4772-a965-70e4879c1abf/whereabouts-cni-bincopy/0.log" May 29 10:43:57.379865 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.379815 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ks5bs_44666ece-c940-4772-a965-70e4879c1abf/whereabouts-cni/0.log" May 29 10:43:57.550216 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.550188 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gjd7g_9301b3d6-a026-4f32-b887-c810341d8584/kube-multus/0.log" May 29 10:43:57.621780 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.621746 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b5znn_5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1/network-metrics-daemon/0.log" May 29 10:43:57.639470 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:57.639440 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b5znn_5d80a8a4-f4db-4e46-9dcd-a5ae8c17dbd1/kube-rbac-proxy/0.log" May 29 10:43:58.513660 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.513630 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-controller/0.log" May 29 10:43:58.529496 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.529462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/0.log" May 29 10:43:58.542446 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.542412 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovn-acl-logging/1.log" May 29 10:43:58.558958 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.558928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/kube-rbac-proxy-node/0.log" May 29 10:43:58.577239 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.577214 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/kube-rbac-proxy-ovn-metrics/0.log" May 29 10:43:58.593785 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.593754 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/northd/0.log" May 29 10:43:58.614184 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.614161 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/nbdb/0.log" May 29 10:43:58.633071 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.633043 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/sbdb/0.log" May 29 10:43:58.731200 ip-10-0-136-71 kubenswrapper[2575]: I0529 10:43:58.731170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7pz67_d72f875f-be72-4db9-ba73-68b9494491fc/ovnkube-controller/0.log"