Jun 15 15:03:55.398966 ip-10-0-139-197 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 15:03:55.398979 ip-10-0-139-197 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 15:03:55.398987 ip-10-0-139-197 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 15:03:55.399324 ip-10-0-139-197 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 15:04:05.555012 ip-10-0-139-197 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 15:04:05.555029 ip-10-0-139-197 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c65ccff095ff4faa8325230e96d7fa8f -- Jun 15 15:06:41.199616 ip-10-0-139-197 systemd[1]: Starting Kubernetes Kubelet... Jun 15 15:06:41.658532 ip-10-0-139-197 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 15:06:41.658532 ip-10-0-139-197 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 15:06:41.658532 ip-10-0-139-197 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 15:06:41.658532 ip-10-0-139-197 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 15:06:41.658532 ip-10-0-139-197 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 15:06:41.659690 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.659594 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 15:06:41.665047 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665021 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 15:06:41.665047 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665045 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665058 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665062 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665067 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665070 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665073 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665076 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665079 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665082 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665085 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665087 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665090 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665092 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665095 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665098 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665101 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665107 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665110 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665128 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 15:06:41.665147 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665130 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665133 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665135 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665138 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665141 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665143 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665146 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665148 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665151 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665154 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665157 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665160 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665163 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665165 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665168 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665170 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665173 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665176 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665178 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665180 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 15:06:41.665602 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665185 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665188 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665191 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665193 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665196 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665199 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665202 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665204 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665206 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665209 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665211 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665214 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665216 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665219 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665223 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665226 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665229 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665231 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665234 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665236 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 15:06:41.666164 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665239 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665241 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665243 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665246 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665248 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665251 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665254 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665256 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665258 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665261 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665264 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665267 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665269 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665272 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665274 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665277 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665280 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665283 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665285 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665288 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 15:06:41.666651 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665290 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665293 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665295 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665298 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665300 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665303 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665305 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665308 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665312 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665315 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665319 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665322 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665326 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665328 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665331 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665334 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665336 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665339 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.665341 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666230 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 15:06:41.667163 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666247 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666251 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666255 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666258 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666260 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666263 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666266 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666269 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666271 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666274 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666276 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666279 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666281 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666284 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666287 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666289 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666292 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666294 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666298 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666305 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 15:06:41.667684 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666308 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666311 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666314 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666318 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666321 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666324 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666327 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666330 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666332 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666335 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666337 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666340 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666346 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666349 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666352 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666355 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666358 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666360 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666363 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 15:06:41.668201 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666365 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666368 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666372 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666376 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666379 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666382 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666384 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666387 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666389 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666392 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666396 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666398 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666401 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666403 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666406 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666408 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666411 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666414 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666416 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 15:06:41.668673 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666419 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666422 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666426 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666428 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666431 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666433 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666436 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666440 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666442 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666445 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666447 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666450 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666453 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666455 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666458 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666461 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666463 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666465 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666468 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666470 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 15:06:41.669171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666473 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666475 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666479 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666483 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666486 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666489 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666492 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666495 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666499 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666501 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666504 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666507 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666510 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666512 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666515 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666517 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666520 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666523 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666526 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666529 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 15:06:41.669672 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666970 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666978 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666981 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666984 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666987 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666990 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666993 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666996 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.666999 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667001 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667004 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667008 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667012 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667014 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667017 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667019 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667022 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667025 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667028 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 15:06:41.670217 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667032 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667035 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667038 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667041 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667044 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667047 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667049 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667052 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667056 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667058 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667061 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667064 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667067 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667070 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667073 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667075 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667077 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667080 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667082 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667085 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 15:06:41.670676 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667087 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667090 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667092 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667096 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667099 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667102 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667105 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667107 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667110 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667132 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667135 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667139 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667141 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667144 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667147 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667149 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667153 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667156 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667158 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667161 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 15:06:41.671220 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667164 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667167 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667170 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667172 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667175 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667178 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667183 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667186 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667188 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667191 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667194 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667197 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667199 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667202 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667205 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667207 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667210 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667212 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667215 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667218 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 15:06:41.671754 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667220 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667223 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667225 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667228 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667231 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667233 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667237 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667239 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667242 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667245 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667248 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667253 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667255 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667258 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667261 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667263 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667266 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667268 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667272 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 15:06:41.672262 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.667276 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667359 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667368 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667375 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667380 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667384 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667388 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667392 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667397 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667400 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667404 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667407 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667410 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667413 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667416 2567 flags.go:64] FLAG: --cgroup-root="" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667419 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667422 2567 flags.go:64] FLAG: --client-ca-file="" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667425 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667428 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667433 2567 flags.go:64] FLAG: --cluster-domain="" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667436 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667439 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667443 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667446 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 15:06:41.672791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667452 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667455 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667458 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667462 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667465 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667468 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667471 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667476 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667479 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667484 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667487 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667490 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667493 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667496 2567 flags.go:64] FLAG: --enable-server="true" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667499 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667504 2567 flags.go:64] FLAG: --event-burst="100" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667507 2567 flags.go:64] FLAG: --event-qps="50" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667510 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667514 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667517 2567 flags.go:64] FLAG: --eviction-hard="" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667521 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667524 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667527 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667529 2567 flags.go:64] FLAG: --eviction-soft="" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667532 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 15:06:41.673427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667535 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667538 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667541 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667544 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667549 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667552 2567 flags.go:64] FLAG: --feature-gates="" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667559 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667563 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667567 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667570 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667573 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667576 2567 flags.go:64] FLAG: --help="false" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667579 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667583 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667586 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667589 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667592 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667596 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667599 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667602 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667604 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667607 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667611 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667613 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 15:06:41.674061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667616 2567 flags.go:64] FLAG: --kube-reserved="" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667619 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667622 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667625 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667627 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667630 2567 flags.go:64] FLAG: --lock-file="" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667633 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667636 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667639 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667644 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667648 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667651 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667655 2567 flags.go:64] FLAG: --logging-format="text" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667658 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667662 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667666 2567 flags.go:64] FLAG: --manifest-url="" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667669 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667674 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667677 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667681 2567 flags.go:64] FLAG: --max-pods="110" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667684 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667687 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667690 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667693 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667696 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 15:06:41.674708 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667700 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667705 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667713 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667716 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667719 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667722 2567 flags.go:64] FLAG: --pod-cidr="" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667725 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667731 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667734 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667737 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667740 2567 flags.go:64] FLAG: --port="10250" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667743 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667746 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-005ec43163c8a9ed2" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667749 2567 flags.go:64] FLAG: --qos-reserved="" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667752 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667755 2567 flags.go:64] FLAG: --register-node="true" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667758 2567 flags.go:64] FLAG: --register-with-taints="" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667761 2567 flags.go:64] FLAG: --registry-burst="10" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667764 2567 flags.go:64] FLAG: --registry-qps="5" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667768 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667771 2567 flags.go:64] FLAG: --reserved-memory="" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667775 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667778 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667783 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667786 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 15:06:41.675336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667788 2567 flags.go:64] FLAG: --runonce="false" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667791 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667794 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667797 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667800 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667803 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667806 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667809 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667812 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667815 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667818 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667821 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667824 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667827 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667830 2567 flags.go:64] FLAG: --system-cgroups="" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667833 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667838 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667841 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667844 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667847 2567 flags.go:64] FLAG: --tls-min-version="" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667850 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667853 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667856 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667859 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667862 2567 flags.go:64] FLAG: --v="2" Jun 15 15:06:41.675964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667866 2567 flags.go:64] FLAG: --version="false" Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667872 2567 flags.go:64] FLAG: --vmodule="" Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667876 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.667879 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668007 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668014 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668017 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668020 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668023 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668026 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668029 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668031 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668034 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668037 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668039 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668042 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668045 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668048 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668051 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668054 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 15:06:41.676620 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668056 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668059 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668062 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668064 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668067 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668069 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668072 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668075 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668077 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668080 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668082 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668084 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668087 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668090 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668093 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668095 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668098 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668101 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668104 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668106 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 15:06:41.677270 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668109 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668126 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668129 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668132 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668134 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668137 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668140 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668142 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668145 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668149 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668154 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668157 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668159 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668162 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668165 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668168 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668170 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668173 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668176 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 15:06:41.677768 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668178 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668181 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668183 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668186 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668188 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668191 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668195 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668197 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668200 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668203 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668207 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668210 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668212 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668215 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668217 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668220 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668222 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668225 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668228 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668230 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 15:06:41.678261 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668232 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668235 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668238 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668241 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668243 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668246 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668248 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668251 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668253 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668256 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668259 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668264 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668266 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668269 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668272 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668274 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668276 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668279 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668283 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 15:06:41.678808 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668285 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668288 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668290 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668294 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.668298 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.668307 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.675758 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.675908 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.676840 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.676854 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676939 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676946 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676951 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676954 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 15:06:41.679303 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676957 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676961 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676964 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676967 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676970 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676973 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676976 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676980 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676985 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676988 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676991 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676994 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676997 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.676999 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677002 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677004 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677007 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677010 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677013 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677015 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 15:06:41.679677 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677018 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677021 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677024 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677027 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677030 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677033 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677036 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677039 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677041 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677044 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677046 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677056 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677061 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677064 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677068 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677070 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677073 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677076 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677078 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677081 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 15:06:41.680191 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677083 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677086 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677089 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677091 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677094 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677096 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677099 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677102 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677105 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677108 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677111 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677131 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677135 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677139 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677143 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677146 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677148 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677151 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677153 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677156 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 15:06:41.680688 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677159 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677163 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677167 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677170 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677172 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677175 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677178 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677182 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677185 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677188 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677190 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677193 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677196 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677198 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677200 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677203 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677206 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677208 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677210 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 15:06:41.681227 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677213 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677216 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677219 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677222 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677225 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677227 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677230 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677233 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677236 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677241 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677244 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677247 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677250 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677252 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677255 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 15:06:41.681693 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677258 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.677264 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677393 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677399 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677402 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677405 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677409 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677412 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677415 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677418 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677420 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677424 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677426 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677429 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677432 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 15:06:41.682058 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677434 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677438 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677440 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677443 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677446 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677448 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677451 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677453 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677456 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677458 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677461 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677464 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677466 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677469 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677473 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677476 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677479 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677482 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677485 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 15:06:41.682527 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677487 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677490 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677492 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677495 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677497 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677500 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677503 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677505 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677508 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677510 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677512 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677515 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677517 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677520 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677522 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677525 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677528 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677530 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677533 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677535 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 15:06:41.682999 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677538 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677540 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677543 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677545 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677548 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677550 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677553 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677555 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677558 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677560 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677563 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677566 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677568 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677570 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677573 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677575 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677578 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677580 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677591 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677594 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 15:06:41.683591 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677597 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677600 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677603 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677605 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677608 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677611 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677613 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677615 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677619 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677621 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677624 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677627 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677630 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677632 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677635 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677638 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677640 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677643 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677645 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 15:06:41.684091 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677648 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677652 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677655 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677657 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677660 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677663 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677665 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:41.677668 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.677673 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.677815 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.680237 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.681634 2567 server.go:1019] "Starting client certificate rotation" Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.681752 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 15:06:41.684556 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.681791 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 15:06:41.687657 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.687632 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 15:06:41.691159 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.691129 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 15:06:41.705415 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.705373 2567 log.go:25] "Validated CRI v1 runtime API" Jun 15 15:06:41.711613 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.711591 2567 log.go:25] "Validated CRI v1 image API" Jun 15 15:06:41.713298 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.713276 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 15:06:41.716016 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.715993 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b8b71958-1a45-4ba6-a084-91169edc9710:/dev/nvme0n1p3 d08e7cc0-253f-4929-9e97-e59c998ad920:/dev/nvme0n1p4] Jun 15 15:06:41.716065 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.716017 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 15:06:41.722469 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.722444 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 15:06:41.722774 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.722654 2567 manager.go:216] Machine: {Timestamp:2026-06-15 15:06:41.721184371 +0000 UTC m=+0.380138073 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096278 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb4fcf85e0044ab22a270342bb1c6 SystemUUID:ec2fb4fc-f85e-0044-ab22-a270342bb1c6 BootID:c65ccff0-95ff-4faa-8325-230e96d7fa8f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:83:e1:67:51 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:83:e1:67:51 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:f2:bb:cb:87:5e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 15:06:41.722835 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.722776 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 15:06:41.722953 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.722939 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 15:06:41.724251 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.724224 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 15:06:41.724420 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.724254 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 15:06:41.725090 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.725075 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 15:06:41.725139 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.725094 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 15:06:41.725139 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.725104 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 15:06:41.725962 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.725948 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 15:06:41.727928 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.727909 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 15:06:41.731849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.731829 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 15 15:06:41.732040 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.732028 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 15:06:41.732079 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.732062 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 15 15:06:41.732079 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.732073 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 15:06:41.732155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.732106 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 15:06:41.732155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.732131 2567 kubelet.go:398] "Adding apiserver pod source" Jun 15 15:06:41.732155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.732152 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 15:06:41.732561 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.732548 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 15:06:41.732610 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.732569 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 15:06:41.736944 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.736915 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 15:06:41.738676 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.738661 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 15:06:41.738744 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.738692 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 15:06:41.738870 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.738860 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 15:06:41.738913 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.738876 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 15:06:41.738913 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.738882 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 15:06:41.738913 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.738887 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 15:06:41.738913 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.738895 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 15:06:41.738913 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.738900 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 15:06:41.739565 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.739555 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 15:06:41.739604 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.739567 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 15:06:41.739604 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.739574 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 15:06:41.739604 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.739579 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 15:06:41.739604 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.739589 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 15:06:41.739604 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.739597 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 15:06:41.740391 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.740376 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 15:06:41.740391 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.740388 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 15:06:41.742822 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.742794 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 15:06:41.743189 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.743164 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 15:06:41.743248 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.743170 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 15:06:41.743847 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.743828 2567 server.go:1268] "Started kubelet" Jun 15 15:06:41.743967 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.743915 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 15:06:41.744029 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.743931 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 15:06:41.744076 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.744036 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 15:06:41.744862 ip-10-0-139-197 systemd[1]: Started Kubernetes Kubelet. Jun 15 15:06:41.746314 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.746291 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 15:06:41.746803 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.746787 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 15 15:06:41.751077 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.748855 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-197.ec2.internal.18b9498dfa823b04 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-197.ec2.internal,UID:ip-10-0-139-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-197.ec2.internal,},FirstTimestamp:2026-06-15 15:06:41.743796996 +0000 UTC m=+0.402750686,LastTimestamp:2026-06-15 15:06:41.743796996 +0000 UTC m=+0.402750686,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-197.ec2.internal,}" Jun 15 15:06:41.751539 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.751517 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 15:06:41.751539 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.751522 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 15:06:41.751722 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.751699 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:41.752285 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.751922 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rmg58" Jun 15 15:06:41.752285 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.752190 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 15:06:41.752285 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.752197 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 15:06:41.752285 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.752213 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 15:06:41.752491 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.752356 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 15 15:06:41.752491 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.752366 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 15 15:06:41.752822 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.752806 2567 factory.go:55] Registering systemd factory Jun 15 15:06:41.752884 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.752826 2567 factory.go:223] Registration of the systemd container factory successfully Jun 15 15:06:41.753094 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.753075 2567 factory.go:153] Registering CRI-O factory Jun 15 15:06:41.753094 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.753092 2567 factory.go:223] Registration of the crio container factory successfully Jun 15 15:06:41.753279 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.753170 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 15:06:41.753279 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.753195 2567 factory.go:103] Registering Raw factory Jun 15 15:06:41.753279 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.753209 2567 manager.go:1196] Started watching for new ooms in manager Jun 15 15:06:41.753614 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.753598 2567 manager.go:349] Starting recovery of all containers Jun 15 15:06:41.757561 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.757406 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 15:06:41.759088 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.759060 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rmg58" Jun 15 15:06:41.763734 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.763706 2567 manager.go:354] Recovery completed Jun 15 15:06:41.766323 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.766213 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 15:06:41.766323 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.766297 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 15:06:41.771519 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.771503 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 15:06:41.778296 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.778273 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientMemory" Jun 15 15:06:41.778400 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.778311 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 15:06:41.778400 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.778321 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientPID" Jun 15 15:06:41.778926 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.778907 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 15:06:41.778926 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.778923 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 15:06:41.779152 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.778931 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 15:06:41.779152 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.778943 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 15 15:06:41.779690 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.779670 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientMemory" Jun 15 15:06:41.779761 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.779709 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 15:06:41.779761 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.779724 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientPID" Jun 15 15:06:41.780318 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.780301 2567 policy_none.go:49] "None policy: Start" Jun 15 15:06:41.780318 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.780320 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 15:06:41.780423 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.780332 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 15:06:41.782019 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.782003 2567 policy_none.go:47] "Start" Jun 15 15:06:41.821866 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.821843 2567 manager.go:337] "Starting Device Plugin manager" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.821946 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.821962 2567 server.go:87] "Starting device plugin registration server" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.822282 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.822294 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.822411 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.822510 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.822521 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.823546 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.823606 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.833278 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.834655 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.834695 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.834719 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.834808 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 15:06:41.863567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.836875 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 15:06:41.922512 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.922405 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 15:06:41.923682 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.923661 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientMemory" Jun 15 15:06:41.923784 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.923702 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 15:06:41.923784 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.923716 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientPID" Jun 15 15:06:41.923784 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.923741 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.931907 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.931876 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.932035 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.931918 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-197.ec2.internal\": node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:41.935529 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.935495 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal"] Jun 15 15:06:41.935641 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.935576 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 15:06:41.936490 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.936472 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientMemory" Jun 15 15:06:41.936564 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.936507 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 15:06:41.936564 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.936522 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientPID" Jun 15 15:06:41.937960 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.937945 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 15:06:41.938059 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.938041 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.938100 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.938077 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 15:06:41.938695 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.938680 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientMemory" Jun 15 15:06:41.938777 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.938720 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 15:06:41.938777 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.938730 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientPID" Jun 15 15:06:41.938777 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.938681 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientMemory" Jun 15 15:06:41.938891 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.938787 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 15:06:41.938891 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.938798 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientPID" Jun 15 15:06:41.941109 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.941088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.941199 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.941150 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 15:06:41.942084 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.942064 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientMemory" Jun 15 15:06:41.942247 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.942103 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 15:06:41.942247 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.942192 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeHasSufficientPID" Jun 15 15:06:41.947338 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.947315 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:41.953513 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.953484 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6012782c247ca02891cbfa75eade6f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal\" (UID: \"f6012782c247ca02891cbfa75eade6f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.953620 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.953519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6012782c247ca02891cbfa75eade6f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal\" (UID: \"f6012782c247ca02891cbfa75eade6f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.953620 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:41.953537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3142153b10a482aab63586672c9641f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-197.ec2.internal\" (UID: \"a3142153b10a482aab63586672c9641f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.965039 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.965003 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-197.ec2.internal\" not found" node="ip-10-0-139-197.ec2.internal" Jun 15 15:06:41.969887 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:41.969866 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-197.ec2.internal\" not found" node="ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.048362 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.048325 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.054291 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.054260 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6012782c247ca02891cbfa75eade6f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal\" (UID: \"f6012782c247ca02891cbfa75eade6f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.054434 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.054302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3142153b10a482aab63586672c9641f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-197.ec2.internal\" (UID: \"a3142153b10a482aab63586672c9641f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.054434 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.054327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6012782c247ca02891cbfa75eade6f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal\" (UID: \"f6012782c247ca02891cbfa75eade6f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.054434 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.054360 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6012782c247ca02891cbfa75eade6f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal\" (UID: \"f6012782c247ca02891cbfa75eade6f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.054434 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.054373 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3142153b10a482aab63586672c9641f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-197.ec2.internal\" (UID: \"a3142153b10a482aab63586672c9641f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.054434 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.054364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6012782c247ca02891cbfa75eade6f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal\" (UID: \"f6012782c247ca02891cbfa75eade6f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.149482 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.149438 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.250332 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.250261 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.267795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.267758 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.274465 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.274439 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" Jun 15 15:06:42.351178 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.351134 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.451671 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.451629 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.552213 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.552130 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.652705 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.652669 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.681043 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.681003 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 15:06:42.681717 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.681192 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 15:06:42.753228 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.753191 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.766198 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.766159 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 15:01:41 +0000 UTC" deadline="2028-03-22 06:49:20.336428562 +0000 UTC" Jun 15 15:06:42.766198 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.766191 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15495h42m37.570240488s" Jun 15 15:06:42.792291 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:42.792074 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3142153b10a482aab63586672c9641f.slice/crio-cdf6b098da94f1aa98e6f2ae4a03803a334c69a2e57c68fcd9f16549ed028e0b WatchSource:0}: Error finding container cdf6b098da94f1aa98e6f2ae4a03803a334c69a2e57c68fcd9f16549ed028e0b: Status 404 returned error can't find the container with id cdf6b098da94f1aa98e6f2ae4a03803a334c69a2e57c68fcd9f16549ed028e0b Jun 15 15:06:42.793211 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:42.793175 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6012782c247ca02891cbfa75eade6f7.slice/crio-28fba72f2b12792512931735308e8251c6908dc9a27dd8d7e803181f88a433f4 WatchSource:0}: Error finding container 28fba72f2b12792512931735308e8251c6908dc9a27dd8d7e803181f88a433f4: Status 404 returned error can't find the container with id 28fba72f2b12792512931735308e8251c6908dc9a27dd8d7e803181f88a433f4 Jun 15 15:06:42.797640 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.797619 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 15:06:42.838387 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.838263 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" event={"ID":"a3142153b10a482aab63586672c9641f","Type":"ContainerStarted","Data":"cdf6b098da94f1aa98e6f2ae4a03803a334c69a2e57c68fcd9f16549ed028e0b"} Jun 15 15:06:42.839832 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:42.839803 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" event={"ID":"f6012782c247ca02891cbfa75eade6f7","Type":"ContainerStarted","Data":"28fba72f2b12792512931735308e8251c6908dc9a27dd8d7e803181f88a433f4"} Jun 15 15:06:42.854134 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.854095 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:42.954585 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:42.954550 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:43.055103 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.055067 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:43.155675 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.155576 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:43.238483 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.238443 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 15:06:43.255697 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.255658 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-197.ec2.internal\" not found" Jun 15 15:06:43.264337 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.264299 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 15:06:43.278331 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.278289 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 15:06:43.352643 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.352607 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" Jun 15 15:06:43.368345 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.368307 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 15:06:43.369508 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.369482 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" Jun 15 15:06:43.398807 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.398773 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 15:06:43.732941 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.732895 2567 apiserver.go:52] "Watching apiserver" Jun 15 15:06:43.745611 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.745580 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 15:06:43.746038 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.746019 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pjnbp","kube-system/konnectivity-agent-vtb9c","openshift-cluster-node-tuning-operator/tuned-j5htj","openshift-dns/node-resolver-sdklf","openshift-image-registry/node-ca-szp6n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal","openshift-multus/network-metrics-daemon-98xgq","openshift-ovn-kubernetes/ovnkube-node-mvx64","kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f","openshift-multus/multus-additional-cni-plugins-z6mqx","openshift-multus/multus-mnm77","openshift-network-diagnostics/network-check-target-qmmfh","openshift-network-operator/iptables-alerter-7sphl"] Jun 15 15:06:43.747890 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.747862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.749441 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.749415 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:06:43.750573 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.750545 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-trm79\"" Jun 15 15:06:43.750692 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.750603 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 15:06:43.750759 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.750552 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 15:06:43.750847 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.750830 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:43.750942 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.750907 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:43.751973 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.751948 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.752317 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.752301 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 15:06:43.754142 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.754092 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 15:06:43.754246 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.754182 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gkrbr\"" Jun 15 15:06:43.754306 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.754274 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 15:06:43.754485 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.754190 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d9vb9\"" Jun 15 15:06:43.754485 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.754400 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 15:06:43.754485 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.754092 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 15:06:43.758595 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.758573 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.759147 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.759096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.759253 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.759176 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:06:43.760248 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.760223 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.760829 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.760804 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 15:06:43.760919 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.760873 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 15:06:43.761133 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.761096 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6lzkk\"" Jun 15 15:06:43.761203 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.761133 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 15:06:43.762234 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.762218 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.763852 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.763876 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lhwpm\"" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764057 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764102 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764110 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764135 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764198 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764501 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764664 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764759 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 15:06:43.764867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.764769 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 15:06:43.765513 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.765104 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xj84m\"" Jun 15 15:06:43.765947 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.765926 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 15:06:43.766107 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.766086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.766957 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.766912 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 15:06:43.767061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.766977 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 15:06:43.767061 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.766988 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 15:06:43.767175 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.767074 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 15:06:43.767305 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.767285 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-46fgn\"" Jun 15 15:06:43.767644 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.767626 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 15:06:43.768219 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:43.768300 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.768251 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:43.768300 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768065 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pdv82\"" Jun 15 15:06:43.768425 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.767896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h55gv\" (UniqueName: \"kubernetes.io/projected/357f8dc3-e0d7-4d84-9a0f-90306bada743-kube-api-access-h55gv\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.768425 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7fr4\" (UniqueName: \"kubernetes.io/projected/6d11743e-081e-4d7d-8cf1-674fec0019a8-kube-api-access-c7fr4\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:43.768521 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0833d8c-5be6-4af7-b8de-288f14458838-serviceca\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.768521 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-modprobe-d\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.768521 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysconfig\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.768521 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768505 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-sys\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.768721 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-lib-modules\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.768721 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357f8dc3-e0d7-4d84-9a0f-90306bada743-tmp\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.768721 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452-agent-certs\") pod \"konnectivity-agent-vtb9c\" (UID: \"79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452\") " pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:06:43.768721 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452-konnectivity-ca\") pod \"konnectivity-agent-vtb9c\" (UID: \"79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452\") " pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:06:43.768721 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9324414c-0a51-46e7-8345-0b7342d71197-hosts-file\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.768721 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-run\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.768721 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-host\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768730 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-tuned\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9324414c-0a51-46e7-8345-0b7342d71197-tmp-dir\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768777 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ztnd\" (UniqueName: \"kubernetes.io/projected/9324414c-0a51-46e7-8345-0b7342d71197-kube-api-access-4ztnd\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcmx8\" (UniqueName: \"kubernetes.io/projected/f0833d8c-5be6-4af7-b8de-288f14458838-kube-api-access-kcmx8\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768835 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-kubernetes\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysctl-d\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysctl-conf\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768927 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-systemd\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.768974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-var-lib-kubelet\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.769014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:43.769063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.769049 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 15:06:43.769629 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.769055 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0833d8c-5be6-4af7-b8de-288f14458838-host\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.771673 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.771641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.774096 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.774070 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 15:06:43.774447 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.774426 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 15:06:43.774741 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.774712 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gz5lp\"" Jun 15 15:06:43.774824 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.774798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 15:06:43.786548 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.786511 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-74mg2" Jun 15 15:06:43.793891 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.793860 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-74mg2" Jun 15 15:06:43.853540 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.853506 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 15:06:43.869549 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55gv\" (UniqueName: \"kubernetes.io/projected/357f8dc3-e0d7-4d84-9a0f-90306bada743-kube-api-access-h55gv\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.869549 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.869797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869578 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.869797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-socket-dir-parent\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.869797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9324414c-0a51-46e7-8345-0b7342d71197-hosts-file\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.869797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869653 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9324414c-0a51-46e7-8345-0b7342d71197-tmp-dir\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.869797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-kubelet-config\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.869797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.869797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-kubelet\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.869797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869764 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9324414c-0a51-46e7-8345-0b7342d71197-hosts-file\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-host\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84hj6\" (UniqueName: \"kubernetes.io/projected/5fbd580b-1344-49f8-839c-88de12e7176c-kube-api-access-84hj6\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-cni-bin\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-system-cni-dir\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-os-release\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-etc-kubernetes\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.869989 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysctl-conf\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-systemd\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-systemd-units\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-systemd\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870083 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9324414c-0a51-46e7-8345-0b7342d71197-tmp-dir\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae70438f-1f5e-4be5-b768-92b0386707fe-cni-binary-copy\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-cni-bin\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-cni-multus\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.870188 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0833d8c-5be6-4af7-b8de-288f14458838-serviceca\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870196 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-host\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676c7660-5867-49a0-b528-9cb9f0b0b3e6-host-slash\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-ovn\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-cni-netd\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870296 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-hostroot\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-multus-certs\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysctl-conf\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870344 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysconfig\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870389 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysconfig\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870382 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ztnd\" (UniqueName: \"kubernetes.io/projected/9324414c-0a51-46e7-8345-0b7342d71197-kube-api-access-4ztnd\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-kubelet\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-node-log\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovn-node-metrics-cert\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovnkube-script-lib\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.870985 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-run\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-sys-fs\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-etc-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-log-socket\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0833d8c-5be6-4af7-b8de-288f14458838-serviceca\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-systemd\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-system-cni-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870871 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-netns\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-socket-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-registration-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-run-netns\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.870974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-daemon-config\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-var-lib-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-modprobe-d\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-run\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-lib-modules\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357f8dc3-e0d7-4d84-9a0f-90306bada743-tmp\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.871849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452-agent-certs\") pod \"konnectivity-agent-vtb9c\" (UID: \"79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452\") " pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-lib-modules\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871256 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-modprobe-d\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-slash\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-os-release\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871512 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dl8\" (UniqueName: \"kubernetes.io/projected/676c7660-5867-49a0-b528-9cb9f0b0b3e6-kube-api-access-w7dl8\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871551 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-dbus\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-env-overrides\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-cni-binary-copy\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871645 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjxs\" (UniqueName: \"kubernetes.io/projected/ae70438f-1f5e-4be5-b768-92b0386707fe-kube-api-access-lmjxs\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7fr4\" (UniqueName: \"kubernetes.io/projected/6d11743e-081e-4d7d-8cf1-674fec0019a8-kube-api-access-c7fr4\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:43.872811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg5d6\" (UniqueName: \"kubernetes.io/projected/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-kube-api-access-qg5d6\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hsj6\" (UniqueName: \"kubernetes.io/projected/6fba54d3-7374-4b55-8f28-20c86dd68da3-kube-api-access-5hsj6\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871838 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-cnibin\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-sys\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871907 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452-konnectivity-ca\") pod \"konnectivity-agent-vtb9c\" (UID: \"79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452\") " pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.871935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/676c7660-5867-49a0-b528-9cb9f0b0b3e6-iptables-alerter-script\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-conf-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.872018 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-tuned\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-sys\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.872083 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:44.372061624 +0000 UTC m=+3.031015324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcmx8\" (UniqueName: \"kubernetes.io/projected/f0833d8c-5be6-4af7-b8de-288f14458838-kube-api-access-kcmx8\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-device-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452-konnectivity-ca\") pod \"konnectivity-agent-vtb9c\" (UID: \"79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452\") " pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovnkube-config\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-kubernetes\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872821 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysctl-d\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.873584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-var-lib-kubelet\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.874393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0833d8c-5be6-4af7-b8de-288f14458838-host\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.874393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-cnibin\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.874393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-cni-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.874393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.872950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-k8s-cni-cncf-io\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.874393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.873047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-sysctl-d\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.874393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.873098 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-var-lib-kubelet\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.874393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.873149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-kubernetes\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.874393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.873197 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0833d8c-5be6-4af7-b8de-288f14458838-host\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.875293 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.875266 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/357f8dc3-e0d7-4d84-9a0f-90306bada743-etc-tuned\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.875455 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.875320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357f8dc3-e0d7-4d84-9a0f-90306bada743-tmp\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.875647 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.875619 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452-agent-certs\") pod \"konnectivity-agent-vtb9c\" (UID: \"79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452\") " pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:06:43.877388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.877347 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h55gv\" (UniqueName: \"kubernetes.io/projected/357f8dc3-e0d7-4d84-9a0f-90306bada743-kube-api-access-h55gv\") pod \"tuned-j5htj\" (UID: \"357f8dc3-e0d7-4d84-9a0f-90306bada743\") " pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:43.878476 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.878452 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ztnd\" (UniqueName: \"kubernetes.io/projected/9324414c-0a51-46e7-8345-0b7342d71197-kube-api-access-4ztnd\") pod \"node-resolver-sdklf\" (UID: \"9324414c-0a51-46e7-8345-0b7342d71197\") " pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:43.880331 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.880306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7fr4\" (UniqueName: \"kubernetes.io/projected/6d11743e-081e-4d7d-8cf1-674fec0019a8-kube-api-access-c7fr4\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:43.880417 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.880359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcmx8\" (UniqueName: \"kubernetes.io/projected/f0833d8c-5be6-4af7-b8de-288f14458838-kube-api-access-kcmx8\") pod \"node-ca-szp6n\" (UID: \"f0833d8c-5be6-4af7-b8de-288f14458838\") " pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:43.973957 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.973920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-slash\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.973957 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.973966 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-os-release\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.973990 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974044 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dl8\" (UniqueName: \"kubernetes.io/projected/676c7660-5867-49a0-b528-9cb9f0b0b3e6-kube-api-access-w7dl8\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-dbus\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-env-overrides\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-cni-binary-copy\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjxs\" (UniqueName: \"kubernetes.io/projected/ae70438f-1f5e-4be5-b768-92b0386707fe-kube-api-access-lmjxs\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974213 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.974236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-os-release\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5d6\" (UniqueName: \"kubernetes.io/projected/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-kube-api-access-qg5d6\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hsj6\" (UniqueName: \"kubernetes.io/projected/6fba54d3-7374-4b55-8f28-20c86dd68da3-kube-api-access-5hsj6\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-cnibin\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/676c7660-5867-49a0-b528-9cb9f0b0b3e6-iptables-alerter-script\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974394 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-conf-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974417 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-device-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974463 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovnkube-config\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974472 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-device-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-cnibin\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974511 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-slash\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-cni-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-k8s-cni-cncf-io\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-socket-dir-parent\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.974697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-kubelet-config\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974679 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-kubelet\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84hj6\" (UniqueName: \"kubernetes.io/projected/5fbd580b-1344-49f8-839c-88de12e7176c-kube-api-access-84hj6\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974730 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-env-overrides\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-cni-bin\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-system-cni-dir\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-dbus\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974831 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-cni-binary-copy\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-os-release\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.974868 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974874 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-etc-kubernetes\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.974923 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret podName:a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d nodeName:}" failed. No retries permitted until 2026-06-15 15:06:44.47490499 +0000 UTC m=+3.133858685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret") pod "global-pull-secret-syncer-pjnbp" (UID: "a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d") : object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974941 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-etc-kubernetes\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.975537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975008 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-kubelet\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975009 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-os-release\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.974941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-systemd-units\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-systemd-units\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-systemd\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975185 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae70438f-1f5e-4be5-b768-92b0386707fe-cni-binary-copy\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975209 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-system-cni-dir\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975253 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-cni-bin\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975261 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-socket-dir-parent\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975302 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovnkube-config\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-cni-bin\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975349 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-systemd\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975303 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fba54d3-7374-4b55-8f28-20c86dd68da3-cnibin\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-cni-bin\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-kubelet-config\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-cni-multus\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975407 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-conf-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.976344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676c7660-5867-49a0-b528-9cb9f0b0b3e6-host-slash\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975439 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-cni-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-ovn\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975474 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-k8s-cni-cncf-io\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-cni-netd\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-cni-netd\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975482 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975528 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-cnibin\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975544 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-hostroot\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975549 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-hostroot\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-ovn\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/676c7660-5867-49a0-b528-9cb9f0b0b3e6-iptables-alerter-script\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-multus-certs\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975575 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-var-lib-cni-multus\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676c7660-5867-49a0-b528-9cb9f0b0b3e6-host-slash\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:43.977439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975629 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-multus-certs\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-kubelet\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975786 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975780 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-kubelet\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-node-log\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975838 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-run-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovn-node-metrics-cert\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae70438f-1f5e-4be5-b768-92b0386707fe-cni-binary-copy\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovnkube-script-lib\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-node-log\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-sys-fs\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-etc-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-sys-fs\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fba54d3-7374-4b55-8f28-20c86dd68da3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.975986 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-log-socket\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-etc-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-system-cni-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-netns\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.978266 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976068 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-system-cni-dir\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-socket-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae70438f-1f5e-4be5-b768-92b0386707fe-host-run-netns\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976028 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-log-socket\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-registration-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-run-netns\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976177 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-registration-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-daemon-config\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976203 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-host-run-netns\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976215 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fbd580b-1344-49f8-839c-88de12e7176c-socket-dir\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-var-lib-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-var-lib-openvswitch\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976356 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovnkube-script-lib\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.976602 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae70438f-1f5e-4be5-b768-92b0386707fe-multus-daemon-config\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.978863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.978710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-ovn-node-metrics-cert\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.981587 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.981560 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 15:06:43.981587 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.981588 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 15:06:43.981771 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.981604 2567 projected.go:196] Error preparing data for projected volume kube-api-access-r7dqx for pod openshift-network-diagnostics/network-check-target-qmmfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:43.981771 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:43.981676 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx podName:25f308e2-d55c-46df-854b-3d5cb3391a16 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:44.481653974 +0000 UTC m=+3.140607679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r7dqx" (UniqueName: "kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx") pod "network-check-target-qmmfh" (UID: "25f308e2-d55c-46df-854b-3d5cb3391a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:43.982571 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.982543 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dl8\" (UniqueName: \"kubernetes.io/projected/676c7660-5867-49a0-b528-9cb9f0b0b3e6-kube-api-access-w7dl8\") pod \"iptables-alerter-7sphl\" (UID: \"676c7660-5867-49a0-b528-9cb9f0b0b3e6\") " pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:43.982919 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.982896 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjxs\" (UniqueName: \"kubernetes.io/projected/ae70438f-1f5e-4be5-b768-92b0386707fe-kube-api-access-lmjxs\") pod \"multus-mnm77\" (UID: \"ae70438f-1f5e-4be5-b768-92b0386707fe\") " pod="openshift-multus/multus-mnm77" Jun 15 15:06:43.983192 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.983096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg5d6\" (UniqueName: \"kubernetes.io/projected/a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9-kube-api-access-qg5d6\") pod \"ovnkube-node-mvx64\" (UID: \"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:43.984445 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.984421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hsj6\" (UniqueName: \"kubernetes.io/projected/6fba54d3-7374-4b55-8f28-20c86dd68da3-kube-api-access-5hsj6\") pod \"multus-additional-cni-plugins-z6mqx\" (UID: \"6fba54d3-7374-4b55-8f28-20c86dd68da3\") " pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:43.984595 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:43.984569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84hj6\" (UniqueName: \"kubernetes.io/projected/5fbd580b-1344-49f8-839c-88de12e7176c-kube-api-access-84hj6\") pod \"aws-ebs-csi-driver-node-8v75f\" (UID: \"5fbd580b-1344-49f8-839c-88de12e7176c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:44.061604 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.061564 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j5htj" Jun 15 15:06:44.076977 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.076940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:06:44.085438 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.085184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sdklf" Jun 15 15:06:44.094394 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.094368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-szp6n" Jun 15 15:06:44.103657 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.103622 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:06:44.110052 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.110027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" Jun 15 15:06:44.117344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.117315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" Jun 15 15:06:44.126466 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.126432 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mnm77" Jun 15 15:06:44.134016 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.133992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7sphl" Jun 15 15:06:44.378957 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.378873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:44.379104 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.379059 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:44.379186 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.379158 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:45.37913739 +0000 UTC m=+4.038091087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:44.480135 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.480095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:44.480299 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.480246 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:44.480349 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.480325 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret podName:a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d nodeName:}" failed. No retries permitted until 2026-06-15 15:06:45.480304279 +0000 UTC m=+4.139257971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret") pod "global-pull-secret-syncer-pjnbp" (UID: "a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d") : object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:44.580826 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.580790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:44.581024 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.580945 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 15:06:44.581024 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.580972 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 15:06:44.581024 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.580995 2567 projected.go:196] Error preparing data for projected volume kube-api-access-r7dqx for pod openshift-network-diagnostics/network-check-target-qmmfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:44.581210 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.581058 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx podName:25f308e2-d55c-46df-854b-3d5cb3391a16 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:45.581038948 +0000 UTC m=+4.239992644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7dqx" (UniqueName: "kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx") pod "network-check-target-qmmfh" (UID: "25f308e2-d55c-46df-854b-3d5cb3391a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:44.673080 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.673059 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae70438f_1f5e_4be5_b768_92b0386707fe.slice/crio-3d80f6576aedc3b7ae144fdd4025a9a3a7f7416cea624cef9cf89267ee5d60ae WatchSource:0}: Error finding container 3d80f6576aedc3b7ae144fdd4025a9a3a7f7416cea624cef9cf89267ee5d60ae: Status 404 returned error can't find the container with id 3d80f6576aedc3b7ae144fdd4025a9a3a7f7416cea624cef9cf89267ee5d60ae Jun 15 15:06:44.674583 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.674555 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f6d2e9_7c20_4a2a_b0e9_9cc8b898d452.slice/crio-1831aae59ca43f53584b4b255034a5e24610b39fdfd6f290f5dcc6014a1ce176 WatchSource:0}: Error finding container 1831aae59ca43f53584b4b255034a5e24610b39fdfd6f290f5dcc6014a1ce176: Status 404 returned error can't find the container with id 1831aae59ca43f53584b4b255034a5e24610b39fdfd6f290f5dcc6014a1ce176 Jun 15 15:06:44.691317 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.691281 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357f8dc3_e0d7_4d84_9a0f_90306bada743.slice/crio-d59545554a30144722ef55f7f05dfe6c148c519624cc39604e1efa75e46c9319 WatchSource:0}: Error finding container d59545554a30144722ef55f7f05dfe6c148c519624cc39604e1efa75e46c9319: Status 404 returned error can't find the container with id d59545554a30144722ef55f7f05dfe6c148c519624cc39604e1efa75e46c9319 Jun 15 15:06:44.695318 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.695295 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fba54d3_7374_4b55_8f28_20c86dd68da3.slice/crio-ecbd4cf9f16c429de41c2f7f047d2c81f5596b6a499bdfecb6e87e27457e2c6b WatchSource:0}: Error finding container ecbd4cf9f16c429de41c2f7f047d2c81f5596b6a499bdfecb6e87e27457e2c6b: Status 404 returned error can't find the container with id ecbd4cf9f16c429de41c2f7f047d2c81f5596b6a499bdfecb6e87e27457e2c6b Jun 15 15:06:44.696233 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.696211 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676c7660_5867_49a0_b528_9cb9f0b0b3e6.slice/crio-641dedb6e5b5bf2b7bc4337b73fd9c0efd2f0e2968508ab2bb7f28e72158afde WatchSource:0}: Error finding container 641dedb6e5b5bf2b7bc4337b73fd9c0efd2f0e2968508ab2bb7f28e72158afde: Status 404 returned error can't find the container with id 641dedb6e5b5bf2b7bc4337b73fd9c0efd2f0e2968508ab2bb7f28e72158afde Jun 15 15:06:44.698003 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.697930 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9324414c_0a51_46e7_8345_0b7342d71197.slice/crio-ac7e61f5c1825f2fb87030854f2b5f273486653a4a2b828d6bb6b1d12964623a WatchSource:0}: Error finding container ac7e61f5c1825f2fb87030854f2b5f273486653a4a2b828d6bb6b1d12964623a: Status 404 returned error can't find the container with id ac7e61f5c1825f2fb87030854f2b5f273486653a4a2b828d6bb6b1d12964623a Jun 15 15:06:44.698848 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.698821 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37ee4ff_d563_4d2a_96a2_f8d9af0c81b9.slice/crio-625db98df16faf3bf488f17f3150882f1bfa1612e1668192b9d4702f804eb077 WatchSource:0}: Error finding container 625db98df16faf3bf488f17f3150882f1bfa1612e1668192b9d4702f804eb077: Status 404 returned error can't find the container with id 625db98df16faf3bf488f17f3150882f1bfa1612e1668192b9d4702f804eb077 Jun 15 15:06:44.700695 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.700515 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fbd580b_1344_49f8_839c_88de12e7176c.slice/crio-63ee42a18dbf2d0fd29aa88d00f69ec47386eeb94bd637eeada9df2d7e2c7620 WatchSource:0}: Error finding container 63ee42a18dbf2d0fd29aa88d00f69ec47386eeb94bd637eeada9df2d7e2c7620: Status 404 returned error can't find the container with id 63ee42a18dbf2d0fd29aa88d00f69ec47386eeb94bd637eeada9df2d7e2c7620 Jun 15 15:06:44.700761 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:06:44.700742 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0833d8c_5be6_4af7_b8de_288f14458838.slice/crio-3bfeedf25f61d4859011fcd5065bed3eb7ba8a5fd3b5c007a3d4641461ad4379 WatchSource:0}: Error finding container 3bfeedf25f61d4859011fcd5065bed3eb7ba8a5fd3b5c007a3d4641461ad4379: Status 404 returned error can't find the container with id 3bfeedf25f61d4859011fcd5065bed3eb7ba8a5fd3b5c007a3d4641461ad4379 Jun 15 15:06:44.795884 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.795845 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 15:01:43 +0000 UTC" deadline="2028-01-26 23:35:57.584537492 +0000 UTC" Jun 15 15:06:44.795884 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.795882 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14168h29m12.788659832s" Jun 15 15:06:44.835771 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.835741 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:44.835929 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:44.835849 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:44.848641 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.848599 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7sphl" event={"ID":"676c7660-5867-49a0-b528-9cb9f0b0b3e6","Type":"ContainerStarted","Data":"641dedb6e5b5bf2b7bc4337b73fd9c0efd2f0e2968508ab2bb7f28e72158afde"} Jun 15 15:06:44.850643 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.850612 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" event={"ID":"5fbd580b-1344-49f8-839c-88de12e7176c","Type":"ContainerStarted","Data":"63ee42a18dbf2d0fd29aa88d00f69ec47386eeb94bd637eeada9df2d7e2c7620"} Jun 15 15:06:44.852051 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.852025 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sdklf" event={"ID":"9324414c-0a51-46e7-8345-0b7342d71197","Type":"ContainerStarted","Data":"ac7e61f5c1825f2fb87030854f2b5f273486653a4a2b828d6bb6b1d12964623a"} Jun 15 15:06:44.855370 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.855343 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mnm77" event={"ID":"ae70438f-1f5e-4be5-b768-92b0386707fe","Type":"ContainerStarted","Data":"3d80f6576aedc3b7ae144fdd4025a9a3a7f7416cea624cef9cf89267ee5d60ae"} Jun 15 15:06:44.859654 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.859625 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" event={"ID":"a3142153b10a482aab63586672c9641f","Type":"ContainerStarted","Data":"cb3b42d2f16e1991c57faa9f6bf72bf153c69a5d73015071abce0297c29eb493"} Jun 15 15:06:44.863397 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.863363 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"625db98df16faf3bf488f17f3150882f1bfa1612e1668192b9d4702f804eb077"} Jun 15 15:06:44.865485 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.865455 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerStarted","Data":"ecbd4cf9f16c429de41c2f7f047d2c81f5596b6a499bdfecb6e87e27457e2c6b"} Jun 15 15:06:44.868259 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.868231 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j5htj" event={"ID":"357f8dc3-e0d7-4d84-9a0f-90306bada743","Type":"ContainerStarted","Data":"d59545554a30144722ef55f7f05dfe6c148c519624cc39604e1efa75e46c9319"} Jun 15 15:06:44.870033 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.870005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vtb9c" event={"ID":"79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452","Type":"ContainerStarted","Data":"1831aae59ca43f53584b4b255034a5e24610b39fdfd6f290f5dcc6014a1ce176"} Jun 15 15:06:44.871000 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:44.870977 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-szp6n" event={"ID":"f0833d8c-5be6-4af7-b8de-288f14458838","Type":"ContainerStarted","Data":"3bfeedf25f61d4859011fcd5065bed3eb7ba8a5fd3b5c007a3d4641461ad4379"} Jun 15 15:06:45.388558 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.388460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:45.388730 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.388649 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:45.388730 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.388720 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:47.388700064 +0000 UTC m=+6.047653748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:45.489147 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.489035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:45.489316 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.489254 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:45.489390 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.489317 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret podName:a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d nodeName:}" failed. No retries permitted until 2026-06-15 15:06:47.489299706 +0000 UTC m=+6.148253386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret") pod "global-pull-secret-syncer-pjnbp" (UID: "a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d") : object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:45.590610 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.589922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:45.590610 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.590144 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 15:06:45.590610 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.590170 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 15:06:45.590610 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.590184 2567 projected.go:196] Error preparing data for projected volume kube-api-access-r7dqx for pod openshift-network-diagnostics/network-check-target-qmmfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:45.590610 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.590247 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx podName:25f308e2-d55c-46df-854b-3d5cb3391a16 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:47.590228144 +0000 UTC m=+6.249181824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7dqx" (UniqueName: "kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx") pod "network-check-target-qmmfh" (UID: "25f308e2-d55c-46df-854b-3d5cb3391a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:45.796899 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.796773 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 15:01:43 +0000 UTC" deadline="2028-01-10 04:26:57.666204185 +0000 UTC" Jun 15 15:06:45.796899 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.796837 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13765h20m11.869370718s" Jun 15 15:06:45.835566 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.835530 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:45.835745 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.835583 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:45.835811 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.835738 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:45.836272 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:45.836200 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:06:45.885789 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.885747 2567 generic.go:356] "Generic (PLEG): container finished" podID="f6012782c247ca02891cbfa75eade6f7" containerID="f6cb4ebfb3809ef1c7a42a46b069030e9f6208bd2f52776535e9efa7cf5dca9a" exitCode=0 Jun 15 15:06:45.886911 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.886880 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" event={"ID":"f6012782c247ca02891cbfa75eade6f7","Type":"ContainerDied","Data":"f6cb4ebfb3809ef1c7a42a46b069030e9f6208bd2f52776535e9efa7cf5dca9a"} Jun 15 15:06:45.901368 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:45.901287 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-197.ec2.internal" podStartSLOduration=2.901266958 podStartE2EDuration="2.901266958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:06:44.874004658 +0000 UTC m=+3.532958357" watchObservedRunningTime="2026-06-15 15:06:45.901266958 +0000 UTC m=+4.560220661" Jun 15 15:06:46.835048 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:46.835018 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:46.835538 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:46.835170 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:46.899617 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:46.899575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" event={"ID":"f6012782c247ca02891cbfa75eade6f7","Type":"ContainerStarted","Data":"4cc62f0771dd353f8948587eb20a4224f6f47762bbb6d036b7cc9031fd179a9f"} Jun 15 15:06:46.915938 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:46.915868 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-197.ec2.internal" podStartSLOduration=3.915846597 podStartE2EDuration="3.915846597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:06:46.915794589 +0000 UTC m=+5.574748284" watchObservedRunningTime="2026-06-15 15:06:46.915846597 +0000 UTC m=+5.574800299" Jun 15 15:06:47.406095 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:47.405461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:47.406095 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.405675 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:47.406095 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.405742 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:51.405722928 +0000 UTC m=+10.064676610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:47.506704 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:47.506667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:47.506886 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.506817 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:47.506886 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.506875 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret podName:a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d nodeName:}" failed. No retries permitted until 2026-06-15 15:06:51.506862187 +0000 UTC m=+10.165815865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret") pod "global-pull-secret-syncer-pjnbp" (UID: "a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d") : object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:47.608310 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:47.607521 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:47.608310 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.607701 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 15:06:47.608310 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.607717 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 15:06:47.608310 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.607726 2567 projected.go:196] Error preparing data for projected volume kube-api-access-r7dqx for pod openshift-network-diagnostics/network-check-target-qmmfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:47.608310 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.607770 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx podName:25f308e2-d55c-46df-854b-3d5cb3391a16 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:51.607757163 +0000 UTC m=+10.266710841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7dqx" (UniqueName: "kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx") pod "network-check-target-qmmfh" (UID: "25f308e2-d55c-46df-854b-3d5cb3391a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:47.837401 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:47.837302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:47.837842 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.837433 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:47.837842 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:47.837730 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:47.837842 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:47.837805 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:06:48.835687 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:48.835644 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:48.835857 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:48.835776 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:49.837279 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:49.837241 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:49.837787 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:49.837376 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:06:49.837787 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:49.837507 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:49.837787 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:49.837591 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:50.835543 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:50.835504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:50.835729 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:50.835645 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:51.439812 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:51.439762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:51.440363 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.439920 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:51.440363 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.439986 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:59.439972018 +0000 UTC m=+18.098925701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:51.540849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:51.540803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:51.541061 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.540952 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:51.541061 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.541026 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret podName:a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d nodeName:}" failed. No retries permitted until 2026-06-15 15:06:59.541007618 +0000 UTC m=+18.199961297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret") pod "global-pull-secret-syncer-pjnbp" (UID: "a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d") : object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:51.641563 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:51.641522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:51.641839 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.641718 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 15:06:51.641839 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.641738 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 15:06:51.641839 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.641750 2567 projected.go:196] Error preparing data for projected volume kube-api-access-r7dqx for pod openshift-network-diagnostics/network-check-target-qmmfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:51.641839 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.641811 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx podName:25f308e2-d55c-46df-854b-3d5cb3391a16 nodeName:}" failed. No retries permitted until 2026-06-15 15:06:59.641791767 +0000 UTC m=+18.300745450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7dqx" (UniqueName: "kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx") pod "network-check-target-qmmfh" (UID: "25f308e2-d55c-46df-854b-3d5cb3391a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:51.837667 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:51.837542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:51.837872 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.837665 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:06:51.838025 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:51.838002 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:51.838197 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:51.838170 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:52.836504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:52.836469 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:52.836854 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:52.836600 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:53.836209 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:53.836170 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:53.836391 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:53.836281 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:53.836645 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:53.836170 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:53.837070 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:53.836718 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:06:54.835131 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:54.834917 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:54.835303 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:54.835245 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:55.835930 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:55.835887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:55.836382 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:55.835887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:55.836382 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:55.836020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:55.836382 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:55.836105 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:06:56.835847 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:56.835809 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:56.836050 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:56.835961 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:57.836054 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:57.836010 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:57.836475 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:57.836013 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:57.836475 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:57.836156 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:06:57.836475 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:57.836237 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:58.835749 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:58.835664 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:58.835911 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:58.835803 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:06:59.501756 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:59.501697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:06:59.502274 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.501881 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:59.502274 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.501959 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:15.501940202 +0000 UTC m=+34.160893882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:06:59.602584 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:59.602522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:59.602781 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.602681 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:59.602781 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.602765 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret podName:a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d nodeName:}" failed. No retries permitted until 2026-06-15 15:07:15.6027457 +0000 UTC m=+34.261699381 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret") pod "global-pull-secret-syncer-pjnbp" (UID: "a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d") : object "kube-system"/"original-pull-secret" not registered Jun 15 15:06:59.703914 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:59.703869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:59.704110 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.704072 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 15:06:59.704110 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.704091 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 15:06:59.704110 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.704102 2567 projected.go:196] Error preparing data for projected volume kube-api-access-r7dqx for pod openshift-network-diagnostics/network-check-target-qmmfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:59.704340 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.704211 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx podName:25f308e2-d55c-46df-854b-3d5cb3391a16 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:15.704160856 +0000 UTC m=+34.363114538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7dqx" (UniqueName: "kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx") pod "network-check-target-qmmfh" (UID: "25f308e2-d55c-46df-854b-3d5cb3391a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:06:59.835807 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:59.835707 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:06:59.835979 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.835836 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:06:59.835979 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:06:59.835906 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:06:59.836091 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:06:59.836021 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:00.835771 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:00.835728 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:00.836268 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:00.835907 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:01.836853 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:01.836815 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:01.837299 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:01.836929 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:01.837299 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:01.836993 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:01.837299 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:01.837012 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:02.835428 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:02.835386 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:02.835612 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:02.835538 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:03.838544 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:03.838510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:03.839719 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:03.838642 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:03.839719 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:03.839161 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:03.839719 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:03.839265 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:03.949204 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:03.949048 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vtb9c" event={"ID":"79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452","Type":"ContainerStarted","Data":"53d38c2f096b8c0247c7a79ba6e8892fa6ed7870e334467f7b0151c76b0aa824"} Jun 15 15:07:03.964103 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:03.962926 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vtb9c" podStartSLOduration=12.438165193 podStartE2EDuration="22.962903905s" totalImagesPullingTime="10.524738712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:03.961750547 +0000 UTC m=+22.620704268" watchObservedRunningTime="2026-06-15 15:07:03.962903905 +0000 UTC m=+22.621857606" Jun 15 15:07:03.988840 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:03.987627 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mnm77" podStartSLOduration=2.881028266 podStartE2EDuration="21.987601972s" totalImagesPullingTime="19.106573706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:03.986885603 +0000 UTC m=+22.645839296" watchObservedRunningTime="2026-06-15 15:07:03.987601972 +0000 UTC m=+22.646555674" Jun 15 15:07:04.835544 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.835505 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:04.835728 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:04.835638 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:04.970221 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.970185 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-szp6n" event={"ID":"f0833d8c-5be6-4af7-b8de-288f14458838","Type":"ContainerStarted","Data":"0f7974bdd86ebe89e8442bde8ca208d7d94d71814db738e8b4b676302642887b"} Jun 15 15:07:04.971723 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.971692 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" event={"ID":"5fbd580b-1344-49f8-839c-88de12e7176c","Type":"ContainerStarted","Data":"dbb9df794646ef87939890e264e1bcd09ffad6c938f3b7eb14aa56915b8805dc"} Jun 15 15:07:04.973069 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.973042 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sdklf" event={"ID":"9324414c-0a51-46e7-8345-0b7342d71197","Type":"ContainerStarted","Data":"aa7c1feb17531c9e631fbbeae503325a13d4b79d445814e5dcf63fd1f197ffa4"} Jun 15 15:07:04.974519 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.974498 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mnm77" event={"ID":"ae70438f-1f5e-4be5-b768-92b0386707fe","Type":"ContainerStarted","Data":"29380e2cbf5f669ea30acafb91bcb8079f6ee752a7543817290cbe83b8ad7ff2"} Jun 15 15:07:04.977278 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.977260 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:07:04.977567 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.977550 2567 generic.go:356] "Generic (PLEG): container finished" podID="a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9" containerID="188aafb4412389252c7d31525832f97c5fcb9ee0922a164461d15d2effa88e13" exitCode=1 Jun 15 15:07:04.977635 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.977609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"b416e07179b4c6d799a653825efbb615bc9d5e1df9093bcb129b2f256b2a3840"} Jun 15 15:07:04.977685 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.977662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"0a287d347f7cfc64aab7687f06a2910e858fdbe8b430c6838c5c020f34a2e450"} Jun 15 15:07:04.977734 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.977709 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"e019c7dab1888e776e00a51c2508956d5a8dc60441489d41f68b29de7f3d73b6"} Jun 15 15:07:04.977777 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.977750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"7b9b17735a01dc0ecdabdfc99891c7675e9e52ebe7555253d8809e136175eaf3"} Jun 15 15:07:04.977832 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.977787 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerDied","Data":"188aafb4412389252c7d31525832f97c5fcb9ee0922a164461d15d2effa88e13"} Jun 15 15:07:04.977832 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.977824 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"55039f2a7732591224936e7488c124febe084964ca9f171b7f5b570feb298344"} Jun 15 15:07:04.978975 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.978955 2567 generic.go:356] "Generic (PLEG): container finished" podID="6fba54d3-7374-4b55-8f28-20c86dd68da3" containerID="f75176e37c66f56fb5992945e2958e4d24c20d265726d0a67874dd25d27ee6c9" exitCode=0 Jun 15 15:07:04.979050 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.979015 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerDied","Data":"f75176e37c66f56fb5992945e2958e4d24c20d265726d0a67874dd25d27ee6c9"} Jun 15 15:07:04.980596 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.980329 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j5htj" event={"ID":"357f8dc3-e0d7-4d84-9a0f-90306bada743","Type":"ContainerStarted","Data":"546834d3238a6d831048325d5dfe028bc51523e9ab98eb6cc27e7fce748fd6b1"} Jun 15 15:07:04.984382 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.984342 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-szp6n" podStartSLOduration=3.937955315 podStartE2EDuration="22.984329743s" totalImagesPullingTime="19.046374428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:04.983793949 +0000 UTC m=+23.642747667" watchObservedRunningTime="2026-06-15 15:07:04.984329743 +0000 UTC m=+23.643283443" Jun 15 15:07:04.997052 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:04.996997 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sdklf" podStartSLOduration=3.94621764 podStartE2EDuration="22.996980283s" totalImagesPullingTime="19.050762643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:04.996864704 +0000 UTC m=+23.655818404" watchObservedRunningTime="2026-06-15 15:07:04.996980283 +0000 UTC m=+23.655933983" Jun 15 15:07:05.039739 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.039635 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j5htj" podStartSLOduration=4.958765022 podStartE2EDuration="24.039618237s" totalImagesPullingTime="19.080853215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:05.039335896 +0000 UTC m=+23.698289595" watchObservedRunningTime="2026-06-15 15:07:05.039618237 +0000 UTC m=+23.698571936" Jun 15 15:07:05.401566 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.401528 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 15:07:05.835487 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.835445 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:05.835684 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:05.835583 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:05.835684 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.835644 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:05.835806 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:05.835765 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:05.838816 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.838735 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T15:07:05.401558984Z","UUID":"41cc727f-633b-49d3-8029-1ff759f70008","Handler":null,"Name":"","Endpoint":""} Jun 15 15:07:05.840460 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.840438 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 15:07:05.840597 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.840484 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 15:07:05.879136 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.879067 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:07:05.880005 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.879973 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:07:05.985217 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.985174 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7sphl" event={"ID":"676c7660-5867-49a0-b528-9cb9f0b0b3e6","Type":"ContainerStarted","Data":"4fb9ed3be1fc62af929b21beaa35018d3696f2f5309ae9eef16d729d44e6bc50"} Jun 15 15:07:05.987924 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.987888 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" event={"ID":"5fbd580b-1344-49f8-839c-88de12e7176c","Type":"ContainerStarted","Data":"0b4724a3c8d18b912d1037ad0d9cc0d46e0f4f5695d846b4d4f66e9b79a8bcd5"} Jun 15 15:07:05.998976 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:05.998920 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7sphl" podStartSLOduration=4.924866122 podStartE2EDuration="23.998902025s" totalImagesPullingTime="19.074035903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:05.998849663 +0000 UTC m=+24.657803365" watchObservedRunningTime="2026-06-15 15:07:05.998902025 +0000 UTC m=+24.657855725" Jun 15 15:07:06.836146 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:06.836007 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:06.836362 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:06.836331 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:06.993217 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:06.993164 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" event={"ID":"5fbd580b-1344-49f8-839c-88de12e7176c","Type":"ContainerStarted","Data":"f4ecf672185543a2b925358fedbe9e1c011f8a7da7c9d2417c3d3fd1b2e4d3e8"} Jun 15 15:07:06.997696 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:06.997665 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:07:06.998264 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:06.998231 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"bef7c015e9e280bec98f36abf5cd354891dd0cd18872525262ef62a7181c9e3a"} Jun 15 15:07:06.998416 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:06.998400 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 15 15:07:07.010182 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:07.010110 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8v75f" podStartSLOduration=3.410219271 podStartE2EDuration="25.010092605s" totalImagesPullingTime="21.599873334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:07.009614758 +0000 UTC m=+25.668568485" watchObservedRunningTime="2026-06-15 15:07:07.010092605 +0000 UTC m=+25.669046306" Jun 15 15:07:07.835084 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:07.835047 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:07.835084 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:07.835090 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:07.835355 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:07.835216 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:07.835355 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:07.835324 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:08.364308 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:08.364263 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:07:08.364951 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:08.364391 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 15 15:07:08.364951 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:08.364932 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vtb9c" Jun 15 15:07:08.835579 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:08.835544 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:08.835781 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:08.835698 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:09.835212 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:09.835178 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:09.835654 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:09.835178 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:09.835654 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:09.835300 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:09.835654 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:09.835396 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:10.010267 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:10.010015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:07:10.835555 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:10.835517 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:10.836008 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:10.835641 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:11.015872 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.015845 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:07:11.016280 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.016250 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"cfe39eb87d1bc92bea1f77e0c6121bfa7f8fcbb663becea7ba2b08d429922e77"} Jun 15 15:07:11.016609 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.016584 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:07:11.016786 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.016772 2567 scope.go:117] "RemoveContainer" containerID="188aafb4412389252c7d31525832f97c5fcb9ee0922a164461d15d2effa88e13" Jun 15 15:07:11.018353 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.018325 2567 generic.go:356] "Generic (PLEG): container finished" podID="6fba54d3-7374-4b55-8f28-20c86dd68da3" containerID="49440db77976749896ac2c6a5b1e6bf64d03728a2fa8edd5367ba69bb7e4e1f1" exitCode=0 Jun 15 15:07:11.018459 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.018390 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerDied","Data":"49440db77976749896ac2c6a5b1e6bf64d03728a2fa8edd5367ba69bb7e4e1f1"} Jun 15 15:07:11.035414 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.035387 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:07:11.835933 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.835748 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:11.836681 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.835809 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:11.836681 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:11.835999 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:11.836681 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:11.836084 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:11.931203 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.931173 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pjnbp"] Jun 15 15:07:11.934313 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.934283 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-98xgq"] Jun 15 15:07:11.934513 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.934417 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:11.934589 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:11.934553 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:11.935087 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:11.935066 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qmmfh"] Jun 15 15:07:12.024185 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:12.024163 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:07:12.024546 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:12.024514 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" event={"ID":"a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9","Type":"ContainerStarted","Data":"7d731fc6875dd2cd235d96bb636de1344846c934567435da5b7e9e5468f4abc6"} Jun 15 15:07:12.024623 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:12.024552 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:12.024623 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:12.024537 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:12.024722 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:12.024688 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:12.024764 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:12.024742 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:12.024906 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:12.024880 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:07:12.024992 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:12.024978 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:07:12.041723 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:12.041696 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:07:12.055661 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:12.055609 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" podStartSLOduration=10.902440236 podStartE2EDuration="30.055593786s" totalImagesPullingTime="19.15315355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:12.05532347 +0000 UTC m=+30.714277196" watchObservedRunningTime="2026-06-15 15:07:12.055593786 +0000 UTC m=+30.714547463" Jun 15 15:07:13.029790 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:13.029756 2567 generic.go:356] "Generic (PLEG): container finished" podID="6fba54d3-7374-4b55-8f28-20c86dd68da3" containerID="4bfd25122b0a3a6e4e87df2d4eff5e40dae62b5d370d4f6b6bf282c60a9bf008" exitCode=0 Jun 15 15:07:13.030296 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:13.029829 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerDied","Data":"4bfd25122b0a3a6e4e87df2d4eff5e40dae62b5d370d4f6b6bf282c60a9bf008"} Jun 15 15:07:13.837339 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:13.836975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:13.837506 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:13.837407 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:13.837562 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:13.837518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:13.837630 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:13.837612 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:13.837679 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:13.837665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:13.837751 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:13.837735 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:15.036606 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:15.036428 2567 generic.go:356] "Generic (PLEG): container finished" podID="6fba54d3-7374-4b55-8f28-20c86dd68da3" containerID="7e2fb6070b48253762fc066878e91e18bb094416425e1c0d8fbcbf888a6584e8" exitCode=0 Jun 15 15:07:15.036606 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:15.036510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerDied","Data":"7e2fb6070b48253762fc066878e91e18bb094416425e1c0d8fbcbf888a6584e8"} Jun 15 15:07:15.529880 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:15.529845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:15.530073 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.529972 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:07:15.530073 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.530029 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:47.53001406 +0000 UTC m=+66.188967739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 15:07:15.631172 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:15.631053 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:15.631359 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.631206 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 15:07:15.631359 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.631290 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret podName:a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d nodeName:}" failed. No retries permitted until 2026-06-15 15:07:47.631268859 +0000 UTC m=+66.290222541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret") pod "global-pull-secret-syncer-pjnbp" (UID: "a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d") : object "kube-system"/"original-pull-secret" not registered Jun 15 15:07:15.731653 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:15.731609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:15.731827 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.731733 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 15:07:15.731827 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.731750 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 15:07:15.731827 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.731759 2567 projected.go:196] Error preparing data for projected volume kube-api-access-r7dqx for pod openshift-network-diagnostics/network-check-target-qmmfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:07:15.731827 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.731807 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx podName:25f308e2-d55c-46df-854b-3d5cb3391a16 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:47.731795355 +0000 UTC m=+66.390749034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7dqx" (UniqueName: "kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx") pod "network-check-target-qmmfh" (UID: "25f308e2-d55c-46df-854b-3d5cb3391a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 15:07:15.835610 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:15.835576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:15.835811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:15.835577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:15.835811 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.835732 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:07:15.835811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:15.835578 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:15.835811 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.835794 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjnbp" podUID="a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d" Jun 15 15:07:15.836040 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:15.835868 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmmfh" podUID="25f308e2-d55c-46df-854b-3d5cb3391a16" Jun 15 15:07:17.627734 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.627654 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-197.ec2.internal" event="NodeReady" Jun 15 15:07:17.628176 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.627820 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 15:07:17.671486 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.671447 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qc99f"] Jun 15 15:07:17.687625 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.687351 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-67kdg"] Jun 15 15:07:17.687820 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.687691 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.690919 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.690707 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 15:07:17.691168 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.691022 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 15:07:17.693067 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.691333 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lvt5t\"" Jun 15 15:07:17.703340 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.703309 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qc99f"] Jun 15 15:07:17.703485 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.703379 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-67kdg"] Jun 15 15:07:17.703485 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.703474 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-67kdg" Jun 15 15:07:17.706468 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.706435 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 15:07:17.706468 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.706459 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 15:07:17.706656 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.706530 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xvzb5\"" Jun 15 15:07:17.706768 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.706753 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 15:07:17.835071 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.835035 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:17.835326 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.835035 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:17.835501 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.835035 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:17.838298 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.838269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 15:07:17.838298 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.838282 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nbhnj\"" Jun 15 15:07:17.838465 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.838278 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 15:07:17.838502 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.838478 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 15:07:17.838534 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.838502 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlxbz\"" Jun 15 15:07:17.838840 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.838818 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 15:07:17.848573 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.848542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/241e1504-b585-4f67-9b5d-f62ec6ad02b7-tmp-dir\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.848748 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.848610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.848748 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.848645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbjgk\" (UniqueName: \"kubernetes.io/projected/8e238c45-ed86-46d2-b94a-9746d23687b5-kube-api-access-qbjgk\") pod \"ingress-canary-67kdg\" (UID: \"8e238c45-ed86-46d2-b94a-9746d23687b5\") " pod="openshift-ingress-canary/ingress-canary-67kdg" Jun 15 15:07:17.848748 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.848667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrnbx\" (UniqueName: \"kubernetes.io/projected/241e1504-b585-4f67-9b5d-f62ec6ad02b7-kube-api-access-xrnbx\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.848748 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.848739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/241e1504-b585-4f67-9b5d-f62ec6ad02b7-config-volume\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.848980 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.848795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e238c45-ed86-46d2-b94a-9746d23687b5-cert\") pod \"ingress-canary-67kdg\" (UID: \"8e238c45-ed86-46d2-b94a-9746d23687b5\") " pod="openshift-ingress-canary/ingress-canary-67kdg" Jun 15 15:07:17.950320 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.950234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.950320 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.950287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjgk\" (UniqueName: \"kubernetes.io/projected/8e238c45-ed86-46d2-b94a-9746d23687b5-kube-api-access-qbjgk\") pod \"ingress-canary-67kdg\" (UID: \"8e238c45-ed86-46d2-b94a-9746d23687b5\") " pod="openshift-ingress-canary/ingress-canary-67kdg" Jun 15 15:07:17.950320 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.950319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrnbx\" (UniqueName: \"kubernetes.io/projected/241e1504-b585-4f67-9b5d-f62ec6ad02b7-kube-api-access-xrnbx\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.950586 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:17.950384 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:07:17.950586 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:17.950461 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:18.450441261 +0000 UTC m=+37.109394941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:07:17.950586 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.950397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/241e1504-b585-4f67-9b5d-f62ec6ad02b7-config-volume\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.950586 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.950525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e238c45-ed86-46d2-b94a-9746d23687b5-cert\") pod \"ingress-canary-67kdg\" (UID: \"8e238c45-ed86-46d2-b94a-9746d23687b5\") " pod="openshift-ingress-canary/ingress-canary-67kdg" Jun 15 15:07:17.950586 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.950566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/241e1504-b585-4f67-9b5d-f62ec6ad02b7-tmp-dir\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.950931 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.950914 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/241e1504-b585-4f67-9b5d-f62ec6ad02b7-tmp-dir\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.951001 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.950977 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/241e1504-b585-4f67-9b5d-f62ec6ad02b7-config-volume\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.955096 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.955067 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e238c45-ed86-46d2-b94a-9746d23687b5-cert\") pod \"ingress-canary-67kdg\" (UID: \"8e238c45-ed86-46d2-b94a-9746d23687b5\") " pod="openshift-ingress-canary/ingress-canary-67kdg" Jun 15 15:07:17.960380 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.960343 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrnbx\" (UniqueName: \"kubernetes.io/projected/241e1504-b585-4f67-9b5d-f62ec6ad02b7-kube-api-access-xrnbx\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:17.960519 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:17.960387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjgk\" (UniqueName: \"kubernetes.io/projected/8e238c45-ed86-46d2-b94a-9746d23687b5-kube-api-access-qbjgk\") pod \"ingress-canary-67kdg\" (UID: \"8e238c45-ed86-46d2-b94a-9746d23687b5\") " pod="openshift-ingress-canary/ingress-canary-67kdg" Jun 15 15:07:18.015465 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:18.015430 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-67kdg" Jun 15 15:07:18.454331 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:18.454291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:18.454630 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:18.454463 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:07:18.454630 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:18.454542 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:19.454520595 +0000 UTC m=+38.113474288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:07:19.461798 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:19.461759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:19.462213 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:19.461943 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:07:19.462213 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:19.462031 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:21.462000481 +0000 UTC m=+40.120954161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:07:19.643238 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:19.643097 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-67kdg"] Jun 15 15:07:19.647956 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:07:19.647926 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e238c45_ed86_46d2_b94a_9746d23687b5.slice/crio-2ebebf0e947005ed0e1c96b1156714172d97abd51dfa9466870591bf446f8b50 WatchSource:0}: Error finding container 2ebebf0e947005ed0e1c96b1156714172d97abd51dfa9466870591bf446f8b50: Status 404 returned error can't find the container with id 2ebebf0e947005ed0e1c96b1156714172d97abd51dfa9466870591bf446f8b50 Jun 15 15:07:20.052036 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:20.051806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-67kdg" event={"ID":"8e238c45-ed86-46d2-b94a-9746d23687b5","Type":"ContainerStarted","Data":"2ebebf0e947005ed0e1c96b1156714172d97abd51dfa9466870591bf446f8b50"} Jun 15 15:07:20.054939 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:20.054903 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerStarted","Data":"453448ed17aa793ba9b0e1b733c775cb9e9dcae0db8324027e52334e0d2c2ca5"} Jun 15 15:07:21.062528 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:21.062476 2567 generic.go:356] "Generic (PLEG): container finished" podID="6fba54d3-7374-4b55-8f28-20c86dd68da3" containerID="453448ed17aa793ba9b0e1b733c775cb9e9dcae0db8324027e52334e0d2c2ca5" exitCode=0 Jun 15 15:07:21.062976 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:21.062550 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerDied","Data":"453448ed17aa793ba9b0e1b733c775cb9e9dcae0db8324027e52334e0d2c2ca5"} Jun 15 15:07:21.476462 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:21.476426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:21.476620 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:21.476601 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:07:21.476697 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:21.476684 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:25.476661467 +0000 UTC m=+44.135615157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:07:22.067774 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:22.067744 2567 generic.go:356] "Generic (PLEG): container finished" podID="6fba54d3-7374-4b55-8f28-20c86dd68da3" containerID="97144358e18a7daa2c3bfcf1fb37b1c905a1d779d7ad2c0245ba22f2d1a92ab7" exitCode=0 Jun 15 15:07:22.068342 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:22.067814 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerDied","Data":"97144358e18a7daa2c3bfcf1fb37b1c905a1d779d7ad2c0245ba22f2d1a92ab7"} Jun 15 15:07:22.069542 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:22.069519 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-67kdg" event={"ID":"8e238c45-ed86-46d2-b94a-9746d23687b5","Type":"ContainerStarted","Data":"b06561fbb4caab8a6393d5460a8dbf4b6d1153a4e5bdcb1b9ff22fa7d4a5f46d"} Jun 15 15:07:22.107792 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:22.107734 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-67kdg" podStartSLOduration=3.349278331 podStartE2EDuration="5.107718445s" totalImagesPullingTime="1.758440114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:22.107269988 +0000 UTC m=+40.766223687" watchObservedRunningTime="2026-06-15 15:07:22.107718445 +0000 UTC m=+40.766672146" Jun 15 15:07:23.075611 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:23.075573 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" event={"ID":"6fba54d3-7374-4b55-8f28-20c86dd68da3","Type":"ContainerStarted","Data":"e61d9fab3daf7e387e4dc735f0c068174299b0155e96eaf8ac310ea964d4a0e3"} Jun 15 15:07:23.103557 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:23.103160 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z6mqx" podStartSLOduration=9.612029757 podStartE2EDuration="41.103137282s" totalImagesPullingTime="31.491107525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:23.101574439 +0000 UTC m=+41.760528159" watchObservedRunningTime="2026-06-15 15:07:23.103137282 +0000 UTC m=+41.762090977" Jun 15 15:07:25.506407 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:25.506352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:25.506819 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:25.506480 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:07:25.506819 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:25.506535 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:33.506522228 +0000 UTC m=+52.165475906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:07:31.210675 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.210639 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j"] Jun 15 15:07:31.239389 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.239353 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.244782 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.244750 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 15 15:07:31.244782 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.244750 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 15 15:07:31.245404 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.245380 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 15 15:07:31.245960 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.245917 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 15 15:07:31.246065 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.246003 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 15 15:07:31.246757 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.246730 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 15 15:07:31.246757 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.246749 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 15 15:07:31.256941 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.256914 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j"] Jun 15 15:07:31.350636 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.350597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-hub\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.350826 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.350667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-ca\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.350826 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.350688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqdcf\" (UniqueName: \"kubernetes.io/projected/9ca2e330-7167-4c19-9873-d08f1f2f4989-kube-api-access-mqdcf\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.350826 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.350727 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.350826 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.350772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca2e330-7167-4c19-9873-d08f1f2f4989-additional-service-ca\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.350952 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.350852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.451239 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.451198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-ca\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.451239 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.451242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdcf\" (UniqueName: \"kubernetes.io/projected/9ca2e330-7167-4c19-9873-d08f1f2f4989-kube-api-access-mqdcf\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.451464 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.451286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.451464 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.451311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca2e330-7167-4c19-9873-d08f1f2f4989-additional-service-ca\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.451464 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.451371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.451464 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.451400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-hub\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.452047 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.452018 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca2e330-7167-4c19-9873-d08f1f2f4989-additional-service-ca\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.455032 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.455001 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-ca\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.455203 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.455093 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.455203 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.455134 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.455290 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.455206 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9ca2e330-7167-4c19-9873-d08f1f2f4989-hub\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.460386 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.460361 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqdcf\" (UniqueName: \"kubernetes.io/projected/9ca2e330-7167-4c19-9873-d08f1f2f4989-kube-api-access-mqdcf\") pod \"cluster-proxy-proxy-agent-855b76d748-5qt7j\" (UID: \"9ca2e330-7167-4c19-9873-d08f1f2f4989\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.557201 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.557161 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:07:31.714537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:31.714499 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j"] Jun 15 15:07:31.719368 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:07:31.719336 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ca2e330_7167_4c19_9873_d08f1f2f4989.slice/crio-a2a055eef9c65b7dd22451671da68d853501cda86ed9d7c53bf2b3ae348cb4d2 WatchSource:0}: Error finding container a2a055eef9c65b7dd22451671da68d853501cda86ed9d7c53bf2b3ae348cb4d2: Status 404 returned error can't find the container with id a2a055eef9c65b7dd22451671da68d853501cda86ed9d7c53bf2b3ae348cb4d2 Jun 15 15:07:32.097420 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:32.097373 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" event={"ID":"9ca2e330-7167-4c19-9873-d08f1f2f4989","Type":"ContainerStarted","Data":"a2a055eef9c65b7dd22451671da68d853501cda86ed9d7c53bf2b3ae348cb4d2"} Jun 15 15:07:33.570939 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:33.570899 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:33.571457 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:33.571062 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:07:33.571457 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:33.571144 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:07:49.571105816 +0000 UTC m=+68.230059513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:07:37.112639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:37.112599 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" event={"ID":"9ca2e330-7167-4c19-9873-d08f1f2f4989","Type":"ContainerStarted","Data":"b05e06900f8fb1506a7b7156f272311f1b8addb1dbecc47d54a5eb8ef0bba478"} Jun 15 15:07:37.113193 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:37.112651 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" event={"ID":"9ca2e330-7167-4c19-9873-d08f1f2f4989","Type":"ContainerStarted","Data":"eeddd21415aa4e40fd171625bed598447d184c6aa28ee9b834cf8f9a3885f646"} Jun 15 15:07:37.113193 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:37.112670 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" event={"ID":"9ca2e330-7167-4c19-9873-d08f1f2f4989","Type":"ContainerStarted","Data":"d17fdf6622d7460a1a5ea1f62bb052827dd868c1311a12e84441144d351cdca1"} Jun 15 15:07:37.138552 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:37.138496 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" podStartSLOduration=1.59821393 podStartE2EDuration="6.138479693s" totalImagesPullingTime="4.540265763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:37.136491832 +0000 UTC m=+55.795445535" watchObservedRunningTime="2026-06-15 15:07:37.138479693 +0000 UTC m=+55.797433436" Jun 15 15:07:44.051035 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:44.051005 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvx64" Jun 15 15:07:47.574684 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.574621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:07:47.577443 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.577418 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 15:07:47.585207 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:47.585174 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 15:07:47.585291 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:47.585262 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:08:51.585245369 +0000 UTC m=+130.244199046 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : secret "metrics-daemon-secret" not found Jun 15 15:07:47.675557 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.675517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:47.678355 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.678330 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 15:07:47.689095 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.689057 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d-original-pull-secret\") pod \"global-pull-secret-syncer-pjnbp\" (UID: \"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d\") " pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:47.776483 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.776436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:47.779609 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.779585 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 15:07:47.789934 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.789908 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 15:07:47.801021 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.800976 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7dqx\" (UniqueName: \"kubernetes.io/projected/25f308e2-d55c-46df-854b-3d5cb3391a16-kube-api-access-r7dqx\") pod \"network-check-target-qmmfh\" (UID: \"25f308e2-d55c-46df-854b-3d5cb3391a16\") " pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:47.850096 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.849999 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nbhnj\"" Jun 15 15:07:47.853829 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.853803 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjnbp" Jun 15 15:07:47.857906 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:47.857872 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:48.001396 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:48.001360 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pjnbp"] Jun 15 15:07:48.004606 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:07:48.004573 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71ca1be_b3d3_49b1_9d11_06e9f9c11f8d.slice/crio-368a4287012db17da397dd05ecf1c2228a5083068005a02e6782cf3bf2672181 WatchSource:0}: Error finding container 368a4287012db17da397dd05ecf1c2228a5083068005a02e6782cf3bf2672181: Status 404 returned error can't find the container with id 368a4287012db17da397dd05ecf1c2228a5083068005a02e6782cf3bf2672181 Jun 15 15:07:48.015602 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:48.015565 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qmmfh"] Jun 15 15:07:48.018760 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:07:48.018722 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f308e2_d55c_46df_854b_3d5cb3391a16.slice/crio-1db0fdefd78b2d6b3051c5b9062e9c26989833a4028f3db82450f06e5e5a44e5 WatchSource:0}: Error finding container 1db0fdefd78b2d6b3051c5b9062e9c26989833a4028f3db82450f06e5e5a44e5: Status 404 returned error can't find the container with id 1db0fdefd78b2d6b3051c5b9062e9c26989833a4028f3db82450f06e5e5a44e5 Jun 15 15:07:48.142340 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:48.142237 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pjnbp" event={"ID":"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d","Type":"ContainerStarted","Data":"368a4287012db17da397dd05ecf1c2228a5083068005a02e6782cf3bf2672181"} Jun 15 15:07:48.143418 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:48.143390 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qmmfh" event={"ID":"25f308e2-d55c-46df-854b-3d5cb3391a16","Type":"ContainerStarted","Data":"1db0fdefd78b2d6b3051c5b9062e9c26989833a4028f3db82450f06e5e5a44e5"} Jun 15 15:07:49.591483 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:49.591446 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:07:49.591982 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:49.591626 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:07:49.591982 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:07:49.591691 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:08:21.591671907 +0000 UTC m=+100.250625591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:07:53.160297 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:53.160252 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qmmfh" event={"ID":"25f308e2-d55c-46df-854b-3d5cb3391a16","Type":"ContainerStarted","Data":"5dcf989d812a7d19a72cd35ea2984354c1a3d8eb5c77434c140a6898697e86d1"} Jun 15 15:07:53.160791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:53.160375 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:07:53.161770 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:53.161745 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pjnbp" event={"ID":"a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d","Type":"ContainerStarted","Data":"281ef4452ad7b80338e231e6b45f38517e500efa08c76a08176a165157d68c2c"} Jun 15 15:07:53.177333 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:53.177272 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qmmfh" podStartSLOduration=66.492282283 podStartE2EDuration="1m11.177254108s" totalImagesPullingTime="4.684971825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:53.176585791 +0000 UTC m=+71.835539492" watchObservedRunningTime="2026-06-15 15:07:53.177254108 +0000 UTC m=+71.836207809" Jun 15 15:07:53.193715 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:07:53.193663 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pjnbp" podStartSLOduration=66.491283387 podStartE2EDuration="1m11.193646336s" totalImagesPullingTime="4.702362949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:07:53.193070133 +0000 UTC m=+71.852023835" watchObservedRunningTime="2026-06-15 15:07:53.193646336 +0000 UTC m=+71.852600064" Jun 15 15:08:21.627193 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:08:21.627136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:08:21.627689 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:08:21.627263 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:08:21.627689 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:08:21.627328 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:25.627313823 +0000 UTC m=+164.286267504 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:08:24.167449 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:08:24.167411 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qmmfh" Jun 15 15:08:51.638888 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:08:51.638842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:08:51.639421 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:08:51.638985 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 15:08:51.639421 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:08:51.639044 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs podName:6d11743e-081e-4d7d-8cf1-674fec0019a8 nodeName:}" failed. No retries permitted until 2026-06-15 15:10:53.639028194 +0000 UTC m=+252.297981873 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs") pod "network-metrics-daemon-98xgq" (UID: "6d11743e-081e-4d7d-8cf1-674fec0019a8") : secret "metrics-daemon-secret" not found Jun 15 15:09:20.702421 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:20.702316 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qc99f" podUID="241e1504-b585-4f67-9b5d-f62ec6ad02b7" Jun 15 15:09:20.859973 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:20.859929 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-98xgq" podUID="6d11743e-081e-4d7d-8cf1-674fec0019a8" Jun 15 15:09:21.411366 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:21.411332 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qc99f" Jun 15 15:09:25.674234 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:25.674177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:09:25.674637 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:25.674333 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 15:09:25.674637 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:25.674405 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls podName:241e1504-b585-4f67-9b5d-f62ec6ad02b7 nodeName:}" failed. No retries permitted until 2026-06-15 15:11:27.674389098 +0000 UTC m=+286.333342780 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls") pod "dns-default-qc99f" (UID: "241e1504-b585-4f67-9b5d-f62ec6ad02b7") : secret "dns-default-metrics-tls" not found Jun 15 15:09:35.835258 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:35.835210 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:09:42.595546 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.595509 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-dr992"] Jun 15 15:09:42.597741 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.597720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.600767 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.600739 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lvf7w\"" Jun 15 15:09:42.600945 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.600927 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 15 15:09:42.601017 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.600939 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 15 15:09:42.601726 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.601708 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 15 15:09:42.601796 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.601711 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 15 15:09:42.606894 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.606866 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 15 15:09:42.610674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.610648 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-dr992"] Jun 15 15:09:42.692721 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.692687 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-trusted-ca\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.692911 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.692739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gq8s\" (UniqueName: \"kubernetes.io/projected/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-kube-api-access-6gq8s\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.692911 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.692780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-config\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.692911 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.692833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-serving-cert\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.793501 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.793455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-trusted-ca\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.793501 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.793508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gq8s\" (UniqueName: \"kubernetes.io/projected/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-kube-api-access-6gq8s\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.793772 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.793534 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-config\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.793772 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.793559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-serving-cert\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.794260 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.794233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-config\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.794381 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.794353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-trusted-ca\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.796087 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.796067 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-serving-cert\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.802291 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.802266 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gq8s\" (UniqueName: \"kubernetes.io/projected/519b47c6-9b46-4b1e-8d0e-5462ff5ece38-kube-api-access-6gq8s\") pod \"console-operator-5dbbb5d744-dr992\" (UID: \"519b47c6-9b46-4b1e-8d0e-5462ff5ece38\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:42.907189 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:42.907065 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:43.037565 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:43.037523 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-dr992"] Jun 15 15:09:43.041776 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:09:43.041747 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519b47c6_9b46_4b1e_8d0e_5462ff5ece38.slice/crio-e221fc9797b2607ef2699551b4e280060d2e8d4941154f34d4965a1557eb8875 WatchSource:0}: Error finding container e221fc9797b2607ef2699551b4e280060d2e8d4941154f34d4965a1557eb8875: Status 404 returned error can't find the container with id e221fc9797b2607ef2699551b4e280060d2e8d4941154f34d4965a1557eb8875 Jun 15 15:09:43.476490 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:43.476453 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" event={"ID":"519b47c6-9b46-4b1e-8d0e-5462ff5ece38","Type":"ContainerStarted","Data":"e221fc9797b2607ef2699551b4e280060d2e8d4941154f34d4965a1557eb8875"} Jun 15 15:09:45.484410 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:45.484331 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/0.log" Jun 15 15:09:45.484410 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:45.484369 2567 generic.go:356] "Generic (PLEG): container finished" podID="519b47c6-9b46-4b1e-8d0e-5462ff5ece38" containerID="1e2a7b8213b2683da1b9b7bcb97a5c5a4832333a05774e3d1691864781a50ac0" exitCode=255 Jun 15 15:09:45.484836 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:45.484406 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" event={"ID":"519b47c6-9b46-4b1e-8d0e-5462ff5ece38","Type":"ContainerDied","Data":"1e2a7b8213b2683da1b9b7bcb97a5c5a4832333a05774e3d1691864781a50ac0"} Jun 15 15:09:45.484836 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:45.484645 2567 scope.go:117] "RemoveContainer" containerID="1e2a7b8213b2683da1b9b7bcb97a5c5a4832333a05774e3d1691864781a50ac0" Jun 15 15:09:46.488640 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:46.488612 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:09:46.489053 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:46.488983 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/0.log" Jun 15 15:09:46.489053 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:46.489016 2567 generic.go:356] "Generic (PLEG): container finished" podID="519b47c6-9b46-4b1e-8d0e-5462ff5ece38" containerID="48448dfd1efa6cf67c0bcfc6d5a6f9426d45b161541cdb79d9b516ce67deb4d8" exitCode=255 Jun 15 15:09:46.489147 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:46.489060 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" event={"ID":"519b47c6-9b46-4b1e-8d0e-5462ff5ece38","Type":"ContainerDied","Data":"48448dfd1efa6cf67c0bcfc6d5a6f9426d45b161541cdb79d9b516ce67deb4d8"} Jun 15 15:09:46.489147 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:46.489111 2567 scope.go:117] "RemoveContainer" containerID="1e2a7b8213b2683da1b9b7bcb97a5c5a4832333a05774e3d1691864781a50ac0" Jun 15 15:09:46.489359 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:46.489342 2567 scope.go:117] "RemoveContainer" containerID="48448dfd1efa6cf67c0bcfc6d5a6f9426d45b161541cdb79d9b516ce67deb4d8" Jun 15 15:09:46.489545 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:46.489527 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-dr992_openshift-console-operator(519b47c6-9b46-4b1e-8d0e-5462ff5ece38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" podUID="519b47c6-9b46-4b1e-8d0e-5462ff5ece38" Jun 15 15:09:47.078252 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.078186 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x86jq"] Jun 15 15:09:47.080882 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.080860 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.083393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.083373 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 15:09:47.087319 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.083997 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 15:09:47.087533 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.087458 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 15:09:47.087533 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.087467 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8xxrz\"" Jun 15 15:09:47.087533 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.087511 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 15:09:47.095048 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.095019 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x86jq"] Jun 15 15:09:47.130899 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.130859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32e23802-1d42-40b8-8e6d-512ed3ed0301-data-volume\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.131078 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.130906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.131078 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.130975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bv97\" (UniqueName: \"kubernetes.io/projected/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-api-access-9bv97\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.131078 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.131033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.131232 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.131150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32e23802-1d42-40b8-8e6d-512ed3ed0301-crio-socket\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.231481 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.231440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32e23802-1d42-40b8-8e6d-512ed3ed0301-data-volume\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.231481 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.231487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.231740 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.231511 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bv97\" (UniqueName: \"kubernetes.io/projected/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-api-access-9bv97\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.231740 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.231549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.231740 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.231591 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 15:09:47.231740 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.231611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32e23802-1d42-40b8-8e6d-512ed3ed0301-crio-socket\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.231740 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.231671 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:47.731651132 +0000 UTC m=+186.390604827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : configmap "kube-rbac-proxy" not found Jun 15 15:09:47.231740 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.231695 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32e23802-1d42-40b8-8e6d-512ed3ed0301-crio-socket\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.231740 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.231735 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 15:09:47.232005 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.231827 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:47.731806238 +0000 UTC m=+186.390759933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : secret "insights-runtime-extractor-tls" not found Jun 15 15:09:47.232005 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.231829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32e23802-1d42-40b8-8e6d-512ed3ed0301-data-volume\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.240795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.240760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bv97\" (UniqueName: \"kubernetes.io/projected/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-api-access-9bv97\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.493594 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.493567 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:09:47.493950 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.493884 2567 scope.go:117] "RemoveContainer" containerID="48448dfd1efa6cf67c0bcfc6d5a6f9426d45b161541cdb79d9b516ce67deb4d8" Jun 15 15:09:47.494036 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.494016 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-dr992_openshift-console-operator(519b47c6-9b46-4b1e-8d0e-5462ff5ece38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" podUID="519b47c6-9b46-4b1e-8d0e-5462ff5ece38" Jun 15 15:09:47.734555 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.734501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.734751 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:47.734578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:47.734751 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.734623 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 15:09:47.734751 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.734701 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:48.734684764 +0000 UTC m=+187.393638441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : configmap "kube-rbac-proxy" not found Jun 15 15:09:47.734751 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.734718 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 15:09:47.734922 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:47.734762 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:48.734749939 +0000 UTC m=+187.393703620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : secret "insights-runtime-extractor-tls" not found Jun 15 15:09:48.742736 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:48.742696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:48.743225 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:48.742752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:48.743225 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:48.742826 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 15:09:48.743225 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:48.742850 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 15:09:48.743225 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:48.742899 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:50.742885572 +0000 UTC m=+189.401839251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : secret "insights-runtime-extractor-tls" not found Jun 15 15:09:48.743225 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:48.742913 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:50.742905794 +0000 UTC m=+189.401859471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : configmap "kube-rbac-proxy" not found Jun 15 15:09:49.273858 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:49.273829 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sdklf_9324414c-0a51-46e7-8345-0b7342d71197/dns-node-resolver/0.log" Jun 15 15:09:50.272778 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:50.272753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-szp6n_f0833d8c-5be6-4af7-b8de-288f14458838/node-ca/0.log" Jun 15 15:09:50.671621 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:50.671550 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-67kdg_8e238c45-ed86-46d2-b94a-9746d23687b5/serve-healthcheck-canary/0.log" Jun 15 15:09:50.758996 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:50.758959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:50.759232 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:50.759048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:50.759232 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:50.759101 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 15:09:50.759232 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:50.759151 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 15:09:50.759232 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:50.759180 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:54.75916473 +0000 UTC m=+193.418118412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : secret "insights-runtime-extractor-tls" not found Jun 15 15:09:50.759232 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:50.759203 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:09:54.759186566 +0000 UTC m=+193.418140248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : configmap "kube-rbac-proxy" not found Jun 15 15:09:52.907316 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:52.907275 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:52.907698 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:52.907344 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:09:52.907698 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:52.907681 2567 scope.go:117] "RemoveContainer" containerID="48448dfd1efa6cf67c0bcfc6d5a6f9426d45b161541cdb79d9b516ce67deb4d8" Jun 15 15:09:52.907861 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:52.907841 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-dr992_openshift-console-operator(519b47c6-9b46-4b1e-8d0e-5462ff5ece38)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" podUID="519b47c6-9b46-4b1e-8d0e-5462ff5ece38" Jun 15 15:09:54.792286 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:54.792228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:54.792727 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:09:54.792320 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:09:54.792727 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:54.792355 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 15:09:54.792727 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:54.792419 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:10:02.792403796 +0000 UTC m=+201.451357478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : configmap "kube-rbac-proxy" not found Jun 15 15:09:54.792727 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:54.792463 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 15:09:54.792727 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:09:54.792515 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls podName:32e23802-1d42-40b8-8e6d-512ed3ed0301 nodeName:}" failed. No retries permitted until 2026-06-15 15:10:02.792502742 +0000 UTC m=+201.451456419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x86jq" (UID: "32e23802-1d42-40b8-8e6d-512ed3ed0301") : secret "insights-runtime-extractor-tls" not found Jun 15 15:10:02.848954 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:02.848901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:10:02.849395 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:02.848979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:10:02.849481 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:02.849460 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32e23802-1d42-40b8-8e6d-512ed3ed0301-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:10:02.851553 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:02.851523 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32e23802-1d42-40b8-8e6d-512ed3ed0301-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x86jq\" (UID: \"32e23802-1d42-40b8-8e6d-512ed3ed0301\") " pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:10:02.994146 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:02.994085 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x86jq" Jun 15 15:10:03.125813 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:03.125733 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x86jq"] Jun 15 15:10:03.128996 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:03.128966 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e23802_1d42_40b8_8e6d_512ed3ed0301.slice/crio-692236bd04af5c40ec41518e64ba1676e5cdc1b72795f57d564fa878bb2957c8 WatchSource:0}: Error finding container 692236bd04af5c40ec41518e64ba1676e5cdc1b72795f57d564fa878bb2957c8: Status 404 returned error can't find the container with id 692236bd04af5c40ec41518e64ba1676e5cdc1b72795f57d564fa878bb2957c8 Jun 15 15:10:03.539374 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:03.539341 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x86jq" event={"ID":"32e23802-1d42-40b8-8e6d-512ed3ed0301","Type":"ContainerStarted","Data":"692236bd04af5c40ec41518e64ba1676e5cdc1b72795f57d564fa878bb2957c8"} Jun 15 15:10:06.835571 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:06.835538 2567 scope.go:117] "RemoveContainer" containerID="48448dfd1efa6cf67c0bcfc6d5a6f9426d45b161541cdb79d9b516ce67deb4d8" Jun 15 15:10:07.555258 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:07.555221 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x86jq" event={"ID":"32e23802-1d42-40b8-8e6d-512ed3ed0301","Type":"ContainerStarted","Data":"83d4bc628d051788da33f4a1c954149830dfe09f6583e8196654c0ba7710e06d"} Jun 15 15:10:07.555435 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:07.555317 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x86jq" event={"ID":"32e23802-1d42-40b8-8e6d-512ed3ed0301","Type":"ContainerStarted","Data":"f69346f439d4d03724135fb58e36399f304ad6a861dded6a8b20c113d9146276"} Jun 15 15:10:07.556936 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:07.556916 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:10:07.557039 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:07.556982 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" event={"ID":"519b47c6-9b46-4b1e-8d0e-5462ff5ece38","Type":"ContainerStarted","Data":"b4e1f7cfc80c69e588165aefc45da7d7775399f6013b6f5dddff6db6eb2467e2"} Jun 15 15:10:07.557278 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:07.557241 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:10:07.573871 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:07.573815 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" podStartSLOduration=23.427319604 podStartE2EDuration="25.57379779s" totalImagesPullingTime="2.146478186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:07.573198401 +0000 UTC m=+206.232152125" watchObservedRunningTime="2026-06-15 15:10:07.57379779 +0000 UTC m=+206.232751490" Jun 15 15:10:07.674321 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:07.674288 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-dr992" Jun 15 15:10:09.566307 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:09.566267 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x86jq" event={"ID":"32e23802-1d42-40b8-8e6d-512ed3ed0301","Type":"ContainerStarted","Data":"0034861c8042eaf4b73823d4ea6976473137a6678735627359f024af0d3df648"} Jun 15 15:10:09.585313 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:09.585259 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x86jq" podStartSLOduration=16.783088 podStartE2EDuration="22.585242293s" totalImagesPullingTime="5.802154293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:09:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:09.584651527 +0000 UTC m=+208.243605247" watchObservedRunningTime="2026-06-15 15:10:09.585242293 +0000 UTC m=+208.244195992" Jun 15 15:10:10.965935 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:10.965902 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-26xjd"] Jun 15 15:10:10.967883 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:10.967861 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-26xjd" Jun 15 15:10:10.970342 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:10.970318 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 15:10:10.970486 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:10.970319 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hw95b\"" Jun 15 15:10:10.970486 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:10.970352 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 15:10:10.980056 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:10.980027 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-26xjd"] Jun 15 15:10:11.116211 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:11.116170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26mdz\" (UniqueName: \"kubernetes.io/projected/e2302079-56c0-4b22-9d65-0360dd2884be-kube-api-access-26mdz\") pod \"downloads-694c955b9-26xjd\" (UID: \"e2302079-56c0-4b22-9d65-0360dd2884be\") " pod="openshift-console/downloads-694c955b9-26xjd" Jun 15 15:10:11.217409 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:11.217315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26mdz\" (UniqueName: \"kubernetes.io/projected/e2302079-56c0-4b22-9d65-0360dd2884be-kube-api-access-26mdz\") pod \"downloads-694c955b9-26xjd\" (UID: \"e2302079-56c0-4b22-9d65-0360dd2884be\") " pod="openshift-console/downloads-694c955b9-26xjd" Jun 15 15:10:11.226069 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:11.226037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26mdz\" (UniqueName: \"kubernetes.io/projected/e2302079-56c0-4b22-9d65-0360dd2884be-kube-api-access-26mdz\") pod \"downloads-694c955b9-26xjd\" (UID: \"e2302079-56c0-4b22-9d65-0360dd2884be\") " pod="openshift-console/downloads-694c955b9-26xjd" Jun 15 15:10:11.277056 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:11.277018 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-26xjd" Jun 15 15:10:11.404860 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:11.404825 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-26xjd"] Jun 15 15:10:11.408969 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:11.408935 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2302079_56c0_4b22_9d65_0360dd2884be.slice/crio-a467d48edc26ea373515ec64088cf58a556891f1ae57be067b4bfe3fd74f7179 WatchSource:0}: Error finding container a467d48edc26ea373515ec64088cf58a556891f1ae57be067b4bfe3fd74f7179: Status 404 returned error can't find the container with id a467d48edc26ea373515ec64088cf58a556891f1ae57be067b4bfe3fd74f7179 Jun 15 15:10:11.575165 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:11.575105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-26xjd" event={"ID":"e2302079-56c0-4b22-9d65-0360dd2884be","Type":"ContainerStarted","Data":"a467d48edc26ea373515ec64088cf58a556891f1ae57be067b4bfe3fd74f7179"} Jun 15 15:10:17.569017 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.568977 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687dfb4dbc-s92rc"] Jun 15 15:10:17.571350 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.571318 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.573955 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.573918 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 15:10:17.575362 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.575051 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 15:10:17.575362 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.575155 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 15:10:17.575362 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.575207 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h9k8j\"" Jun 15 15:10:17.575362 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.575155 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 15:10:17.575362 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.575307 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 15:10:17.581998 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.581635 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687dfb4dbc-s92rc"] Jun 15 15:10:17.669423 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.669386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-serving-cert\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.669423 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.669437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-oauth-config\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.669662 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.669490 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvj6p\" (UniqueName: \"kubernetes.io/projected/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-kube-api-access-lvj6p\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.669662 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.669547 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-oauth-serving-cert\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.669662 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.669576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-config\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.669662 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.669604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-service-ca\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770157 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-oauth-serving-cert\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770157 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-config\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770399 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-service-ca\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770399 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-serving-cert\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770399 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770240 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-oauth-config\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770399 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvj6p\" (UniqueName: \"kubernetes.io/projected/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-kube-api-access-lvj6p\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770970 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-oauth-serving-cert\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770970 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-config\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.770970 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.770970 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-service-ca\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.772769 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.772738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-serving-cert\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.772858 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.772801 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-oauth-config\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.781214 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.781189 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvj6p\" (UniqueName: \"kubernetes.io/projected/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-kube-api-access-lvj6p\") pod \"console-687dfb4dbc-s92rc\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:17.883948 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:17.883856 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:18.027730 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.027694 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687dfb4dbc-s92rc"] Jun 15 15:10:18.031022 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:18.030989 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543b217f_eecc_44a2_a9b7_45fe10f0b1fe.slice/crio-bb9daa738b2f3e15a42ecb0aa88f906e3811eb3dbb8a3c132f665f6b5a61e6df WatchSource:0}: Error finding container bb9daa738b2f3e15a42ecb0aa88f906e3811eb3dbb8a3c132f665f6b5a61e6df: Status 404 returned error can't find the container with id bb9daa738b2f3e15a42ecb0aa88f906e3811eb3dbb8a3c132f665f6b5a61e6df Jun 15 15:10:18.133784 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.133752 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q6c4w"] Jun 15 15:10:18.136803 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.136730 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.139003 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.138976 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 15:10:18.139304 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.139286 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 15:10:18.139386 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.139343 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-crtft\"" Jun 15 15:10:18.140345 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.140319 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 15:10:18.140477 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.140367 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 15:10:18.140477 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.140380 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 15:10:18.140477 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.140387 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 15:10:18.274327 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98b52f65-e0f5-496e-923d-14eab776672c-metrics-client-ca\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.274532 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274338 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-textfile\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.274532 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.274532 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-sys\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.274532 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-wtmp\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.274532 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274491 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-root\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.274532 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.274830 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-tls\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.274830 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.274620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pplh\" (UniqueName: \"kubernetes.io/projected/98b52f65-e0f5-496e-923d-14eab776672c-kube-api-access-7pplh\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375053 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-tls\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375053 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375056 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pplh\" (UniqueName: \"kubernetes.io/projected/98b52f65-e0f5-496e-923d-14eab776672c-kube-api-access-7pplh\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375326 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98b52f65-e0f5-496e-923d-14eab776672c-metrics-client-ca\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375326 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-textfile\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375326 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375326 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:10:18.375208 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 15:10:18.375326 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-sys\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375326 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-wtmp\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375326 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-root\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375654 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375654 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-sys\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375654 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:10:18.375410 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-tls podName:98b52f65-e0f5-496e-923d-14eab776672c nodeName:}" failed. No retries permitted until 2026-06-15 15:10:18.875387951 +0000 UTC m=+217.534341641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-tls") pod "node-exporter-q6c4w" (UID: "98b52f65-e0f5-496e-923d-14eab776672c") : secret "node-exporter-tls" not found Jun 15 15:10:18.375654 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-wtmp\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375654 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375554 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98b52f65-e0f5-496e-923d-14eab776672c-root\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375920 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98b52f65-e0f5-496e-923d-14eab776672c-metrics-client-ca\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375920 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375834 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-textfile\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.375920 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.375907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.378753 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.378727 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.386083 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.386052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pplh\" (UniqueName: \"kubernetes.io/projected/98b52f65-e0f5-496e-923d-14eab776672c-kube-api-access-7pplh\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.601029 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.600989 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dfb4dbc-s92rc" event={"ID":"543b217f-eecc-44a2-a9b7-45fe10f0b1fe","Type":"ContainerStarted","Data":"bb9daa738b2f3e15a42ecb0aa88f906e3811eb3dbb8a3c132f665f6b5a61e6df"} Jun 15 15:10:18.880361 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.880270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-tls\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:18.882934 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:18.882902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98b52f65-e0f5-496e-923d-14eab776672c-node-exporter-tls\") pod \"node-exporter-q6c4w\" (UID: \"98b52f65-e0f5-496e-923d-14eab776672c\") " pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:19.051291 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.051249 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q6c4w" Jun 15 15:10:19.063770 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:19.063683 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b52f65_e0f5_496e_923d_14eab776672c.slice/crio-2b7e9e0b765f25c9b26dc189aedce7ceb785c4f6b6a66dc4230070d4c9f89abb WatchSource:0}: Error finding container 2b7e9e0b765f25c9b26dc189aedce7ceb785c4f6b6a66dc4230070d4c9f89abb: Status 404 returned error can't find the container with id 2b7e9e0b765f25c9b26dc189aedce7ceb785c4f6b6a66dc4230070d4c9f89abb Jun 15 15:10:19.166427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.166245 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:10:19.169966 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.169877 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.172860 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.172593 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 15:10:19.172860 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.172622 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 15:10:19.172860 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.172658 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 15:10:19.172860 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.172698 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 15:10:19.172860 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.172622 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 15:10:19.173244 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.173074 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 15:10:19.173244 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.173111 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 15:10:19.173336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.173282 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 15:10:19.173336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.173313 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 15:10:19.173764 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.173600 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-58k5s\"" Jun 15 15:10:19.184111 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.184023 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:10:19.283892 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.283854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.283901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkgfb\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-kube-api-access-kkgfb\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.283944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.283967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-out\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.283990 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.284051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284377 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.284093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-web-config\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284377 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.284141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284377 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.284176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284377 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.284210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284377 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.284243 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284377 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.284269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.284377 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.284302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.384787 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.384738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.384787 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.384787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkgfb\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-kube-api-access-kkgfb\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385011 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.384829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385011 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.384855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-out\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385011 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.384882 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385211 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385263 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385230 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-web-config\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385263 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385235 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385263 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385413 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385413 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385413 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385413 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.385614 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.386325 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385836 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.386325 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.385855 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.386325 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:10:19.385951 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 15 15:10:19.386325 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:10:19.386017 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls podName:d0a12eac-f22c-4ae0-8a24-b1f714d93354 nodeName:}" failed. No retries permitted until 2026-06-15 15:10:19.885998395 +0000 UTC m=+218.544952077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354") : secret "alertmanager-main-tls" not found Jun 15 15:10:19.388175 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.388073 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.388945 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.388917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-web-config\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.389554 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.389223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.389554 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.389316 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.389554 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.389495 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.389554 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.389519 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.389797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.389717 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-out\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.390733 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.390697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.395177 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.395149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkgfb\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-kube-api-access-kkgfb\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.607376 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.607329 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6c4w" event={"ID":"98b52f65-e0f5-496e-923d-14eab776672c","Type":"ContainerStarted","Data":"2b7e9e0b765f25c9b26dc189aedce7ceb785c4f6b6a66dc4230070d4c9f89abb"} Jun 15 15:10:19.891418 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.891322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:19.894986 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:19.894922 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:20.083782 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:20.083749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:10:20.243544 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:20.243485 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:10:20.293208 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:20.293153 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a12eac_f22c_4ae0_8a24_b1f714d93354.slice/crio-cb9b1e52dd425fafcf1d1bd61ff14a170ce1081f15031579acb97b4fff4dab1f WatchSource:0}: Error finding container cb9b1e52dd425fafcf1d1bd61ff14a170ce1081f15031579acb97b4fff4dab1f: Status 404 returned error can't find the container with id cb9b1e52dd425fafcf1d1bd61ff14a170ce1081f15031579acb97b4fff4dab1f Jun 15 15:10:20.612509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:20.612470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerStarted","Data":"cb9b1e52dd425fafcf1d1bd61ff14a170ce1081f15031579acb97b4fff4dab1f"} Jun 15 15:10:20.614363 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:20.614330 2567 generic.go:356] "Generic (PLEG): container finished" podID="98b52f65-e0f5-496e-923d-14eab776672c" containerID="bb854baf28d5962e31db28d06864f1f541ce22a7bbdd47b19be02bdbbec9dfd9" exitCode=0 Jun 15 15:10:20.614519 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:20.614433 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6c4w" event={"ID":"98b52f65-e0f5-496e-923d-14eab776672c","Type":"ContainerDied","Data":"bb854baf28d5962e31db28d06864f1f541ce22a7bbdd47b19be02bdbbec9dfd9"} Jun 15 15:10:21.560512 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:21.559969 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" podUID="9ca2e330-7167-4c19-9873-d08f1f2f4989" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 15:10:21.620622 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:21.620379 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dfb4dbc-s92rc" event={"ID":"543b217f-eecc-44a2-a9b7-45fe10f0b1fe","Type":"ContainerStarted","Data":"6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12"} Jun 15 15:10:21.623633 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:21.623456 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6c4w" event={"ID":"98b52f65-e0f5-496e-923d-14eab776672c","Type":"ContainerStarted","Data":"18a13aa3726a9e4f29c9890c179ed704026da1acc8cd7e3e81eabaf19023a952"} Jun 15 15:10:21.639504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:21.639444 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687dfb4dbc-s92rc" podStartSLOduration=1.180808434 podStartE2EDuration="4.639421569s" totalImagesPullingTime="3.458613135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:21.638338822 +0000 UTC m=+220.297292522" watchObservedRunningTime="2026-06-15 15:10:21.639421569 +0000 UTC m=+220.298375273" Jun 15 15:10:22.398820 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.398779 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-669657c594-lc2mj"] Jun 15 15:10:22.401083 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.401049 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.404639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.404406 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 15 15:10:22.404639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.404427 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 15:10:22.404639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.404428 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 15 15:10:22.404639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.404484 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pflrt\"" Jun 15 15:10:22.404639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.404435 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 15 15:10:22.404639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.404416 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dtt3tr687oo44\"" Jun 15 15:10:22.411947 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.411912 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669657c594-lc2mj"] Jun 15 15:10:22.520217 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.520167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-secret-metrics-server-client-certs\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.520217 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.520219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6da38f2a-9db0-4ec2-9e37-f188202667d9-audit-log\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.520459 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.520255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da38f2a-9db0-4ec2-9e37-f188202667d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.520459 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.520329 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-client-ca-bundle\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.520459 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.520379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-secret-metrics-server-tls\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.520459 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.520457 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqdxm\" (UniqueName: \"kubernetes.io/projected/6da38f2a-9db0-4ec2-9e37-f188202667d9-kube-api-access-gqdxm\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.520631 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.520493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6da38f2a-9db0-4ec2-9e37-f188202667d9-metrics-server-audit-profiles\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.621366 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.621330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-client-ca-bundle\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.621366 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.621374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-secret-metrics-server-tls\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.621938 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.621455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqdxm\" (UniqueName: \"kubernetes.io/projected/6da38f2a-9db0-4ec2-9e37-f188202667d9-kube-api-access-gqdxm\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.621938 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.621488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6da38f2a-9db0-4ec2-9e37-f188202667d9-metrics-server-audit-profiles\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.621938 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.621523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-secret-metrics-server-client-certs\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.621938 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.621550 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6da38f2a-9db0-4ec2-9e37-f188202667d9-audit-log\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.621938 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.621579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da38f2a-9db0-4ec2-9e37-f188202667d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.622504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.622468 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da38f2a-9db0-4ec2-9e37-f188202667d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.622713 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.622687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6da38f2a-9db0-4ec2-9e37-f188202667d9-audit-log\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.623407 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.623380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6da38f2a-9db0-4ec2-9e37-f188202667d9-metrics-server-audit-profiles\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.624575 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.624550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-secret-metrics-server-tls\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.624682 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.624602 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-secret-metrics-server-client-certs\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.624743 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.624719 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6da38f2a-9db0-4ec2-9e37-f188202667d9-client-ca-bundle\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.628896 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.628862 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerID="9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6" exitCode=0 Jun 15 15:10:22.629045 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.628945 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerDied","Data":"9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6"} Jun 15 15:10:22.630389 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.630366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqdxm\" (UniqueName: \"kubernetes.io/projected/6da38f2a-9db0-4ec2-9e37-f188202667d9-kube-api-access-gqdxm\") pod \"metrics-server-669657c594-lc2mj\" (UID: \"6da38f2a-9db0-4ec2-9e37-f188202667d9\") " pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.632227 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.632084 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6c4w" event={"ID":"98b52f65-e0f5-496e-923d-14eab776672c","Type":"ContainerStarted","Data":"c4600bf61e5d193eacc84221123e5e0d5138d8b7f6eaf24305326e9333f89564"} Jun 15 15:10:22.670202 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.670136 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q6c4w" podStartSLOduration=3.586538328 podStartE2EDuration="4.670100446s" totalImagesPullingTime="986.625837ms" totalInitContainerRuntime="96.936281ms" isStatefulPod=true podCreationTimestamp="2026-06-15 15:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:22.669497678 +0000 UTC m=+221.328451425" watchObservedRunningTime="2026-06-15 15:10:22.670100446 +0000 UTC m=+221.329054124" Jun 15 15:10:22.712845 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.712807 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:22.872551 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.872516 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669657c594-lc2mj"] Jun 15 15:10:22.875917 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:22.875888 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da38f2a_9db0_4ec2_9e37_f188202667d9.slice/crio-b63879066ee3b1d6ff4d387cf1f85e22771a963a0371720ce10d587fdaebd10d WatchSource:0}: Error finding container b63879066ee3b1d6ff4d387cf1f85e22771a963a0371720ce10d587fdaebd10d: Status 404 returned error can't find the container with id b63879066ee3b1d6ff4d387cf1f85e22771a963a0371720ce10d587fdaebd10d Jun 15 15:10:22.879072 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.879044 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5"] Jun 15 15:10:22.882054 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.882032 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:22.884307 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.884284 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 15 15:10:22.884471 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.884337 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8cw97\"" Jun 15 15:10:22.893624 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:22.893597 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5"] Jun 15 15:10:23.025023 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:23.024938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a09ceceb-a955-461c-a028-8e320fc001b8-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-qxzk5\" (UID: \"a09ceceb-a955-461c-a028-8e320fc001b8\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:23.025216 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:23.025062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jcrd\" (UniqueName: \"kubernetes.io/projected/a09ceceb-a955-461c-a028-8e320fc001b8-kube-api-access-5jcrd\") pod \"monitoring-plugin-589576dfc7-qxzk5\" (UID: \"a09ceceb-a955-461c-a028-8e320fc001b8\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:23.126110 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:23.126063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a09ceceb-a955-461c-a028-8e320fc001b8-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-qxzk5\" (UID: \"a09ceceb-a955-461c-a028-8e320fc001b8\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:23.126335 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:23.126196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jcrd\" (UniqueName: \"kubernetes.io/projected/a09ceceb-a955-461c-a028-8e320fc001b8-kube-api-access-5jcrd\") pod \"monitoring-plugin-589576dfc7-qxzk5\" (UID: \"a09ceceb-a955-461c-a028-8e320fc001b8\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:23.129253 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:23.129225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a09ceceb-a955-461c-a028-8e320fc001b8-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-qxzk5\" (UID: \"a09ceceb-a955-461c-a028-8e320fc001b8\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:23.136362 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:23.136331 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jcrd\" (UniqueName: \"kubernetes.io/projected/a09ceceb-a955-461c-a028-8e320fc001b8-kube-api-access-5jcrd\") pod \"monitoring-plugin-589576dfc7-qxzk5\" (UID: \"a09ceceb-a955-461c-a028-8e320fc001b8\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:23.195147 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:23.195100 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:23.638562 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:23.638529 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" event={"ID":"6da38f2a-9db0-4ec2-9e37-f188202667d9","Type":"ContainerStarted","Data":"b63879066ee3b1d6ff4d387cf1f85e22771a963a0371720ce10d587fdaebd10d"} Jun 15 15:10:24.277719 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.277681 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:10:24.280905 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.280877 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.284017 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.283720 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 15:10:24.284017 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.283741 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5fhg8\"" Jun 15 15:10:24.284017 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.283810 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 15:10:24.284017 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.283841 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c7bu3t3bhsd8h\"" Jun 15 15:10:24.284017 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.283856 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 15:10:24.284401 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.284332 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 15:10:24.284401 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.284332 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 15:10:24.284401 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.284371 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 15:10:24.284401 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.284392 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 15:10:24.284596 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.284547 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 15:10:24.284971 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.284950 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 15:10:24.285079 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.284949 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 15:10:24.285167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.285133 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 15:10:24.285287 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.285269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 15:10:24.287779 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.287754 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 15:10:24.291210 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.291187 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 15:10:24.298621 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.298591 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:10:24.439010 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.438977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439010 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439282 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439282 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439282 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439282 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439282 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-config\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439282 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8k7n\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-kube-api-access-d8k7n\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439490 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-web-config\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-config-out\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439923 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439923 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439642 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.439923 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.439685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.540382 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.540382 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-config\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.540382 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540385 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.540664 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.540664 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.540664 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8k7n\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-kube-api-access-d8k7n\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.540664 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.540664 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541572 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-web-config\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541572 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.540999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541572 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541572 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541526 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541664 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-config-out\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541860 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.541875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.542288 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.542288 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.542288 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.541959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.543357 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.542524 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.543357 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.543244 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.543780 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.543639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.544003 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.543976 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.544077 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.544017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.544220 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.544197 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.544294 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.544272 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.544618 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.544592 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-config-out\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.545241 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.545165 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.545649 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.545610 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-config\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.546967 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.546914 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.547068 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.547028 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.547389 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.547370 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.547590 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.547569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.548076 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.548051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.548076 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.548069 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-web-config\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.549898 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.549871 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8k7n\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-kube-api-access-d8k7n\") pod \"prometheus-k8s-0\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:24.593773 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:24.593726 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:27.884400 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:27.884357 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:27.884853 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:27.884426 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:10:27.886011 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:27.885986 2567 patch_prober.go:28] interesting pod/console-687dfb4dbc-s92rc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 15 15:10:27.886160 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:27.886030 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-687dfb4dbc-s92rc" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 15 15:10:30.152999 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.152971 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:10:30.153556 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:30.153516 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718fba08_70de_428d_a670_5990522fb022.slice/crio-b1fd537caa392e855c1e376b6317a6caddbd1225180db79fc8f1bc7f0a0bfae3 WatchSource:0}: Error finding container b1fd537caa392e855c1e376b6317a6caddbd1225180db79fc8f1bc7f0a0bfae3: Status 404 returned error can't find the container with id b1fd537caa392e855c1e376b6317a6caddbd1225180db79fc8f1bc7f0a0bfae3 Jun 15 15:10:30.156478 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.156455 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5"] Jun 15 15:10:30.159744 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:30.159681 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09ceceb_a955_461c_a028_8e320fc001b8.slice/crio-d1ceec9bcfdc0d23b8db4247bb5c6b3e3d42c77d8069e4bc1c4ea0a5fc19dfc7 WatchSource:0}: Error finding container d1ceec9bcfdc0d23b8db4247bb5c6b3e3d42c77d8069e4bc1c4ea0a5fc19dfc7: Status 404 returned error can't find the container with id d1ceec9bcfdc0d23b8db4247bb5c6b3e3d42c77d8069e4bc1c4ea0a5fc19dfc7 Jun 15 15:10:30.666811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.666769 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-26xjd" event={"ID":"e2302079-56c0-4b22-9d65-0360dd2884be","Type":"ContainerStarted","Data":"646756d58cfa601bb880386634f49ed59d87f61dd260340bf58f12e147800524"} Jun 15 15:10:30.667095 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.667052 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-26xjd" Jun 15 15:10:30.669063 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.669020 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" event={"ID":"a09ceceb-a955-461c-a028-8e320fc001b8","Type":"ContainerStarted","Data":"d1ceec9bcfdc0d23b8db4247bb5c6b3e3d42c77d8069e4bc1c4ea0a5fc19dfc7"} Jun 15 15:10:30.670920 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.670895 2567 generic.go:356] "Generic (PLEG): container finished" podID="718fba08-70de-428d-a670-5990522fb022" containerID="6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14" exitCode=0 Jun 15 15:10:30.671037 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.670935 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerDied","Data":"6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14"} Jun 15 15:10:30.671037 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.670997 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerStarted","Data":"b1fd537caa392e855c1e376b6317a6caddbd1225180db79fc8f1bc7f0a0bfae3"} Jun 15 15:10:30.679181 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.679156 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-26xjd" Jun 15 15:10:30.684599 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:30.684459 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-26xjd" podStartSLOduration=2.010847928 podStartE2EDuration="20.684309748s" totalImagesPullingTime="18.67346182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:30.683309175 +0000 UTC m=+229.342262904" watchObservedRunningTime="2026-06-15 15:10:30.684309748 +0000 UTC m=+229.343263448" Jun 15 15:10:31.558762 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:31.558715 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" podUID="9ca2e330-7167-4c19-9873-d08f1f2f4989" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 15:10:33.695483 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:33.694829 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerStarted","Data":"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb"} Jun 15 15:10:33.701052 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:33.701003 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" event={"ID":"6da38f2a-9db0-4ec2-9e37-f188202667d9","Type":"ContainerStarted","Data":"648d1902532b0af0f8030f970dce7794119a9a59fdd950815945b170d67e7c25"} Jun 15 15:10:33.707755 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:33.706630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" event={"ID":"a09ceceb-a955-461c-a028-8e320fc001b8","Type":"ContainerStarted","Data":"45e88ce799dde400aaae1a1e8ce8918adecaf74518b738f7a700d8c149f37e17"} Jun 15 15:10:33.707755 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:33.707600 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:33.717616 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:33.717590 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" Jun 15 15:10:33.720103 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:33.719830 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" podStartSLOduration=1.166808923 podStartE2EDuration="11.719807587s" totalImagesPullingTime="10.552998664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:33.717829811 +0000 UTC m=+232.376783529" watchObservedRunningTime="2026-06-15 15:10:33.719807587 +0000 UTC m=+232.378761290" Jun 15 15:10:33.733393 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:33.732680 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qxzk5" podStartSLOduration=8.46726853 podStartE2EDuration="11.732656612s" totalImagesPullingTime="3.265388082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:33.732305784 +0000 UTC m=+232.391259508" watchObservedRunningTime="2026-06-15 15:10:33.732656612 +0000 UTC m=+232.391610314" Jun 15 15:10:34.716353 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:34.716208 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerStarted","Data":"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1"} Jun 15 15:10:34.716843 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:34.716333 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerStarted","Data":"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23"} Jun 15 15:10:34.716958 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:34.716886 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerStarted","Data":"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4"} Jun 15 15:10:34.716958 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:34.716934 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerStarted","Data":"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78"} Jun 15 15:10:36.727845 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:36.727802 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerStarted","Data":"906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576"} Jun 15 15:10:36.728370 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:36.727876 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerStarted","Data":"85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35"} Jun 15 15:10:37.739224 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:37.739166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerStarted","Data":"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c"} Jun 15 15:10:37.766993 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:37.766930 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.32047019 podStartE2EDuration="18.766855734s" totalImagesPullingTime="15.426837493s" totalInitContainerRuntime="19.548051ms" isStatefulPod=false podCreationTimestamp="2026-06-15 15:10:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:37.7643625 +0000 UTC m=+236.423316255" watchObservedRunningTime="2026-06-15 15:10:37.766855734 +0000 UTC m=+236.425809439" Jun 15 15:10:37.885387 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:37.885347 2567 patch_prober.go:28] interesting pod/console-687dfb4dbc-s92rc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 15 15:10:37.885728 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:37.885414 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-687dfb4dbc-s92rc" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 15 15:10:39.752941 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:39.752843 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerStarted","Data":"b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1"} Jun 15 15:10:39.753474 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:39.752963 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerStarted","Data":"a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e"} Jun 15 15:10:39.753474 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:39.753011 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerStarted","Data":"81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3"} Jun 15 15:10:39.753474 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:39.753049 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerStarted","Data":"e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3"} Jun 15 15:10:39.781072 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:39.781003 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.744331247 podStartE2EDuration="15.780975734s" totalImagesPullingTime="8.013256028s" totalInitContainerRuntime="23.388459ms" isStatefulPod=false podCreationTimestamp="2026-06-15 15:10:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:39.778601427 +0000 UTC m=+238.437555181" watchObservedRunningTime="2026-06-15 15:10:39.780975734 +0000 UTC m=+238.439929437" Jun 15 15:10:41.558300 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:41.558258 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" podUID="9ca2e330-7167-4c19-9873-d08f1f2f4989" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 15:10:41.558677 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:41.558330 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" Jun 15 15:10:41.558910 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:41.558872 2567 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b05e06900f8fb1506a7b7156f272311f1b8addb1dbecc47d54a5eb8ef0bba478"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 15 15:10:41.558988 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:41.558936 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" podUID="9ca2e330-7167-4c19-9873-d08f1f2f4989" containerName="service-proxy" containerID="cri-o://b05e06900f8fb1506a7b7156f272311f1b8addb1dbecc47d54a5eb8ef0bba478" gracePeriod=30 Jun 15 15:10:41.762490 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:41.762459 2567 generic.go:356] "Generic (PLEG): container finished" podID="9ca2e330-7167-4c19-9873-d08f1f2f4989" containerID="b05e06900f8fb1506a7b7156f272311f1b8addb1dbecc47d54a5eb8ef0bba478" exitCode=2 Jun 15 15:10:41.762659 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:41.762536 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" event={"ID":"9ca2e330-7167-4c19-9873-d08f1f2f4989","Type":"ContainerDied","Data":"b05e06900f8fb1506a7b7156f272311f1b8addb1dbecc47d54a5eb8ef0bba478"} Jun 15 15:10:42.713449 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:42.713403 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:42.713836 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:42.713510 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:10:42.768602 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:42.768561 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855b76d748-5qt7j" event={"ID":"9ca2e330-7167-4c19-9873-d08f1f2f4989","Type":"ContainerStarted","Data":"629ad960b12ba5c1cb348f03adcec8223aa27f356546a1192962c2ac3f1cef7a"} Jun 15 15:10:44.594492 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:44.594444 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:10:47.885344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:47.885310 2567 patch_prober.go:28] interesting pod/console-687dfb4dbc-s92rc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 15 15:10:47.885733 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:47.885358 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-687dfb4dbc-s92rc" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 15 15:10:53.639815 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:53.639712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:10:53.642336 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:53.642308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d11743e-081e-4d7d-8cf1-674fec0019a8-metrics-certs\") pod \"network-metrics-daemon-98xgq\" (UID: \"6d11743e-081e-4d7d-8cf1-674fec0019a8\") " pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:10:53.838850 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:53.838806 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlxbz\"" Jun 15 15:10:53.845931 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:53.845907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-98xgq" Jun 15 15:10:53.994289 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:53.994241 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-98xgq"] Jun 15 15:10:53.997063 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:10:53.997032 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d11743e_081e_4d7d_8cf1_674fec0019a8.slice/crio-d75cd32303c2c6f01f4aedd3e6fb7c9570846ad09dd18dbf1c482b2b9936090c WatchSource:0}: Error finding container d75cd32303c2c6f01f4aedd3e6fb7c9570846ad09dd18dbf1c482b2b9936090c: Status 404 returned error can't find the container with id d75cd32303c2c6f01f4aedd3e6fb7c9570846ad09dd18dbf1c482b2b9936090c Jun 15 15:10:54.813321 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:54.813288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-98xgq" event={"ID":"6d11743e-081e-4d7d-8cf1-674fec0019a8","Type":"ContainerStarted","Data":"d75cd32303c2c6f01f4aedd3e6fb7c9570846ad09dd18dbf1c482b2b9936090c"} Jun 15 15:10:55.818525 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:55.818486 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-98xgq" event={"ID":"6d11743e-081e-4d7d-8cf1-674fec0019a8","Type":"ContainerStarted","Data":"1939fd0caae3a610c749c8782f8cabbcfde8af0e1bc323b9bcfac55516975d72"} Jun 15 15:10:55.819001 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:55.818577 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-98xgq" event={"ID":"6d11743e-081e-4d7d-8cf1-674fec0019a8","Type":"ContainerStarted","Data":"2a8b141b9cc5c1d300cd4a2a25bee65f8a2f5a3c863bf58062f1466e75d980ed"} Jun 15 15:10:55.835640 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:55.835579 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-98xgq" podStartSLOduration=252.388959213 podStartE2EDuration="4m13.835561076s" totalImagesPullingTime="1.446601863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:10:55.833186987 +0000 UTC m=+254.492140702" watchObservedRunningTime="2026-06-15 15:10:55.835561076 +0000 UTC m=+254.494514774" Jun 15 15:10:57.885270 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:57.885236 2567 patch_prober.go:28] interesting pod/console-687dfb4dbc-s92rc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 15 15:10:57.885659 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:10:57.885288 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-687dfb4dbc-s92rc" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 15 15:11:02.718511 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:02.718481 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:11:02.722481 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:02.722455 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-669657c594-lc2mj" Jun 15 15:11:07.884333 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:07.884298 2567 patch_prober.go:28] interesting pod/console-687dfb4dbc-s92rc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 15 15:11:07.884723 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:07.884361 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-687dfb4dbc-s92rc" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 15 15:11:16.545530 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:16.545484 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687dfb4dbc-s92rc"] Jun 15 15:11:24.411964 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:24.411923 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qc99f" podUID="241e1504-b585-4f67-9b5d-f62ec6ad02b7" Jun 15 15:11:24.594784 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:24.594745 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:24.615422 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:24.615394 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:24.931133 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:24.931096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qc99f" Jun 15 15:11:24.947700 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:24.947674 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:24.986892 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:24.986858 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sdklf_9324414c-0a51-46e7-8345-0b7342d71197/dns-node-resolver/0.log" Jun 15 15:11:25.386976 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:25.386944 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-67kdg_8e238c45-ed86-46d2-b94a-9746d23687b5/serve-healthcheck-canary/0.log" Jun 15 15:11:27.745704 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:27.745661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:11:27.748228 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:27.748194 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/241e1504-b585-4f67-9b5d-f62ec6ad02b7-metrics-tls\") pod \"dns-default-qc99f\" (UID: \"241e1504-b585-4f67-9b5d-f62ec6ad02b7\") " pod="openshift-dns/dns-default-qc99f" Jun 15 15:11:27.934572 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:27.934541 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lvt5t\"" Jun 15 15:11:27.942014 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:27.941985 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qc99f" Jun 15 15:11:28.079499 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:28.079473 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qc99f"] Jun 15 15:11:28.081994 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:11:28.081967 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241e1504_b585_4f67_9b5d_f62ec6ad02b7.slice/crio-7e41af9ffc20c2835d34656257d652d76561cf616a3dc636eaec6a39f4c638d4 WatchSource:0}: Error finding container 7e41af9ffc20c2835d34656257d652d76561cf616a3dc636eaec6a39f4c638d4: Status 404 returned error can't find the container with id 7e41af9ffc20c2835d34656257d652d76561cf616a3dc636eaec6a39f4c638d4 Jun 15 15:11:28.948973 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:28.948936 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qc99f" event={"ID":"241e1504-b585-4f67-9b5d-f62ec6ad02b7","Type":"ContainerStarted","Data":"7e41af9ffc20c2835d34656257d652d76561cf616a3dc636eaec6a39f4c638d4"} Jun 15 15:11:29.955710 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:29.955618 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qc99f" event={"ID":"241e1504-b585-4f67-9b5d-f62ec6ad02b7","Type":"ContainerStarted","Data":"c3d111aafa5cc4903c5421533fe0e7fc9d59670027a4f03a2927467f3564dd3c"} Jun 15 15:11:29.955710 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:29.955674 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qc99f" event={"ID":"241e1504-b585-4f67-9b5d-f62ec6ad02b7","Type":"ContainerStarted","Data":"fb36310ae4db201104bde38171a0a20acdadd6ae44487cea86dd3ed4e74b12d8"} Jun 15 15:11:29.956282 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:29.955714 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qc99f" Jun 15 15:11:29.974258 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:29.974190 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qc99f" podStartSLOduration=251.446178248 podStartE2EDuration="4m12.974169429s" totalImagesPullingTime="1.527991181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:11:29.972763777 +0000 UTC m=+288.631717507" watchObservedRunningTime="2026-06-15 15:11:29.974169429 +0000 UTC m=+288.633123129" Jun 15 15:11:38.372077 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:38.372036 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:11:38.372529 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:38.372360 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="alertmanager" containerID="cri-o://5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb" gracePeriod=120 Jun 15 15:11:38.372529 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:38.372456 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="prom-label-proxy" containerID="cri-o://3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c" gracePeriod=120 Jun 15 15:11:38.372529 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:38.372490 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy-web" containerID="cri-o://a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4" gracePeriod=120 Jun 15 15:11:38.372688 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:38.372507 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="config-reloader" containerID="cri-o://2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78" gracePeriod=120 Jun 15 15:11:38.372688 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:38.372531 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy" containerID="cri-o://4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23" gracePeriod=120 Jun 15 15:11:38.372688 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:38.372439 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy-metric" containerID="cri-o://5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1" gracePeriod=120 Jun 15 15:11:39.002410 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.002365 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerID="3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c" exitCode=0 Jun 15 15:11:39.002410 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.002407 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerID="4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23" exitCode=0 Jun 15 15:11:39.002658 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.002420 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerID="2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78" exitCode=0 Jun 15 15:11:39.002658 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.002438 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerID="5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb" exitCode=0 Jun 15 15:11:39.002658 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.002488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerDied","Data":"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c"} Jun 15 15:11:39.002658 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.002605 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerDied","Data":"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23"} Jun 15 15:11:39.002839 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.002693 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerDied","Data":"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78"} Jun 15 15:11:39.002839 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.002754 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerDied","Data":"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb"} Jun 15 15:11:39.617354 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.617327 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:39.750700 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750662 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-tls-assets\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.750859 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750713 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-cluster-tls-config\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.750859 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750744 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-web\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.750859 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750788 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-trusted-ca-bundle\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.750859 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750819 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkgfb\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-kube-api-access-kkgfb\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.750859 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750854 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.751099 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750900 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-out\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.751099 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750925 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.751099 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.750966 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.751099 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.751037 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-volume\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.751099 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.751067 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-main-db\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.751099 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.751090 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-web-config\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.751435 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.751166 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-metrics-client-ca\") pod \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\" (UID: \"d0a12eac-f22c-4ae0-8a24-b1f714d93354\") " Jun 15 15:11:39.751435 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.751275 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:39.751554 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.751468 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.751810 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.751764 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:39.752351 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.752095 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 15:11:39.753620 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.753497 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:11:39.753737 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.753644 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:39.753737 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.753682 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:39.754580 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.754550 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-kube-api-access-kkgfb" (OuterVolumeSpecName: "kube-api-access-kkgfb") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "kube-api-access-kkgfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:11:39.755098 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.755071 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-volume" (OuterVolumeSpecName: "config-volume") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:39.755245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.755143 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-out" (OuterVolumeSpecName: "config-out") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 15:11:39.755666 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.755641 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:39.755962 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.755941 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:39.758711 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.758687 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:39.765537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.765510 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-web-config" (OuterVolumeSpecName: "web-config") pod "d0a12eac-f22c-4ae0-8a24-b1f714d93354" (UID: "d0a12eac-f22c-4ae0-8a24-b1f714d93354"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:39.852230 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852201 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-volume\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852230 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852229 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-alertmanager-main-db\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852259 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-web-config\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852268 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0a12eac-f22c-4ae0-8a24-b1f714d93354-metrics-client-ca\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852277 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-tls-assets\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852286 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-cluster-tls-config\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852294 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852304 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkgfb\" (UniqueName: \"kubernetes.io/projected/d0a12eac-f22c-4ae0-8a24-b1f714d93354-kube-api-access-kkgfb\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852313 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852322 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0a12eac-f22c-4ae0-8a24-b1f714d93354-config-out\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852330 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-main-tls\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.852388 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.852339 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0a12eac-f22c-4ae0-8a24-b1f714d93354-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:39.962390 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:39.962357 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qc99f" Jun 15 15:11:40.010414 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.010326 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerID="5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1" exitCode=0 Jun 15 15:11:40.010414 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.010353 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerID="a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4" exitCode=0 Jun 15 15:11:40.010414 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.010377 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerDied","Data":"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1"} Jun 15 15:11:40.010414 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.010406 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.010644 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.010434 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerDied","Data":"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4"} Jun 15 15:11:40.010644 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.010470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0a12eac-f22c-4ae0-8a24-b1f714d93354","Type":"ContainerDied","Data":"cb9b1e52dd425fafcf1d1bd61ff14a170ce1081f15031579acb97b4fff4dab1f"} Jun 15 15:11:40.010644 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.010500 2567 scope.go:117] "RemoveContainer" containerID="3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c" Jun 15 15:11:40.019453 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.019425 2567 scope.go:117] "RemoveContainer" containerID="5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1" Jun 15 15:11:40.027028 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.027002 2567 scope.go:117] "RemoveContainer" containerID="4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23" Jun 15 15:11:40.030075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.030049 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:11:40.036014 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.035989 2567 scope.go:117] "RemoveContainer" containerID="a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4" Jun 15 15:11:40.036530 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.036507 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:11:40.043403 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.043384 2567 scope.go:117] "RemoveContainer" containerID="2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78" Jun 15 15:11:40.050679 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.050660 2567 scope.go:117] "RemoveContainer" containerID="5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb" Jun 15 15:11:40.058644 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.058626 2567 scope.go:117] "RemoveContainer" containerID="9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6" Jun 15 15:11:40.062213 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062191 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:11:40.062492 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062476 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy" Jun 15 15:11:40.062533 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062496 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy" Jun 15 15:11:40.062533 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062519 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy-metric" Jun 15 15:11:40.062533 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062530 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy-metric" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062547 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="init-config-reloader" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062553 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="init-config-reloader" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062561 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="prom-label-proxy" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062568 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="prom-label-proxy" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062577 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="config-reloader" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062582 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="config-reloader" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062589 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="alertmanager" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062594 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="alertmanager" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062601 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy-web" Jun 15 15:11:40.062615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062607 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy-web" Jun 15 15:11:40.062886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062669 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy-web" Jun 15 15:11:40.062886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062684 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="alertmanager" Jun 15 15:11:40.062886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062692 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy" Jun 15 15:11:40.062886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062698 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="kube-rbac-proxy-metric" Jun 15 15:11:40.062886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062703 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="config-reloader" Jun 15 15:11:40.062886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.062708 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" containerName="prom-label-proxy" Jun 15 15:11:40.066525 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.066504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.066843 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.066818 2567 scope.go:117] "RemoveContainer" containerID="3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c" Jun 15 15:11:40.067243 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:40.067220 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c\": container with ID starting with 3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c not found: ID does not exist" containerID="3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c" Jun 15 15:11:40.067328 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.067252 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c"} err="failed to get container status \"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c\": rpc error: code = NotFound desc = could not find container \"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c\": container with ID starting with 3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c not found: ID does not exist" Jun 15 15:11:40.067328 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.067272 2567 scope.go:117] "RemoveContainer" containerID="5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1" Jun 15 15:11:40.067568 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:40.067544 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1\": container with ID starting with 5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1 not found: ID does not exist" containerID="5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1" Jun 15 15:11:40.067649 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.067573 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1"} err="failed to get container status \"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1\": rpc error: code = NotFound desc = could not find container \"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1\": container with ID starting with 5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1 not found: ID does not exist" Jun 15 15:11:40.067649 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.067592 2567 scope.go:117] "RemoveContainer" containerID="4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23" Jun 15 15:11:40.067852 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:40.067835 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23\": container with ID starting with 4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23 not found: ID does not exist" containerID="4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23" Jun 15 15:11:40.067894 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.067856 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23"} err="failed to get container status \"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23\": rpc error: code = NotFound desc = could not find container \"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23\": container with ID starting with 4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23 not found: ID does not exist" Jun 15 15:11:40.067894 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.067870 2567 scope.go:117] "RemoveContainer" containerID="a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4" Jun 15 15:11:40.068101 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:40.068084 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4\": container with ID starting with a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4 not found: ID does not exist" containerID="a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4" Jun 15 15:11:40.068261 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.068107 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4"} err="failed to get container status \"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4\": rpc error: code = NotFound desc = could not find container \"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4\": container with ID starting with a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4 not found: ID does not exist" Jun 15 15:11:40.068261 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.068149 2567 scope.go:117] "RemoveContainer" containerID="2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78" Jun 15 15:11:40.068426 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:40.068409 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78\": container with ID starting with 2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78 not found: ID does not exist" containerID="2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78" Jun 15 15:11:40.068476 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.068429 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78"} err="failed to get container status \"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78\": rpc error: code = NotFound desc = could not find container \"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78\": container with ID starting with 2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78 not found: ID does not exist" Jun 15 15:11:40.068476 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.068446 2567 scope.go:117] "RemoveContainer" containerID="5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb" Jun 15 15:11:40.068654 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:40.068637 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb\": container with ID starting with 5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb not found: ID does not exist" containerID="5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb" Jun 15 15:11:40.068692 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.068659 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb"} err="failed to get container status \"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb\": rpc error: code = NotFound desc = could not find container \"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb\": container with ID starting with 5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb not found: ID does not exist" Jun 15 15:11:40.068692 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.068673 2567 scope.go:117] "RemoveContainer" containerID="9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6" Jun 15 15:11:40.068963 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:40.068940 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6\": container with ID starting with 9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6 not found: ID does not exist" containerID="9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6" Jun 15 15:11:40.069056 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.068967 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6"} err="failed to get container status \"9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6\": rpc error: code = NotFound desc = could not find container \"9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6\": container with ID starting with 9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6 not found: ID does not exist" Jun 15 15:11:40.069056 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.068985 2567 scope.go:117] "RemoveContainer" containerID="3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c" Jun 15 15:11:40.069509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-58k5s\"" Jun 15 15:11:40.069509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069292 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c"} err="failed to get container status \"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c\": rpc error: code = NotFound desc = could not find container \"3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c\": container with ID starting with 3544fecfb97ef472b948794f09ff1c50217b380353ccdb6d1844e271f9b24e7c not found: ID does not exist" Jun 15 15:11:40.069509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069334 2567 scope.go:117] "RemoveContainer" containerID="5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1" Jun 15 15:11:40.069509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069341 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 15:11:40.069509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069398 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 15:11:40.069509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 15:11:40.069867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069631 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 15:11:40.069867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069709 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 15:11:40.069867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069783 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 15:11:40.069867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069786 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 15:11:40.069867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069804 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1"} err="failed to get container status \"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1\": rpc error: code = NotFound desc = could not find container \"5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1\": container with ID starting with 5af0376926322b6816a107146b94098d0363a3df044d5ea9e42b2eec1d7291a1 not found: ID does not exist" Jun 15 15:11:40.069867 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069832 2567 scope.go:117] "RemoveContainer" containerID="4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23" Jun 15 15:11:40.070152 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.069904 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 15:11:40.070152 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.070088 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23"} err="failed to get container status \"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23\": rpc error: code = NotFound desc = could not find container \"4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23\": container with ID starting with 4a4f8771b6c7c01f3adabf1547b69d42d15e8b6abf29c68487fc48df3510aa23 not found: ID does not exist" Jun 15 15:11:40.070152 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.070105 2567 scope.go:117] "RemoveContainer" containerID="a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4" Jun 15 15:11:40.070318 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.070299 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4"} err="failed to get container status \"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4\": rpc error: code = NotFound desc = could not find container \"a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4\": container with ID starting with a559f7c439ebb6d40993116a89b08d9988d2f772ca746aeef7f2e0de7a21a5f4 not found: ID does not exist" Jun 15 15:11:40.070369 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.070320 2567 scope.go:117] "RemoveContainer" containerID="2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78" Jun 15 15:11:40.070667 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.070643 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78"} err="failed to get container status \"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78\": rpc error: code = NotFound desc = could not find container \"2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78\": container with ID starting with 2b38f74d7b0ad41cd61547425ecdcf34eb98732abca83581cc49e4dd9f4a3b78 not found: ID does not exist" Jun 15 15:11:40.070778 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.070670 2567 scope.go:117] "RemoveContainer" containerID="5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb" Jun 15 15:11:40.070918 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.070893 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb"} err="failed to get container status \"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb\": rpc error: code = NotFound desc = could not find container \"5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb\": container with ID starting with 5670458082c27c061c3bf12734cd9060b50f321ee32504ac3aac740d4e2c69cb not found: ID does not exist" Jun 15 15:11:40.070981 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.070921 2567 scope.go:117] "RemoveContainer" containerID="9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6" Jun 15 15:11:40.071245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.071218 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6"} err="failed to get container status \"9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6\": rpc error: code = NotFound desc = could not find container \"9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6\": container with ID starting with 9cd0476113e3b4bb5e9cc236ba3b80c69235a765d7d1a3a161485e7ae0a39fa6 not found: ID does not exist" Jun 15 15:11:40.074837 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.074814 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 15:11:40.085141 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.085096 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:11:40.255583 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee35cce2-7c71-4563-a0ae-15fe79c63278-config-out\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.255583 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255586 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.255808 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255619 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbfsm\" (UniqueName: \"kubernetes.io/projected/ee35cce2-7c71-4563-a0ae-15fe79c63278-kube-api-access-qbfsm\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.255808 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.255808 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-web-config\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.255808 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255716 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.255808 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.255808 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.255808 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee35cce2-7c71-4563-a0ae-15fe79c63278-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.256105 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.256105 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255885 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee35cce2-7c71-4563-a0ae-15fe79c63278-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.256105 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee35cce2-7c71-4563-a0ae-15fe79c63278-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.256105 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.255970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee35cce2-7c71-4563-a0ae-15fe79c63278-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357448 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357448 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357417 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357448 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee35cce2-7c71-4563-a0ae-15fe79c63278-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357484 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee35cce2-7c71-4563-a0ae-15fe79c63278-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee35cce2-7c71-4563-a0ae-15fe79c63278-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee35cce2-7c71-4563-a0ae-15fe79c63278-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee35cce2-7c71-4563-a0ae-15fe79c63278-config-out\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357631 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbfsm\" (UniqueName: \"kubernetes.io/projected/ee35cce2-7c71-4563-a0ae-15fe79c63278-kube-api-access-qbfsm\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.357674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.358108 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-web-config\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.358108 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.357925 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee35cce2-7c71-4563-a0ae-15fe79c63278-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.358886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.358856 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee35cce2-7c71-4563-a0ae-15fe79c63278-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.360530 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.360492 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.360691 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.360669 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-web-config\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.360801 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.360777 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.360853 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.360793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.360898 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.360870 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.361350 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.361320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee35cce2-7c71-4563-a0ae-15fe79c63278-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.361575 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.361558 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.361728 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.361709 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee35cce2-7c71-4563-a0ae-15fe79c63278-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.362133 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.362095 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee35cce2-7c71-4563-a0ae-15fe79c63278-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.362635 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.362620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee35cce2-7c71-4563-a0ae-15fe79c63278-config-out\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.366649 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.366627 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbfsm\" (UniqueName: \"kubernetes.io/projected/ee35cce2-7c71-4563-a0ae-15fe79c63278-kube-api-access-qbfsm\") pod \"alertmanager-main-0\" (UID: \"ee35cce2-7c71-4563-a0ae-15fe79c63278\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.376636 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.376611 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 15:11:40.517802 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:40.517761 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 15:11:40.521479 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:11:40.521452 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee35cce2_7c71_4563_a0ae_15fe79c63278.slice/crio-a9408a32b62afdac8ea31ddc2a484f6558eafbd40520310afa71421d76ecc86f WatchSource:0}: Error finding container a9408a32b62afdac8ea31ddc2a484f6558eafbd40520310afa71421d76ecc86f: Status 404 returned error can't find the container with id a9408a32b62afdac8ea31ddc2a484f6558eafbd40520310afa71421d76ecc86f Jun 15 15:11:41.018137 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.018093 2567 generic.go:356] "Generic (PLEG): container finished" podID="ee35cce2-7c71-4563-a0ae-15fe79c63278" containerID="1f8edbee019ed79e86ecc73cb860fe944860c09f32316c9ff479a3471a4792bb" exitCode=0 Jun 15 15:11:41.018609 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.018155 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee35cce2-7c71-4563-a0ae-15fe79c63278","Type":"ContainerDied","Data":"1f8edbee019ed79e86ecc73cb860fe944860c09f32316c9ff479a3471a4792bb"} Jun 15 15:11:41.018609 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.018216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee35cce2-7c71-4563-a0ae-15fe79c63278","Type":"ContainerStarted","Data":"a9408a32b62afdac8ea31ddc2a484f6558eafbd40520310afa71421d76ecc86f"} Jun 15 15:11:41.566771 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.566677 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-687dfb4dbc-s92rc" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" containerID="cri-o://6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12" gracePeriod=15 Jun 15 15:11:41.781207 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.781178 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:11:41.782293 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.782270 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:11:41.786711 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.786687 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:11:41.788017 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.787995 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:11:41.792460 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.792442 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 15:11:41.820395 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.820336 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:11:41.842410 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.842281 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a12eac-f22c-4ae0-8a24-b1f714d93354" path="/var/lib/kubelet/pods/d0a12eac-f22c-4ae0-8a24-b1f714d93354/volumes" Jun 15 15:11:41.977099 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977066 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-service-ca\") pod \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " Jun 15 15:11:41.977311 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977110 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-serving-cert\") pod \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " Jun 15 15:11:41.977311 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977195 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-config\") pod \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " Jun 15 15:11:41.977311 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977238 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvj6p\" (UniqueName: \"kubernetes.io/projected/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-kube-api-access-lvj6p\") pod \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " Jun 15 15:11:41.977311 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977284 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-oauth-serving-cert\") pod \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " Jun 15 15:11:41.977514 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977330 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-oauth-config\") pod \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\" (UID: \"543b217f-eecc-44a2-a9b7-45fe10f0b1fe\") " Jun 15 15:11:41.977707 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977669 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "543b217f-eecc-44a2-a9b7-45fe10f0b1fe" (UID: "543b217f-eecc-44a2-a9b7-45fe10f0b1fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:41.977842 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977766 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-config" (OuterVolumeSpecName: "console-config") pod "543b217f-eecc-44a2-a9b7-45fe10f0b1fe" (UID: "543b217f-eecc-44a2-a9b7-45fe10f0b1fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:41.977842 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.977816 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "543b217f-eecc-44a2-a9b7-45fe10f0b1fe" (UID: "543b217f-eecc-44a2-a9b7-45fe10f0b1fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:41.979652 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.979630 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-kube-api-access-lvj6p" (OuterVolumeSpecName: "kube-api-access-lvj6p") pod "543b217f-eecc-44a2-a9b7-45fe10f0b1fe" (UID: "543b217f-eecc-44a2-a9b7-45fe10f0b1fe"). InnerVolumeSpecName "kube-api-access-lvj6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:11:41.979762 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.979674 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "543b217f-eecc-44a2-a9b7-45fe10f0b1fe" (UID: "543b217f-eecc-44a2-a9b7-45fe10f0b1fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:41.979762 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:41.979721 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "543b217f-eecc-44a2-a9b7-45fe10f0b1fe" (UID: "543b217f-eecc-44a2-a9b7-45fe10f0b1fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:42.023877 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.023842 2567 generic.go:356] "Generic (PLEG): container finished" podID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerID="6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12" exitCode=0 Jun 15 15:11:42.024375 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.023887 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dfb4dbc-s92rc" Jun 15 15:11:42.024375 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.023926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dfb4dbc-s92rc" event={"ID":"543b217f-eecc-44a2-a9b7-45fe10f0b1fe","Type":"ContainerDied","Data":"6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12"} Jun 15 15:11:42.024375 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.023979 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dfb4dbc-s92rc" event={"ID":"543b217f-eecc-44a2-a9b7-45fe10f0b1fe","Type":"ContainerDied","Data":"bb9daa738b2f3e15a42ecb0aa88f906e3811eb3dbb8a3c132f665f6b5a61e6df"} Jun 15 15:11:42.024375 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.024008 2567 scope.go:117] "RemoveContainer" containerID="6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12" Jun 15 15:11:42.028225 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.028191 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee35cce2-7c71-4563-a0ae-15fe79c63278","Type":"ContainerStarted","Data":"222fdd17da313154f94cc8fe64a9c5378e949ee2cae219945cb9de44bf5f579c"} Jun 15 15:11:42.028356 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.028264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee35cce2-7c71-4563-a0ae-15fe79c63278","Type":"ContainerStarted","Data":"d6b59ec62c97c838452c5feb44f8218e7a59a441bf2fbcfe6ba8c2cf819fbfe6"} Jun 15 15:11:42.028356 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.028306 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee35cce2-7c71-4563-a0ae-15fe79c63278","Type":"ContainerStarted","Data":"39d8019b6480e1bba902fd697460267316750ee2e2c62c0aa34064913b5bce16"} Jun 15 15:11:42.028356 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.028346 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee35cce2-7c71-4563-a0ae-15fe79c63278","Type":"ContainerStarted","Data":"8d750b92c1fb72c5e87a88193d4ae06c4a414fdad14db98442a70111ac797c7b"} Jun 15 15:11:42.028504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.028389 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee35cce2-7c71-4563-a0ae-15fe79c63278","Type":"ContainerStarted","Data":"29dc140e8c65bfdd761e83c926f6f5e4d628ef378fb52caa535331f5c1cd8102"} Jun 15 15:11:42.028504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.028429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee35cce2-7c71-4563-a0ae-15fe79c63278","Type":"ContainerStarted","Data":"cf4e12137685ea61be377b420a239e159a6ebf4424364fe13178f413ecd2d3fb"} Jun 15 15:11:42.033671 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.033534 2567 scope.go:117] "RemoveContainer" containerID="6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12" Jun 15 15:11:42.034051 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:42.034025 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12\": container with ID starting with 6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12 not found: ID does not exist" containerID="6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12" Jun 15 15:11:42.034183 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.034066 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12"} err="failed to get container status \"6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12\": rpc error: code = NotFound desc = could not find container \"6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12\": container with ID starting with 6bf21041723d2fee04110e2d9a80993c8e08678825c2379838a01bbe15125b12 not found: ID does not exist" Jun 15 15:11:42.056015 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.055956 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.038568549 podStartE2EDuration="2.055939918s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.371369ms" isStatefulPod=false podCreationTimestamp="2026-06-15 15:11:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:11:42.054457037 +0000 UTC m=+300.713410747" watchObservedRunningTime="2026-06-15 15:11:42.055939918 +0000 UTC m=+300.714893631" Jun 15 15:11:42.069281 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.069246 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687dfb4dbc-s92rc"] Jun 15 15:11:42.076994 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.076919 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687dfb4dbc-s92rc"] Jun 15 15:11:42.078915 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.078880 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-config\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:42.079075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.078923 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvj6p\" (UniqueName: \"kubernetes.io/projected/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-kube-api-access-lvj6p\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:42.079075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.078940 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-oauth-serving-cert\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:42.079075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.078954 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-oauth-config\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:42.079075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.078968 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-service-ca\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:42.079075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.078981 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543b217f-eecc-44a2-a9b7-45fe10f0b1fe-console-serving-cert\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:42.683192 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.683152 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:11:42.683533 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.683505 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="prometheus" containerID="cri-o://85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35" gracePeriod=600 Jun 15 15:11:42.683638 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.683569 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1" gracePeriod=600 Jun 15 15:11:42.683638 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.683621 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy" containerID="cri-o://a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e" gracePeriod=600 Jun 15 15:11:42.683745 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.683646 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="config-reloader" containerID="cri-o://906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576" gracePeriod=600 Jun 15 15:11:42.683745 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.683600 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy-web" containerID="cri-o://81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3" gracePeriod=600 Jun 15 15:11:42.683848 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:42.683603 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="thanos-sidecar" containerID="cri-o://e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3" gracePeriod=600 Jun 15 15:11:43.036486 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036448 2567 generic.go:356] "Generic (PLEG): container finished" podID="718fba08-70de-428d-a670-5990522fb022" containerID="b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1" exitCode=0 Jun 15 15:11:43.036486 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036482 2567 generic.go:356] "Generic (PLEG): container finished" podID="718fba08-70de-428d-a670-5990522fb022" containerID="a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e" exitCode=0 Jun 15 15:11:43.036486 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036491 2567 generic.go:356] "Generic (PLEG): container finished" podID="718fba08-70de-428d-a670-5990522fb022" containerID="e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3" exitCode=0 Jun 15 15:11:43.036917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036499 2567 generic.go:356] "Generic (PLEG): container finished" podID="718fba08-70de-428d-a670-5990522fb022" containerID="906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576" exitCode=0 Jun 15 15:11:43.036917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036506 2567 generic.go:356] "Generic (PLEG): container finished" podID="718fba08-70de-428d-a670-5990522fb022" containerID="85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35" exitCode=0 Jun 15 15:11:43.036917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerDied","Data":"b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1"} Jun 15 15:11:43.036917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerDied","Data":"a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e"} Jun 15 15:11:43.036917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerDied","Data":"e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3"} Jun 15 15:11:43.036917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerDied","Data":"906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576"} Jun 15 15:11:43.036917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.036653 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerDied","Data":"85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35"} Jun 15 15:11:43.841030 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.840997 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" path="/var/lib/kubelet/pods/543b217f-eecc-44a2-a9b7-45fe10f0b1fe/volumes" Jun 15 15:11:43.921236 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.921212 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:43.990585 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990548 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-metrics-client-ca\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.990752 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990605 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.990752 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990639 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-1\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.990752 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990681 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-config-out\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.990752 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990706 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-2\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.990752 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990732 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-trusted-ca-bundle\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990767 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-metrics-client-certs\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990798 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8k7n\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-kube-api-access-d8k7n\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990822 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-kube-rbac-proxy\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990852 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-db\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990881 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-thanos-prometheus-http-client-file\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990916 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-grpc-tls\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990940 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-web-config\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991380 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.990983 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-tls\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991869 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991542 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991869 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991600 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-serving-certs-ca-bundle\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991869 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991634 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-0\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991869 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991660 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-tls-assets\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991869 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991686 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-kubelet-serving-ca-bundle\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.991869 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991718 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-config\") pod \"718fba08-70de-428d-a670-5990522fb022\" (UID: \"718fba08-70de-428d-a670-5990522fb022\") " Jun 15 15:11:43.992543 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991173 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:43.992804 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991211 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:43.992899 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991603 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:43.992982 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.991626 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:43.994423 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.994323 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:43.994598 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.994449 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 15:11:43.994667 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.994580 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:43.995005 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.994835 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-config-out" (OuterVolumeSpecName: "config-out") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 15:11:43.995005 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.994985 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:43.995589 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.995566 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-kube-api-access-d8k7n" (OuterVolumeSpecName: "kube-api-access-d8k7n") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "kube-api-access-d8k7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:11:43.995739 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.995604 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:43.995978 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.995952 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 15:11:43.996679 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.996637 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:43.996679 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.996670 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-config" (OuterVolumeSpecName: "config") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:43.996888 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.996763 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:43.997357 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.997330 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:43.997566 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.997538 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:43.997947 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.997926 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:43.998381 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:43.998358 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:11:44.008849 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.008819 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-web-config" (OuterVolumeSpecName: "web-config") pod "718fba08-70de-428d-a670-5990522fb022" (UID: "718fba08-70de-428d-a670-5990522fb022"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:11:44.044400 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.044312 2567 generic.go:356] "Generic (PLEG): container finished" podID="718fba08-70de-428d-a670-5990522fb022" containerID="81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3" exitCode=0 Jun 15 15:11:44.044400 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.044377 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerDied","Data":"81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3"} Jun 15 15:11:44.044794 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.044441 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.044794 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.044458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718fba08-70de-428d-a670-5990522fb022","Type":"ContainerDied","Data":"b1fd537caa392e855c1e376b6317a6caddbd1225180db79fc8f1bc7f0a0bfae3"} Jun 15 15:11:44.044794 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.044509 2567 scope.go:117] "RemoveContainer" containerID="b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1" Jun 15 15:11:44.053189 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.053171 2567 scope.go:117] "RemoveContainer" containerID="a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e" Jun 15 15:11:44.060779 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.060756 2567 scope.go:117] "RemoveContainer" containerID="81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3" Jun 15 15:11:44.070679 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.070556 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:11:44.070737 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.070704 2567 scope.go:117] "RemoveContainer" containerID="e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3" Jun 15 15:11:44.077808 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.077779 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:11:44.078341 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.078319 2567 scope.go:117] "RemoveContainer" containerID="906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576" Jun 15 15:11:44.086348 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.086326 2567 scope.go:117] "RemoveContainer" containerID="85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35" Jun 15 15:11:44.092963 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.092927 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.092963 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.092954 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-metrics-client-certs\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.092963 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.092965 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8k7n\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-kube-api-access-d8k7n\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.092974 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-kube-rbac-proxy\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.092983 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-db\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.092992 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093000 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-grpc-tls\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093008 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-web-config\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093015 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093025 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093034 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093044 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093053 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/718fba08-70de-428d-a670-5990522fb022-tls-assets\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093062 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093070 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-config\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093078 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-configmap-metrics-client-ca\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093086 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/718fba08-70de-428d-a670-5990522fb022-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093094 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093102 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/718fba08-70de-428d-a670-5990522fb022-config-out\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.093167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.093110 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/718fba08-70de-428d-a670-5990522fb022-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:11:44.094377 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.094356 2567 scope.go:117] "RemoveContainer" containerID="6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14" Jun 15 15:11:44.101543 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.101522 2567 scope.go:117] "RemoveContainer" containerID="b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1" Jun 15 15:11:44.101850 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:44.101830 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1\": container with ID starting with b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1 not found: ID does not exist" containerID="b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1" Jun 15 15:11:44.101913 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.101865 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1"} err="failed to get container status \"b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1\": rpc error: code = NotFound desc = could not find container \"b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1\": container with ID starting with b2dbddcf76e5707b8296203de01d89e2be3aa0c22fd490263cf2a3fcc6c023b1 not found: ID does not exist" Jun 15 15:11:44.101913 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.101889 2567 scope.go:117] "RemoveContainer" containerID="a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e" Jun 15 15:11:44.102168 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:44.102142 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e\": container with ID starting with a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e not found: ID does not exist" containerID="a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e" Jun 15 15:11:44.102255 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.102181 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e"} err="failed to get container status \"a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e\": rpc error: code = NotFound desc = could not find container \"a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e\": container with ID starting with a4841af384d0a262407e7387eee385ee362930d2a393feab225d4ca190e2917e not found: ID does not exist" Jun 15 15:11:44.102255 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.102205 2567 scope.go:117] "RemoveContainer" containerID="81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3" Jun 15 15:11:44.102570 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:44.102546 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3\": container with ID starting with 81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3 not found: ID does not exist" containerID="81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3" Jun 15 15:11:44.102639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.102578 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3"} err="failed to get container status \"81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3\": rpc error: code = NotFound desc = could not find container \"81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3\": container with ID starting with 81fa708ce495aba7c45c01f095cf6ddf84edc1833a5614b87bb6cab1dec6ead3 not found: ID does not exist" Jun 15 15:11:44.102639 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.102602 2567 scope.go:117] "RemoveContainer" containerID="e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3" Jun 15 15:11:44.102923 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:44.102900 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3\": container with ID starting with e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3 not found: ID does not exist" containerID="e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3" Jun 15 15:11:44.103102 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.103035 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3"} err="failed to get container status \"e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3\": rpc error: code = NotFound desc = could not find container \"e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3\": container with ID starting with e04f130ae1a3e53e2ddf96e47ee6904da0a7d90c9aa56c90a06f764106203fb3 not found: ID does not exist" Jun 15 15:11:44.103245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.103230 2567 scope.go:117] "RemoveContainer" containerID="906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576" Jun 15 15:11:44.103952 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:44.103708 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576\": container with ID starting with 906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576 not found: ID does not exist" containerID="906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576" Jun 15 15:11:44.103952 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.103742 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576"} err="failed to get container status \"906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576\": rpc error: code = NotFound desc = could not find container \"906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576\": container with ID starting with 906517e106482dda0ff613bc24055deaa3c334583da2ec9f179833b2f9376576 not found: ID does not exist" Jun 15 15:11:44.103952 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.103786 2567 scope.go:117] "RemoveContainer" containerID="85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35" Jun 15 15:11:44.104281 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:44.104225 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35\": container with ID starting with 85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35 not found: ID does not exist" containerID="85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35" Jun 15 15:11:44.104402 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.104280 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35"} err="failed to get container status \"85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35\": rpc error: code = NotFound desc = could not find container \"85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35\": container with ID starting with 85c6c3fd8632734227f81aae5b9c07d4574f8d670a2e4a96cb02b6f287b50c35 not found: ID does not exist" Jun 15 15:11:44.104402 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.104307 2567 scope.go:117] "RemoveContainer" containerID="6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14" Jun 15 15:11:44.104623 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:11:44.104577 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14\": container with ID starting with 6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14 not found: ID does not exist" containerID="6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14" Jun 15 15:11:44.104623 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.104604 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14"} err="failed to get container status \"6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14\": rpc error: code = NotFound desc = could not find container \"6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14\": container with ID starting with 6af152c7a9b7d2ea573d88ff81096929ddd7344e4ebcf88f636d768caa024f14 not found: ID does not exist" Jun 15 15:11:44.105032 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105013 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:11:44.105318 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105304 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy" Jun 15 15:11:44.105364 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105319 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy" Jun 15 15:11:44.105364 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105330 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="config-reloader" Jun 15 15:11:44.105364 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105335 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="config-reloader" Jun 15 15:11:44.105364 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105342 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy-web" Jun 15 15:11:44.105364 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105348 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy-web" Jun 15 15:11:44.105364 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105355 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="init-config-reloader" Jun 15 15:11:44.105364 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105360 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="init-config-reloader" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105375 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="thanos-sidecar" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105380 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="thanos-sidecar" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105386 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="prometheus" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105390 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="prometheus" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105396 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy-thanos" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105402 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy-thanos" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105409 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105414 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105453 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="thanos-sidecar" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105460 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy-web" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105466 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="543b217f-eecc-44a2-a9b7-45fe10f0b1fe" containerName="console" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105473 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="prometheus" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105478 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105484 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="config-reloader" Jun 15 15:11:44.105588 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.105490 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="718fba08-70de-428d-a670-5990522fb022" containerName="kube-rbac-proxy-thanos" Jun 15 15:11:44.109538 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.109520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.111896 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.111874 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 15:11:44.111981 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.111879 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 15:11:44.112049 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112014 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c7bu3t3bhsd8h\"" Jun 15 15:11:44.112049 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.111995 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 15:11:44.112362 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112341 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 15:11:44.112462 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112405 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 15:11:44.112462 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112417 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 15:11:44.112462 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112456 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 15:11:44.112626 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112473 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 15:11:44.112626 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112420 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 15:11:44.112626 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112522 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 15:11:44.112761 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112645 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 15:11:44.112761 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.112678 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 15:11:44.113030 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.113002 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5fhg8\"" Jun 15 15:11:44.114643 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.114624 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 15:11:44.120946 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.118992 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 15:11:44.127095 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.127069 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:11:44.194257 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194257 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-web-config\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194473 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194292 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194473 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194473 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194473 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194406 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194473 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194473 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194455 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194646 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194646 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d04265cd-735d-4271-8cb9-f7db7b79ed33-config-out\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194646 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-config\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194646 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194646 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194675 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d04265cd-735d-4271-8cb9-f7db7b79ed33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6ktb\" (UniqueName: \"kubernetes.io/projected/d04265cd-735d-4271-8cb9-f7db7b79ed33-kube-api-access-h6ktb\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.194795 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.194792 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.295800 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.295710 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.295800 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.295759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.295800 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.295788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.295819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.295845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.295877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d04265cd-735d-4271-8cb9-f7db7b79ed33-config-out\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.295899 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-config\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.295921 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296275 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296219 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296412 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296381 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296816 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296777 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296907 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296907 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.296907 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d04265cd-735d-4271-8cb9-f7db7b79ed33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.297271 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6ktb\" (UniqueName: \"kubernetes.io/projected/d04265cd-735d-4271-8cb9-f7db7b79ed33-kube-api-access-h6ktb\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.297271 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.297271 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.297006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.297271 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.297035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.297271 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.297064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-web-config\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.297271 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.297140 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.297271 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.297168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.298090 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.298063 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.299032 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.298849 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.299032 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.296479 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.299207 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.299054 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.299484 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.299352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.299484 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.299381 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d04265cd-735d-4271-8cb9-f7db7b79ed33-config-out\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.299715 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.299669 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.299887 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.299744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d04265cd-735d-4271-8cb9-f7db7b79ed33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.300110 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.300085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.300211 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.297063 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.300450 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.300380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.300738 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.300712 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.300924 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.300905 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-config\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.301418 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.301396 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.301490 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.301431 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.301811 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.301791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-web-config\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.302278 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.302258 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d04265cd-735d-4271-8cb9-f7db7b79ed33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.302516 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.302497 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d04265cd-735d-4271-8cb9-f7db7b79ed33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.305960 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.305942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6ktb\" (UniqueName: \"kubernetes.io/projected/d04265cd-735d-4271-8cb9-f7db7b79ed33-kube-api-access-h6ktb\") pod \"prometheus-k8s-0\" (UID: \"d04265cd-735d-4271-8cb9-f7db7b79ed33\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.421356 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.421314 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:11:44.566720 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:44.566686 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 15:11:44.567706 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:11:44.567676 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04265cd_735d_4271_8cb9_f7db7b79ed33.slice/crio-3db18d73753e42ef7cf0ba75a5f5f7dedd218306cca18d3dce33147913795f80 WatchSource:0}: Error finding container 3db18d73753e42ef7cf0ba75a5f5f7dedd218306cca18d3dce33147913795f80: Status 404 returned error can't find the container with id 3db18d73753e42ef7cf0ba75a5f5f7dedd218306cca18d3dce33147913795f80 Jun 15 15:11:45.050396 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:45.050362 2567 generic.go:356] "Generic (PLEG): container finished" podID="d04265cd-735d-4271-8cb9-f7db7b79ed33" containerID="82b117ff6fc248c38f75109eff6fae3a953e516517ce4e9e677c7d1af9dafef5" exitCode=0 Jun 15 15:11:45.050782 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:45.050431 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d04265cd-735d-4271-8cb9-f7db7b79ed33","Type":"ContainerDied","Data":"82b117ff6fc248c38f75109eff6fae3a953e516517ce4e9e677c7d1af9dafef5"} Jun 15 15:11:45.050782 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:45.050490 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d04265cd-735d-4271-8cb9-f7db7b79ed33","Type":"ContainerStarted","Data":"3db18d73753e42ef7cf0ba75a5f5f7dedd218306cca18d3dce33147913795f80"} Jun 15 15:11:45.841736 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:45.841701 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="718fba08-70de-428d-a670-5990522fb022" path="/var/lib/kubelet/pods/718fba08-70de-428d-a670-5990522fb022/volumes" Jun 15 15:11:46.058719 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:46.058685 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d04265cd-735d-4271-8cb9-f7db7b79ed33","Type":"ContainerStarted","Data":"f6fb1cb479f5cbc08138e78509ab88f74dc48fc2cad79649a9ed0517ec332f5f"} Jun 15 15:11:46.059097 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:46.058751 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d04265cd-735d-4271-8cb9-f7db7b79ed33","Type":"ContainerStarted","Data":"06dad7cd7f78c32a774595ccd5f7f3667c278fb83940a61aa7f3c0adad3ca5fa"} Jun 15 15:11:46.059097 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:46.058778 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d04265cd-735d-4271-8cb9-f7db7b79ed33","Type":"ContainerStarted","Data":"5d3567029fa6d5b3886cf814ff04f031c80db3255c7eedd75b6ad332a28d7a64"} Jun 15 15:11:46.059097 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:46.058803 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d04265cd-735d-4271-8cb9-f7db7b79ed33","Type":"ContainerStarted","Data":"d4907c5ca5481434176c628a7704762f3a6257955b9cbf11e5ae172872150731"} Jun 15 15:11:46.059097 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:46.058830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d04265cd-735d-4271-8cb9-f7db7b79ed33","Type":"ContainerStarted","Data":"a3dc2218566084445fb63d6f52ea203f97d753115d3e481ae856d396d5c78b9b"} Jun 15 15:11:46.059097 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:46.058858 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d04265cd-735d-4271-8cb9-f7db7b79ed33","Type":"ContainerStarted","Data":"4d1e5070ccb86275ebe76865f5a897e8f3fdad961f586354c6c918299a33a8c6"} Jun 15 15:11:46.093828 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:46.093711 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.072976416 podStartE2EDuration="2.093686248s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.709832ms" isStatefulPod=false podCreationTimestamp="2026-06-15 15:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:11:46.09286707 +0000 UTC m=+304.751820880" watchObservedRunningTime="2026-06-15 15:11:46.093686248 +0000 UTC m=+304.752639995" Jun 15 15:11:49.421883 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:11:49.421832 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:12:44.422035 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:12:44.421988 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:12:44.439196 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:12:44.439163 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:12:45.306176 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:12:45.306148 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 15:16:09.854902 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.854865 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x"] Jun 15 15:16:09.857402 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.857377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:09.860970 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.860941 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 15:16:09.861143 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.861064 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 15:16:09.861143 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.861071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v8bnh\"" Jun 15 15:16:09.861268 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.861140 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 15:16:09.861268 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.861218 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 15:16:09.881474 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.881443 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x"] Jun 15 15:16:09.986887 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.986842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82d6a98c-e211-4462-a0f0-2aaf311719fb-manifests\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:09.987078 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.986901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82d6a98c-e211-4462-a0f0-2aaf311719fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:09.987078 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.986929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82d6a98c-e211-4462-a0f0-2aaf311719fb-tmp\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:09.987078 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.986981 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf2fj\" (UniqueName: \"kubernetes.io/projected/82d6a98c-e211-4462-a0f0-2aaf311719fb-kube-api-access-cf2fj\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:09.987250 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:09.987143 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82d6a98c-e211-4462-a0f0-2aaf311719fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.088355 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.088311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf2fj\" (UniqueName: \"kubernetes.io/projected/82d6a98c-e211-4462-a0f0-2aaf311719fb-kube-api-access-cf2fj\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.088526 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.088431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82d6a98c-e211-4462-a0f0-2aaf311719fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.088526 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.088462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82d6a98c-e211-4462-a0f0-2aaf311719fb-manifests\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.088526 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.088502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82d6a98c-e211-4462-a0f0-2aaf311719fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.088662 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.088630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82d6a98c-e211-4462-a0f0-2aaf311719fb-tmp\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.088908 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.088883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82d6a98c-e211-4462-a0f0-2aaf311719fb-manifests\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.091142 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.091086 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82d6a98c-e211-4462-a0f0-2aaf311719fb-tmp\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.091267 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.091194 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82d6a98c-e211-4462-a0f0-2aaf311719fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.091267 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.091249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82d6a98c-e211-4462-a0f0-2aaf311719fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.098582 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.098553 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf2fj\" (UniqueName: \"kubernetes.io/projected/82d6a98c-e211-4462-a0f0-2aaf311719fb-kube-api-access-cf2fj\") pod \"opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x\" (UID: \"82d6a98c-e211-4462-a0f0-2aaf311719fb\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.167917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.167820 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:10.309385 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.309345 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x"] Jun 15 15:16:10.314377 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:16:10.314349 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d6a98c_e211_4462_a0f0_2aaf311719fb.slice/crio-5380433ce8926f094dbd29a668c2f1408cf78fef9a5705c0922859a4ed3d24af WatchSource:0}: Error finding container 5380433ce8926f094dbd29a668c2f1408cf78fef9a5705c0922859a4ed3d24af: Status 404 returned error can't find the container with id 5380433ce8926f094dbd29a668c2f1408cf78fef9a5705c0922859a4ed3d24af Jun 15 15:16:10.316223 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:10.316205 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 15:16:11.053586 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:11.053546 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" event={"ID":"82d6a98c-e211-4462-a0f0-2aaf311719fb","Type":"ContainerStarted","Data":"5380433ce8926f094dbd29a668c2f1408cf78fef9a5705c0922859a4ed3d24af"} Jun 15 15:16:14.069966 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:14.069925 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" event={"ID":"82d6a98c-e211-4462-a0f0-2aaf311719fb","Type":"ContainerStarted","Data":"c78193596299c7ce5871c5f59e84e823a3a0b10a3b98347e15fc1a685a7bc5e8"} Jun 15 15:16:15.075601 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:15.075559 2567 generic.go:356] "Generic (PLEG): container finished" podID="82d6a98c-e211-4462-a0f0-2aaf311719fb" containerID="c78193596299c7ce5871c5f59e84e823a3a0b10a3b98347e15fc1a685a7bc5e8" exitCode=0 Jun 15 15:16:15.075979 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:15.075645 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" event={"ID":"82d6a98c-e211-4462-a0f0-2aaf311719fb","Type":"ContainerDied","Data":"c78193596299c7ce5871c5f59e84e823a3a0b10a3b98347e15fc1a685a7bc5e8"} Jun 15 15:16:16.082528 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:16.082491 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" event={"ID":"82d6a98c-e211-4462-a0f0-2aaf311719fb","Type":"ContainerStarted","Data":"41db1986e9ad38a00861f5499812260b56180d82fd77fd9cfc0d769548f90e2b"} Jun 15 15:16:16.082931 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:16.082622 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:16.108585 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:16.108530 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" podStartSLOduration=2.823223773 podStartE2EDuration="7.108510509s" totalImagesPullingTime="3.313191607s" totalInitContainerRuntime="972.095129ms" isStatefulPod=false podCreationTimestamp="2026-06-15 15:16:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:16:16.106993394 +0000 UTC m=+574.765947094" watchObservedRunningTime="2026-06-15 15:16:16.108510509 +0000 UTC m=+574.767464253" Jun 15 15:16:27.089107 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:27.089073 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x" Jun 15 15:16:29.976091 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.976057 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk"] Jun 15 15:16:29.983643 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.983611 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:29.986422 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.986399 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hkjh5\"" Jun 15 15:16:29.987382 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.987361 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 15:16:29.987504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.987436 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 15:16:29.987504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.987453 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 15:16:29.987504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.987488 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 15:16:29.987664 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.987540 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 15:16:29.989718 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:29.989695 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk"] Jun 15 15:16:30.048717 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.048683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8023fa8-a40d-4662-9774-0c4fed652806-manager-config\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.048930 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.048749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8023fa8-a40d-4662-9774-0c4fed652806-metrics-cert\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.048930 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.048795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mv59\" (UniqueName: \"kubernetes.io/projected/e8023fa8-a40d-4662-9774-0c4fed652806-kube-api-access-4mv59\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.048930 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.048837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8023fa8-a40d-4662-9774-0c4fed652806-cert\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.149989 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.149955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mv59\" (UniqueName: \"kubernetes.io/projected/e8023fa8-a40d-4662-9774-0c4fed652806-kube-api-access-4mv59\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.150182 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.150003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8023fa8-a40d-4662-9774-0c4fed652806-cert\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.150182 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.150036 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8023fa8-a40d-4662-9774-0c4fed652806-manager-config\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.150182 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.150067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8023fa8-a40d-4662-9774-0c4fed652806-metrics-cert\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.150691 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.150666 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8023fa8-a40d-4662-9774-0c4fed652806-manager-config\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.152745 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.152718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8023fa8-a40d-4662-9774-0c4fed652806-metrics-cert\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.152843 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.152718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8023fa8-a40d-4662-9774-0c4fed652806-cert\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.157902 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.157875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mv59\" (UniqueName: \"kubernetes.io/projected/e8023fa8-a40d-4662-9774-0c4fed652806-kube-api-access-4mv59\") pod \"lws-controller-manager-6d9bccfb8-cbmpk\" (UID: \"e8023fa8-a40d-4662-9774-0c4fed652806\") " pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.294343 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.294307 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:30.427026 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:30.426991 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk"] Jun 15 15:16:30.430575 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:16:30.430549 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8023fa8_a40d_4662_9774_0c4fed652806.slice/crio-3efe46578a2e906e7362380bf39806d69b329d1f6bd56ed366cbd03e3721322f WatchSource:0}: Error finding container 3efe46578a2e906e7362380bf39806d69b329d1f6bd56ed366cbd03e3721322f: Status 404 returned error can't find the container with id 3efe46578a2e906e7362380bf39806d69b329d1f6bd56ed366cbd03e3721322f Jun 15 15:16:31.146467 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:31.146429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" event={"ID":"e8023fa8-a40d-4662-9774-0c4fed652806","Type":"ContainerStarted","Data":"3efe46578a2e906e7362380bf39806d69b329d1f6bd56ed366cbd03e3721322f"} Jun 15 15:16:34.160487 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:34.160453 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" event={"ID":"e8023fa8-a40d-4662-9774-0c4fed652806","Type":"ContainerStarted","Data":"ffe37fd27f2e40ec643e96345e9f0e96a0bd48345ef8b3a2b875a15f5dfeb0fd"} Jun 15 15:16:34.160875 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:34.160545 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:34.178148 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:34.178069 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" podStartSLOduration=2.109248961 podStartE2EDuration="5.178049896s" totalImagesPullingTime="3.068800935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:16:34.176657929 +0000 UTC m=+592.835611649" watchObservedRunningTime="2026-06-15 15:16:34.178049896 +0000 UTC m=+592.837003599" Jun 15 15:16:41.809265 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:41.809239 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:16:41.809265 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:41.809250 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:16:41.815145 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:41.815103 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:16:41.815321 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:41.815279 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:16:45.167466 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:45.167436 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d9bccfb8-cbmpk" Jun 15 15:16:49.420759 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.420685 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bd7775f85-cjnbk"] Jun 15 15:16:49.423631 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.423598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.426493 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.426460 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 15:16:49.426884 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.426734 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 15:16:49.427537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.427507 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 15:16:49.427900 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.427565 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 15:16:49.427900 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.427627 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 15:16:49.427900 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.427632 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h9k8j\"" Jun 15 15:16:49.431961 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.431935 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 15:16:49.435814 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.435785 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd7775f85-cjnbk"] Jun 15 15:16:49.516714 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.516666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-oauth-serving-cert\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.516917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.516747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-service-ca\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.516917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.516783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-console-config\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.516917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.516807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q99v\" (UniqueName: \"kubernetes.io/projected/2efdd55c-3867-4c82-b217-e55704234787-kube-api-access-2q99v\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.516917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.516846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2efdd55c-3867-4c82-b217-e55704234787-console-serving-cert\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.516917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.516862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-trusted-ca-bundle\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.516917 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.516885 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2efdd55c-3867-4c82-b217-e55704234787-console-oauth-config\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.617789 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.617740 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2efdd55c-3867-4c82-b217-e55704234787-console-serving-cert\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.617789 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.617789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-trusted-ca-bundle\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.618004 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.617830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2efdd55c-3867-4c82-b217-e55704234787-console-oauth-config\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.618004 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.617877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-oauth-serving-cert\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.618004 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.617920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-service-ca\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.618004 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.617971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-console-config\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.618222 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.618012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q99v\" (UniqueName: \"kubernetes.io/projected/2efdd55c-3867-4c82-b217-e55704234787-kube-api-access-2q99v\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.618769 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.618742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-console-config\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.618934 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.618907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-trusted-ca-bundle\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.619079 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.619056 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-oauth-serving-cert\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.619164 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.619105 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2efdd55c-3867-4c82-b217-e55704234787-service-ca\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.620658 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.620630 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2efdd55c-3867-4c82-b217-e55704234787-console-oauth-config\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.620749 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.620726 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2efdd55c-3867-4c82-b217-e55704234787-console-serving-cert\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.627235 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.627214 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q99v\" (UniqueName: \"kubernetes.io/projected/2efdd55c-3867-4c82-b217-e55704234787-kube-api-access-2q99v\") pod \"console-5bd7775f85-cjnbk\" (UID: \"2efdd55c-3867-4c82-b217-e55704234787\") " pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.736521 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.736423 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:49.884323 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:49.884291 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd7775f85-cjnbk"] Jun 15 15:16:49.887458 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:16:49.887426 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efdd55c_3867_4c82_b217_e55704234787.slice/crio-4e1a1d1374de5fefab5867532d52f441f15dc6f5370a00ae6bc709cae9435fcc WatchSource:0}: Error finding container 4e1a1d1374de5fefab5867532d52f441f15dc6f5370a00ae6bc709cae9435fcc: Status 404 returned error can't find the container with id 4e1a1d1374de5fefab5867532d52f441f15dc6f5370a00ae6bc709cae9435fcc Jun 15 15:16:50.226237 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:50.226161 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd7775f85-cjnbk" event={"ID":"2efdd55c-3867-4c82-b217-e55704234787","Type":"ContainerStarted","Data":"0436aa03be8f5dd967f3b10dfdd3aa86c42768a42716b24c48cf55e66a0d4718"} Jun 15 15:16:50.226237 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:50.226216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd7775f85-cjnbk" event={"ID":"2efdd55c-3867-4c82-b217-e55704234787","Type":"ContainerStarted","Data":"4e1a1d1374de5fefab5867532d52f441f15dc6f5370a00ae6bc709cae9435fcc"} Jun 15 15:16:50.244390 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:50.244334 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bd7775f85-cjnbk" podStartSLOduration=1.244315695 podStartE2EDuration="1.244315695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:16:50.243106285 +0000 UTC m=+608.902059987" watchObservedRunningTime="2026-06-15 15:16:50.244315695 +0000 UTC m=+608.903269395" Jun 15 15:16:59.736960 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:59.736917 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:59.737507 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:59.736999 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:16:59.742190 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:16:59.742166 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:17:00.271492 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:00.271464 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bd7775f85-cjnbk" Jun 15 15:17:11.979433 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:11.979396 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65"] Jun 15 15:17:11.984308 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:11.984281 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:11.986897 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:11.986870 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 15:17:11.987058 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:11.986916 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rjkkg\"" Jun 15 15:17:11.987058 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:11.987026 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 15:17:11.987209 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:11.987168 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 15:17:11.994224 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:11.994195 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65"] Jun 15 15:17:12.117252 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xmjl\" (UniqueName: \"kubernetes.io/projected/2895183e-516a-4a1e-949e-c14dc29af8d1-kube-api-access-7xmjl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.117252 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.117470 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.117470 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2895183e-516a-4a1e-949e-c14dc29af8d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.117470 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.117470 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.117602 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.117602 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.117602 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.117589 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.218807 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.218757 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.218974 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.218823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.218974 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.218856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.218974 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.218881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.218974 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.218916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.218974 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.218961 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xmjl\" (UniqueName: \"kubernetes.io/projected/2895183e-516a-4a1e-949e-c14dc29af8d1-kube-api-access-7xmjl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.219272 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.219016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.219272 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.219060 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.219272 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.219095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2895183e-516a-4a1e-949e-c14dc29af8d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.219272 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.219253 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.219477 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.219347 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.219477 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.219433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.219576 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.219512 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.219828 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.219807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2895183e-516a-4a1e-949e-c14dc29af8d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.221618 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.221595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.221671 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.221636 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.226748 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.226715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2895183e-516a-4a1e-949e-c14dc29af8d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.226847 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.226818 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xmjl\" (UniqueName: \"kubernetes.io/projected/2895183e-516a-4a1e-949e-c14dc29af8d1-kube-api-access-7xmjl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lsc65\" (UID: \"2895183e-516a-4a1e-949e-c14dc29af8d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.297680 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.297635 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:12.438886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:12.438823 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65"] Jun 15 15:17:12.441670 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:17:12.441646 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2895183e_516a_4a1e_949e_c14dc29af8d1.slice/crio-e8030849f791808fec847aaf3a698b26aedb3da2bf016716c6dcf4b0843f962d WatchSource:0}: Error finding container e8030849f791808fec847aaf3a698b26aedb3da2bf016716c6dcf4b0843f962d: Status 404 returned error can't find the container with id e8030849f791808fec847aaf3a698b26aedb3da2bf016716c6dcf4b0843f962d Jun 15 15:17:13.326447 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:13.326409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" event={"ID":"2895183e-516a-4a1e-949e-c14dc29af8d1","Type":"ContainerStarted","Data":"e8030849f791808fec847aaf3a698b26aedb3da2bf016716c6dcf4b0843f962d"} Jun 15 15:17:15.810642 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:15.810600 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:17:15.810960 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:15.810677 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:17:15.810960 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:15.810705 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:17:16.342514 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.342476 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" event={"ID":"2895183e-516a-4a1e-949e-c14dc29af8d1","Type":"ContainerStarted","Data":"179f75c1825aaa8ea8ac40e2994f95234197cb93aeb5bcd942d9591cd6ff8ffa"} Jun 15 15:17:16.364719 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.364658 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" podStartSLOduration=1.998156469 podStartE2EDuration="5.364635301s" totalImagesPullingTime="3.366478832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:17:16.362965681 +0000 UTC m=+635.021919380" watchObservedRunningTime="2026-06-15 15:17:16.364635301 +0000 UTC m=+635.023589001" Jun 15 15:17:16.751902 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.751862 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7d44784fcb-7sv49"] Jun 15 15:17:16.754739 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.754717 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" Jun 15 15:17:16.757350 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.757325 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-djf92\"" Jun 15 15:17:16.757551 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.757531 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 15:17:16.767130 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.767086 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7d44784fcb-7sv49"] Jun 15 15:17:16.863076 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.863031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6wxn\" (UniqueName: \"kubernetes.io/projected/51904ebc-599b-4a5a-a3eb-a6487cee66aa-kube-api-access-s6wxn\") pod \"dashboard-redirect-7d44784fcb-7sv49\" (UID: \"51904ebc-599b-4a5a-a3eb-a6487cee66aa\") " pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" Jun 15 15:17:16.863479 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.863182 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/51904ebc-599b-4a5a-a3eb-a6487cee66aa-redirect-config\") pod \"dashboard-redirect-7d44784fcb-7sv49\" (UID: \"51904ebc-599b-4a5a-a3eb-a6487cee66aa\") " pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" Jun 15 15:17:16.964674 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.964635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6wxn\" (UniqueName: \"kubernetes.io/projected/51904ebc-599b-4a5a-a3eb-a6487cee66aa-kube-api-access-s6wxn\") pod \"dashboard-redirect-7d44784fcb-7sv49\" (UID: \"51904ebc-599b-4a5a-a3eb-a6487cee66aa\") " pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" Jun 15 15:17:16.964856 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.964698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/51904ebc-599b-4a5a-a3eb-a6487cee66aa-redirect-config\") pod \"dashboard-redirect-7d44784fcb-7sv49\" (UID: \"51904ebc-599b-4a5a-a3eb-a6487cee66aa\") " pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" Jun 15 15:17:16.965471 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.965451 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/51904ebc-599b-4a5a-a3eb-a6487cee66aa-redirect-config\") pod \"dashboard-redirect-7d44784fcb-7sv49\" (UID: \"51904ebc-599b-4a5a-a3eb-a6487cee66aa\") " pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" Jun 15 15:17:16.976516 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:16.976480 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6wxn\" (UniqueName: \"kubernetes.io/projected/51904ebc-599b-4a5a-a3eb-a6487cee66aa-kube-api-access-s6wxn\") pod \"dashboard-redirect-7d44784fcb-7sv49\" (UID: \"51904ebc-599b-4a5a-a3eb-a6487cee66aa\") " pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" Jun 15 15:17:17.065859 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:17.065773 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" Jun 15 15:17:17.246304 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:17.246276 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7d44784fcb-7sv49"] Jun 15 15:17:17.248993 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:17:17.248965 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51904ebc_599b_4a5a_a3eb_a6487cee66aa.slice/crio-782764eadb6fbb69c3bcd7ebd32d58fc3a578e7b40244616b08f56b371e68013 WatchSource:0}: Error finding container 782764eadb6fbb69c3bcd7ebd32d58fc3a578e7b40244616b08f56b371e68013: Status 404 returned error can't find the container with id 782764eadb6fbb69c3bcd7ebd32d58fc3a578e7b40244616b08f56b371e68013 Jun 15 15:17:17.298136 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:17.298070 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:17.303374 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:17.303342 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:17.348654 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:17.348555 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" event={"ID":"51904ebc-599b-4a5a-a3eb-a6487cee66aa","Type":"ContainerStarted","Data":"782764eadb6fbb69c3bcd7ebd32d58fc3a578e7b40244616b08f56b371e68013"} Jun 15 15:17:17.348839 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:17.348810 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:17.349930 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:17.349907 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lsc65" Jun 15 15:17:19.360170 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:19.360135 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" event={"ID":"51904ebc-599b-4a5a-a3eb-a6487cee66aa","Type":"ContainerStarted","Data":"d6e57fb2f4e6ef8661ba1c5a79a10215e159789c72e841c096acefa3eca3efd6"} Jun 15 15:17:19.375713 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:19.375657 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7d44784fcb-7sv49" podStartSLOduration=1.397759833 podStartE2EDuration="3.375640147s" totalImagesPullingTime="1.977880314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:17:19.37442807 +0000 UTC m=+638.033381770" watchObservedRunningTime="2026-06-15 15:17:19.375640147 +0000 UTC m=+638.034593846" Jun 15 15:17:30.321710 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.321672 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wl5mz"] Jun 15 15:17:30.324537 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.324518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" Jun 15 15:17:30.326986 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.326956 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zqfbk\"" Jun 15 15:17:30.327193 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.327089 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 15:17:30.327956 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.327935 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 15:17:30.333424 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.333396 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wl5mz"] Jun 15 15:17:30.382922 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.382882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srt9b\" (UniqueName: \"kubernetes.io/projected/d0bdbd22-f532-467d-913c-170a32e9627e-kube-api-access-srt9b\") pod \"kuadrant-operator-catalog-wl5mz\" (UID: \"d0bdbd22-f532-467d-913c-170a32e9627e\") " pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" Jun 15 15:17:30.484030 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.483987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srt9b\" (UniqueName: \"kubernetes.io/projected/d0bdbd22-f532-467d-913c-170a32e9627e-kube-api-access-srt9b\") pod \"kuadrant-operator-catalog-wl5mz\" (UID: \"d0bdbd22-f532-467d-913c-170a32e9627e\") " pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" Jun 15 15:17:30.492009 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.491978 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srt9b\" (UniqueName: \"kubernetes.io/projected/d0bdbd22-f532-467d-913c-170a32e9627e-kube-api-access-srt9b\") pod \"kuadrant-operator-catalog-wl5mz\" (UID: \"d0bdbd22-f532-467d-913c-170a32e9627e\") " pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" Jun 15 15:17:30.636410 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.636313 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" Jun 15 15:17:30.689316 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.689283 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wl5mz"] Jun 15 15:17:30.772459 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.772392 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wl5mz"] Jun 15 15:17:30.774712 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:17:30.774680 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bdbd22_f532_467d_913c_170a32e9627e.slice/crio-f3706f5f18cca1a613d7b0042938f13ebe4aae23d71a4100ffbaf279b145d177 WatchSource:0}: Error finding container f3706f5f18cca1a613d7b0042938f13ebe4aae23d71a4100ffbaf279b145d177: Status 404 returned error can't find the container with id f3706f5f18cca1a613d7b0042938f13ebe4aae23d71a4100ffbaf279b145d177 Jun 15 15:17:30.897857 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.897781 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ss6cs"] Jun 15 15:17:30.901202 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.901180 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:17:30.909502 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.909467 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ss6cs"] Jun 15 15:17:30.989687 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:30.989652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tnbt\" (UniqueName: \"kubernetes.io/projected/9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c-kube-api-access-2tnbt\") pod \"kuadrant-operator-catalog-ss6cs\" (UID: \"9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c\") " pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:17:31.090797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:31.090764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tnbt\" (UniqueName: \"kubernetes.io/projected/9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c-kube-api-access-2tnbt\") pod \"kuadrant-operator-catalog-ss6cs\" (UID: \"9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c\") " pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:17:31.104494 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:31.104458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tnbt\" (UniqueName: \"kubernetes.io/projected/9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c-kube-api-access-2tnbt\") pod \"kuadrant-operator-catalog-ss6cs\" (UID: \"9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c\") " pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:17:31.211716 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:31.211621 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:17:31.371581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:31.371550 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ss6cs"] Jun 15 15:17:31.377275 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:17:31.377244 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf84e6d_2db3_4b2e_9ef3_b948fe5a5b0c.slice/crio-d806b696db13218d8e0babdf547920309de3420d408302102283b3e89c988148 WatchSource:0}: Error finding container d806b696db13218d8e0babdf547920309de3420d408302102283b3e89c988148: Status 404 returned error can't find the container with id d806b696db13218d8e0babdf547920309de3420d408302102283b3e89c988148 Jun 15 15:17:31.413254 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:31.413219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" event={"ID":"9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c","Type":"ContainerStarted","Data":"d806b696db13218d8e0babdf547920309de3420d408302102283b3e89c988148"} Jun 15 15:17:31.414504 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:31.414475 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" event={"ID":"d0bdbd22-f532-467d-913c-170a32e9627e","Type":"ContainerStarted","Data":"f3706f5f18cca1a613d7b0042938f13ebe4aae23d71a4100ffbaf279b145d177"} Jun 15 15:17:33.426417 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.426302 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" event={"ID":"9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c","Type":"ContainerStarted","Data":"95d416b86de38b3d8bee1f9837c382a9b65c3fd9153fc40a049246b1c9ede351"} Jun 15 15:17:33.427924 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.427894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" event={"ID":"d0bdbd22-f532-467d-913c-170a32e9627e","Type":"ContainerStarted","Data":"7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762"} Jun 15 15:17:33.428068 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.427974 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" podUID="d0bdbd22-f532-467d-913c-170a32e9627e" containerName="registry-server" containerID="cri-o://7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762" gracePeriod=2 Jun 15 15:17:33.446712 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.446656 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" podStartSLOduration=1.721023017 podStartE2EDuration="3.446637508s" totalImagesPullingTime="1.725614491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:17:33.44588193 +0000 UTC m=+652.104835630" watchObservedRunningTime="2026-06-15 15:17:33.446637508 +0000 UTC m=+652.105591208" Jun 15 15:17:33.462744 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.462688 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" podStartSLOduration=1.1305173609999999 podStartE2EDuration="3.462666331s" totalImagesPullingTime="2.33214897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:17:33.461653358 +0000 UTC m=+652.120607076" watchObservedRunningTime="2026-06-15 15:17:33.462666331 +0000 UTC m=+652.121620032" Jun 15 15:17:33.678502 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.678430 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" Jun 15 15:17:33.716751 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.716712 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srt9b\" (UniqueName: \"kubernetes.io/projected/d0bdbd22-f532-467d-913c-170a32e9627e-kube-api-access-srt9b\") pod \"d0bdbd22-f532-467d-913c-170a32e9627e\" (UID: \"d0bdbd22-f532-467d-913c-170a32e9627e\") " Jun 15 15:17:33.719031 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.719007 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0bdbd22-f532-467d-913c-170a32e9627e-kube-api-access-srt9b" (OuterVolumeSpecName: "kube-api-access-srt9b") pod "d0bdbd22-f532-467d-913c-170a32e9627e" (UID: "d0bdbd22-f532-467d-913c-170a32e9627e"). InnerVolumeSpecName "kube-api-access-srt9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:17:33.817949 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:33.817910 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srt9b\" (UniqueName: \"kubernetes.io/projected/d0bdbd22-f532-467d-913c-170a32e9627e-kube-api-access-srt9b\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:17:34.436747 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.436657 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0bdbd22-f532-467d-913c-170a32e9627e" containerID="7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762" exitCode=0 Jun 15 15:17:34.437245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.436776 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" Jun 15 15:17:34.437245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.436805 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" event={"ID":"d0bdbd22-f532-467d-913c-170a32e9627e","Type":"ContainerDied","Data":"7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762"} Jun 15 15:17:34.437245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.436876 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wl5mz" event={"ID":"d0bdbd22-f532-467d-913c-170a32e9627e","Type":"ContainerDied","Data":"f3706f5f18cca1a613d7b0042938f13ebe4aae23d71a4100ffbaf279b145d177"} Jun 15 15:17:34.437245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.436907 2567 scope.go:117] "RemoveContainer" containerID="7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762" Jun 15 15:17:34.446091 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.446069 2567 scope.go:117] "RemoveContainer" containerID="7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762" Jun 15 15:17:34.446467 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:17:34.446446 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762\": container with ID starting with 7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762 not found: ID does not exist" containerID="7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762" Jun 15 15:17:34.446522 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.446478 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762"} err="failed to get container status \"7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762\": rpc error: code = NotFound desc = could not find container \"7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762\": container with ID starting with 7a7a6f8c4b436bf73328135b88bf620be22bdade5d66e3c5d74a21083add8762 not found: ID does not exist" Jun 15 15:17:34.454775 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.454741 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wl5mz"] Jun 15 15:17:34.461665 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:34.461637 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wl5mz"] Jun 15 15:17:35.840522 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:35.840485 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0bdbd22-f532-467d-913c-170a32e9627e" path="/var/lib/kubelet/pods/d0bdbd22-f532-467d-913c-170a32e9627e/volumes" Jun 15 15:17:41.212040 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:41.211990 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:17:41.212591 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:41.212075 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:17:41.235826 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:41.235800 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:17:41.490994 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:17:41.490965 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ss6cs" Jun 15 15:18:02.177076 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.177031 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd"] Jun 15 15:18:02.177581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.177403 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0bdbd22-f532-467d-913c-170a32e9627e" containerName="registry-server" Jun 15 15:18:02.177581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.177416 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0bdbd22-f532-467d-913c-170a32e9627e" containerName="registry-server" Jun 15 15:18:02.177581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.177484 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0bdbd22-f532-467d-913c-170a32e9627e" containerName="registry-server" Jun 15 15:18:02.184319 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.184296 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" Jun 15 15:18:02.186843 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.186818 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-djr2m\"" Jun 15 15:18:02.187237 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.187209 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 15 15:18:02.200301 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.200271 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd"] Jun 15 15:18:02.269164 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.269087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ftgv\" (UniqueName: \"kubernetes.io/projected/1b28a8b1-6cbf-418b-96e2-8030ac716f98-kube-api-access-2ftgv\") pod \"dns-operator-controller-manager-864dd78c4c-qvcrd\" (UID: \"1b28a8b1-6cbf-418b-96e2-8030ac716f98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" Jun 15 15:18:02.370376 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.370335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ftgv\" (UniqueName: \"kubernetes.io/projected/1b28a8b1-6cbf-418b-96e2-8030ac716f98-kube-api-access-2ftgv\") pod \"dns-operator-controller-manager-864dd78c4c-qvcrd\" (UID: \"1b28a8b1-6cbf-418b-96e2-8030ac716f98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" Jun 15 15:18:02.379416 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.379387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ftgv\" (UniqueName: \"kubernetes.io/projected/1b28a8b1-6cbf-418b-96e2-8030ac716f98-kube-api-access-2ftgv\") pod \"dns-operator-controller-manager-864dd78c4c-qvcrd\" (UID: \"1b28a8b1-6cbf-418b-96e2-8030ac716f98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" Jun 15 15:18:02.494143 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.494068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" Jun 15 15:18:02.634632 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:02.634605 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd"] Jun 15 15:18:02.637171 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:18:02.637140 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b28a8b1_6cbf_418b_96e2_8030ac716f98.slice/crio-188e090669751d75c81918351819b612c95fdff011a7824d7e063daea88f43c8 WatchSource:0}: Error finding container 188e090669751d75c81918351819b612c95fdff011a7824d7e063daea88f43c8: Status 404 returned error can't find the container with id 188e090669751d75c81918351819b612c95fdff011a7824d7e063daea88f43c8 Jun 15 15:18:03.568561 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:03.568518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" event={"ID":"1b28a8b1-6cbf-418b-96e2-8030ac716f98","Type":"ContainerStarted","Data":"188e090669751d75c81918351819b612c95fdff011a7824d7e063daea88f43c8"} Jun 15 15:18:05.579876 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:05.579839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" event={"ID":"1b28a8b1-6cbf-418b-96e2-8030ac716f98","Type":"ContainerStarted","Data":"6253aed79802248e2f2b6595f3fe773fe85d898ca105ac5fcc8622146e0c6579"} Jun 15 15:18:05.580287 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:05.579904 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" Jun 15 15:18:05.599310 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:05.599250 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" podStartSLOduration=1.312001314 podStartE2EDuration="3.599231299s" totalImagesPullingTime="2.287229985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:18:05.596093409 +0000 UTC m=+684.255047125" watchObservedRunningTime="2026-06-15 15:18:05.599231299 +0000 UTC m=+684.258184999" Jun 15 15:18:06.235220 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.235177 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ds4df"] Jun 15 15:18:06.237671 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.237653 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" Jun 15 15:18:06.240391 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.240360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-x9brj\"" Jun 15 15:18:06.253724 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.253696 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ds4df"] Jun 15 15:18:06.306585 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.306540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmh27\" (UniqueName: \"kubernetes.io/projected/a0a0a01a-fbac-4bd3-94c9-43bce806f117-kube-api-access-xmh27\") pod \"authorino-operator-75cc8d5cb7-ds4df\" (UID: \"a0a0a01a-fbac-4bd3-94c9-43bce806f117\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" Jun 15 15:18:06.407779 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.407722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmh27\" (UniqueName: \"kubernetes.io/projected/a0a0a01a-fbac-4bd3-94c9-43bce806f117-kube-api-access-xmh27\") pod \"authorino-operator-75cc8d5cb7-ds4df\" (UID: \"a0a0a01a-fbac-4bd3-94c9-43bce806f117\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" Jun 15 15:18:06.416836 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.416807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmh27\" (UniqueName: \"kubernetes.io/projected/a0a0a01a-fbac-4bd3-94c9-43bce806f117-kube-api-access-xmh27\") pod \"authorino-operator-75cc8d5cb7-ds4df\" (UID: \"a0a0a01a-fbac-4bd3-94c9-43bce806f117\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" Jun 15 15:18:06.549625 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.549573 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" Jun 15 15:18:06.699555 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:06.699529 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ds4df"] Jun 15 15:18:06.702243 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:18:06.702215 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a0a01a_fbac_4bd3_94c9_43bce806f117.slice/crio-509aaf8c52b4c204f0d975f7428f43ce1a205a900fd5874217bb4ffd15f0a81c WatchSource:0}: Error finding container 509aaf8c52b4c204f0d975f7428f43ce1a205a900fd5874217bb4ffd15f0a81c: Status 404 returned error can't find the container with id 509aaf8c52b4c204f0d975f7428f43ce1a205a900fd5874217bb4ffd15f0a81c Jun 15 15:18:07.593064 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:07.592966 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" event={"ID":"a0a0a01a-fbac-4bd3-94c9-43bce806f117","Type":"ContainerStarted","Data":"509aaf8c52b4c204f0d975f7428f43ce1a205a900fd5874217bb4ffd15f0a81c"} Jun 15 15:18:09.605288 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:09.605244 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" event={"ID":"a0a0a01a-fbac-4bd3-94c9-43bce806f117","Type":"ContainerStarted","Data":"9477dbdfef42edd51d482cf53f30f82b7d10a93908570e35e92708c7aab3d21f"} Jun 15 15:18:09.605725 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:09.605347 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" Jun 15 15:18:09.637909 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:09.637845 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" podStartSLOduration=1.314204016 podStartE2EDuration="3.637828428s" totalImagesPullingTime="2.323624412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:18:09.635369037 +0000 UTC m=+688.294322737" watchObservedRunningTime="2026-06-15 15:18:09.637828428 +0000 UTC m=+688.296782130" Jun 15 15:18:14.300420 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.300372 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt"] Jun 15 15:18:14.302999 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.302976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:14.305572 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.305547 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4hshh\"" Jun 15 15:18:14.320288 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.320256 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt"] Jun 15 15:18:14.375141 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.375080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trsw5\" (UniqueName: \"kubernetes.io/projected/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-kube-api-access-trsw5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" (UID: \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:14.375351 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.375283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" (UID: \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:14.476244 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.476205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" (UID: \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:14.476469 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.476256 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trsw5\" (UniqueName: \"kubernetes.io/projected/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-kube-api-access-trsw5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" (UID: \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:14.476703 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.476676 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" (UID: \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:14.485601 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.485565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trsw5\" (UniqueName: \"kubernetes.io/projected/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-kube-api-access-trsw5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" (UID: \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:14.612641 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.612527 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:14.749290 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:14.749238 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt"] Jun 15 15:18:14.752570 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:18:14.752535 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fc3d12_561a_4c3f_a919_bdd8fcd3999c.slice/crio-e71c59d3faae0cda82d7713a1f83c2505b0b7eb736072a5f426872157709c89a WatchSource:0}: Error finding container e71c59d3faae0cda82d7713a1f83c2505b0b7eb736072a5f426872157709c89a: Status 404 returned error can't find the container with id e71c59d3faae0cda82d7713a1f83c2505b0b7eb736072a5f426872157709c89a Jun 15 15:18:15.634864 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:15.634830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" event={"ID":"66fc3d12-561a-4c3f-a919-bdd8fcd3999c","Type":"ContainerStarted","Data":"e71c59d3faae0cda82d7713a1f83c2505b0b7eb736072a5f426872157709c89a"} Jun 15 15:18:16.587800 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:16.587763 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvcrd" Jun 15 15:18:20.612441 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:20.612362 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ds4df" Jun 15 15:18:21.665828 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:21.665794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" event={"ID":"66fc3d12-561a-4c3f-a919-bdd8fcd3999c","Type":"ContainerStarted","Data":"6f25830444f6a0a9eb808c83bade5792d1490d36d6d5fc27c9327d3485e385c9"} Jun 15 15:18:21.666228 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:21.665888 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:21.689187 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:21.689112 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" podStartSLOduration=0.980811675 podStartE2EDuration="7.689095283s" totalImagesPullingTime="6.708283608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:18:21.686892131 +0000 UTC m=+700.345845829" watchObservedRunningTime="2026-06-15 15:18:21.689095283 +0000 UTC m=+700.348049051" Jun 15 15:18:32.673056 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:32.673017 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:34.030529 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.030495 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln"] Jun 15 15:18:34.033067 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.033048 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.050044 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.050014 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln"] Jun 15 15:18:34.169946 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.169903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72711f37-37eb-4e5f-a891-425f3a1153d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" (UID: \"72711f37-37eb-4e5f-a891-425f3a1153d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.170168 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.169973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krm8b\" (UniqueName: \"kubernetes.io/projected/72711f37-37eb-4e5f-a891-425f3a1153d3-kube-api-access-krm8b\") pod \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" (UID: \"72711f37-37eb-4e5f-a891-425f3a1153d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.271189 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.271110 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krm8b\" (UniqueName: \"kubernetes.io/projected/72711f37-37eb-4e5f-a891-425f3a1153d3-kube-api-access-krm8b\") pod \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" (UID: \"72711f37-37eb-4e5f-a891-425f3a1153d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.271389 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.271249 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72711f37-37eb-4e5f-a891-425f3a1153d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" (UID: \"72711f37-37eb-4e5f-a891-425f3a1153d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.271599 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.271582 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72711f37-37eb-4e5f-a891-425f3a1153d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" (UID: \"72711f37-37eb-4e5f-a891-425f3a1153d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.279321 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.279299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krm8b\" (UniqueName: \"kubernetes.io/projected/72711f37-37eb-4e5f-a891-425f3a1153d3-kube-api-access-krm8b\") pod \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" (UID: \"72711f37-37eb-4e5f-a891-425f3a1153d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.343196 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.343067 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.454659 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.454623 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln"] Jun 15 15:18:34.469582 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.469530 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln"] Jun 15 15:18:34.500999 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.500965 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x"] Jun 15 15:18:34.503998 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.503969 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:34.521754 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.521714 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt"] Jun 15 15:18:34.521981 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.521954 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" containerName="manager" containerID="cri-o://6f25830444f6a0a9eb808c83bade5792d1490d36d6d5fc27c9327d3485e385c9" gracePeriod=2 Jun 15 15:18:34.529262 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.528958 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt"] Jun 15 15:18:34.539513 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.539423 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x"] Jun 15 15:18:34.585510 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.585463 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:34.633313 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.633271 2567 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 15 15:18:34.633313 ip-10-0-139-197 kubenswrapper[2567]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-tzqln_kuadrant-system_72711f37-37eb-4e5f-a891-425f3a1153d3_0(a39f042035de2030a68f9d417491d638a1ad72ee10912741ef586b8e58cb7c5e): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-tzqln to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a39f042035de2030a68f9d417491d638a1ad72ee10912741ef586b8e58cb7c5e" Netns:"/var/run/netns/72eb053e-6a40-401a-b895-8e53e2d34043" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-tzqln;K8S_POD_INFRA_CONTAINER_ID=a39f042035de2030a68f9d417491d638a1ad72ee10912741ef586b8e58cb7c5e;K8S_POD_UID=72711f37-37eb-4e5f-a891-425f3a1153d3" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln/72711f37-37eb-4e5f-a891-425f3a1153d3]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-tzqln in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-tzqln in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-tzqln" not found Jun 15 15:18:34.633313 ip-10-0-139-197 kubenswrapper[2567]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 15 15:18:34.633313 ip-10-0-139-197 kubenswrapper[2567]: > Jun 15 15:18:34.633475 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.633347 2567 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 15 15:18:34.633475 ip-10-0-139-197 kubenswrapper[2567]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-tzqln_kuadrant-system_72711f37-37eb-4e5f-a891-425f3a1153d3_0(a39f042035de2030a68f9d417491d638a1ad72ee10912741ef586b8e58cb7c5e): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-tzqln to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a39f042035de2030a68f9d417491d638a1ad72ee10912741ef586b8e58cb7c5e" Netns:"/var/run/netns/72eb053e-6a40-401a-b895-8e53e2d34043" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-tzqln;K8S_POD_INFRA_CONTAINER_ID=a39f042035de2030a68f9d417491d638a1ad72ee10912741ef586b8e58cb7c5e;K8S_POD_UID=72711f37-37eb-4e5f-a891-425f3a1153d3" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln/72711f37-37eb-4e5f-a891-425f3a1153d3]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-tzqln in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-tzqln in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-tzqln" not found Jun 15 15:18:34.633475 ip-10-0-139-197 kubenswrapper[2567]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 15 15:18:34.633475 ip-10-0-139-197 kubenswrapper[2567]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.678534 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.678499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58e37851-aa87-443d-86c7-f3cee09dc4e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv46x\" (UID: \"58e37851-aa87-443d-86c7-f3cee09dc4e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:34.678696 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.678552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68thr\" (UniqueName: \"kubernetes.io/projected/58e37851-aa87-443d-86c7-f3cee09dc4e8-kube-api-access-68thr\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv46x\" (UID: \"58e37851-aa87-443d-86c7-f3cee09dc4e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:34.731399 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.731367 2567 generic.go:356] "Generic (PLEG): container finished" podID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" containerID="6f25830444f6a0a9eb808c83bade5792d1490d36d6d5fc27c9327d3485e385c9" exitCode=0 Jun 15 15:18:34.731579 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.731464 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.733930 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.733895 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:34.736064 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.736033 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="72711f37-37eb-4e5f-a891-425f3a1153d3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.738841 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.738818 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.741087 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.741052 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="72711f37-37eb-4e5f-a891-425f3a1153d3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.743130 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.743085 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:34.754382 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.754355 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:34.756738 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.756708 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="72711f37-37eb-4e5f-a891-425f3a1153d3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:34.758773 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:34.758742 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:34.779935 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.779893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58e37851-aa87-443d-86c7-f3cee09dc4e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv46x\" (UID: \"58e37851-aa87-443d-86c7-f3cee09dc4e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:34.780093 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.779953 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68thr\" (UniqueName: \"kubernetes.io/projected/58e37851-aa87-443d-86c7-f3cee09dc4e8-kube-api-access-68thr\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv46x\" (UID: \"58e37851-aa87-443d-86c7-f3cee09dc4e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:34.780320 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.780296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58e37851-aa87-443d-86c7-f3cee09dc4e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv46x\" (UID: \"58e37851-aa87-443d-86c7-f3cee09dc4e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:34.789274 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.789248 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68thr\" (UniqueName: \"kubernetes.io/projected/58e37851-aa87-443d-86c7-f3cee09dc4e8-kube-api-access-68thr\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv46x\" (UID: \"58e37851-aa87-443d-86c7-f3cee09dc4e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:34.816243 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.816211 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:34.880831 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.880751 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krm8b\" (UniqueName: \"kubernetes.io/projected/72711f37-37eb-4e5f-a891-425f3a1153d3-kube-api-access-krm8b\") pod \"72711f37-37eb-4e5f-a891-425f3a1153d3\" (UID: \"72711f37-37eb-4e5f-a891-425f3a1153d3\") " Jun 15 15:18:34.880831 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.880816 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-extensions-socket-volume\") pod \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\" (UID: \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\") " Jun 15 15:18:34.881016 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.880851 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trsw5\" (UniqueName: \"kubernetes.io/projected/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-kube-api-access-trsw5\") pod \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\" (UID: \"66fc3d12-561a-4c3f-a919-bdd8fcd3999c\") " Jun 15 15:18:34.881016 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.880889 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72711f37-37eb-4e5f-a891-425f3a1153d3-extensions-socket-volume\") pod \"72711f37-37eb-4e5f-a891-425f3a1153d3\" (UID: \"72711f37-37eb-4e5f-a891-425f3a1153d3\") " Jun 15 15:18:34.881255 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.881230 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72711f37-37eb-4e5f-a891-425f3a1153d3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "72711f37-37eb-4e5f-a891-425f3a1153d3" (UID: "72711f37-37eb-4e5f-a891-425f3a1153d3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 15:18:34.881616 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.881587 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "66fc3d12-561a-4c3f-a919-bdd8fcd3999c" (UID: "66fc3d12-561a-4c3f-a919-bdd8fcd3999c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 15:18:34.883227 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.883196 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72711f37-37eb-4e5f-a891-425f3a1153d3-kube-api-access-krm8b" (OuterVolumeSpecName: "kube-api-access-krm8b") pod "72711f37-37eb-4e5f-a891-425f3a1153d3" (UID: "72711f37-37eb-4e5f-a891-425f3a1153d3"). InnerVolumeSpecName "kube-api-access-krm8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:18:34.883365 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.883201 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-kube-api-access-trsw5" (OuterVolumeSpecName: "kube-api-access-trsw5") pod "66fc3d12-561a-4c3f-a919-bdd8fcd3999c" (UID: "66fc3d12-561a-4c3f-a919-bdd8fcd3999c"). InnerVolumeSpecName "kube-api-access-trsw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:18:34.954201 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.954172 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x"] Jun 15 15:18:34.956882 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:18:34.956854 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e37851_aa87_443d_86c7_f3cee09dc4e8.slice/crio-acfd0352ebed2acf0fdac22b4be261c6a3b83869fa6eb84a12de4b80f6456d1b WatchSource:0}: Error finding container acfd0352ebed2acf0fdac22b4be261c6a3b83869fa6eb84a12de4b80f6456d1b: Status 404 returned error can't find the container with id acfd0352ebed2acf0fdac22b4be261c6a3b83869fa6eb84a12de4b80f6456d1b Jun 15 15:18:34.981741 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.981717 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72711f37-37eb-4e5f-a891-425f3a1153d3-extensions-socket-volume\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:18:34.981848 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.981744 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krm8b\" (UniqueName: \"kubernetes.io/projected/72711f37-37eb-4e5f-a891-425f3a1153d3-kube-api-access-krm8b\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:18:34.981848 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.981759 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-extensions-socket-volume\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:18:34.981848 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:34.981773 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trsw5\" (UniqueName: \"kubernetes.io/projected/66fc3d12-561a-4c3f-a919-bdd8fcd3999c-kube-api-access-trsw5\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:18:35.737258 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.737162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" event={"ID":"58e37851-aa87-443d-86c7-f3cee09dc4e8","Type":"ContainerStarted","Data":"45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c"} Jun 15 15:18:35.737258 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.737228 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" event={"ID":"58e37851-aa87-443d-86c7-f3cee09dc4e8","Type":"ContainerStarted","Data":"acfd0352ebed2acf0fdac22b4be261c6a3b83869fa6eb84a12de4b80f6456d1b"} Jun 15 15:18:35.737761 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.737308 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:35.738775 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.738753 2567 scope.go:117] "RemoveContainer" containerID="6f25830444f6a0a9eb808c83bade5792d1490d36d6d5fc27c9327d3485e385c9" Jun 15 15:18:35.738885 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.738757 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:35.738947 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.738759 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:35.760761 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:35.760698 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:35.760964 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.760916 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" podStartSLOduration=1.760895604 podStartE2EDuration="1.760895604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:18:35.75875822 +0000 UTC m=+714.417711919" watchObservedRunningTime="2026-06-15 15:18:35.760895604 +0000 UTC m=+714.419849308" Jun 15 15:18:35.762562 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:35.762533 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="72711f37-37eb-4e5f-a891-425f3a1153d3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:35.764318 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:35.764299 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2tgt\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2tgt" Jun 15 15:18:35.766174 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:35.766146 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tzqln\" is forbidden: User \"system:node:ip-10-0-139-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-197.ec2.internal' and this object" podUID="72711f37-37eb-4e5f-a891-425f3a1153d3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tzqln" Jun 15 15:18:35.841133 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.841077 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" path="/var/lib/kubelet/pods/66fc3d12-561a-4c3f-a919-bdd8fcd3999c/volumes" Jun 15 15:18:35.841467 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:35.841453 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72711f37-37eb-4e5f-a891-425f3a1153d3" path="/var/lib/kubelet/pods/72711f37-37eb-4e5f-a891-425f3a1153d3/volumes" Jun 15 15:18:46.747104 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:46.747067 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:47.081821 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.081779 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b"] Jun 15 15:18:47.082159 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.082145 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" containerName="manager" Jun 15 15:18:47.082159 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.082160 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" containerName="manager" Jun 15 15:18:47.082248 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.082222 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fc3d12-561a-4c3f-a919-bdd8fcd3999c" containerName="manager" Jun 15 15:18:47.089297 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.089267 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.103355 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.103322 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b"] Jun 15 15:18:47.192528 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.192479 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00d07ac4-3514-46d5-873d-8e9c2820efcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c655b\" (UID: \"00d07ac4-3514-46d5-873d-8e9c2820efcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.192716 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.192539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lclxj\" (UniqueName: \"kubernetes.io/projected/00d07ac4-3514-46d5-873d-8e9c2820efcd-kube-api-access-lclxj\") pod \"kuadrant-operator-controller-manager-86878c769f-c655b\" (UID: \"00d07ac4-3514-46d5-873d-8e9c2820efcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.293568 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.293462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00d07ac4-3514-46d5-873d-8e9c2820efcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c655b\" (UID: \"00d07ac4-3514-46d5-873d-8e9c2820efcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.293568 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.293521 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lclxj\" (UniqueName: \"kubernetes.io/projected/00d07ac4-3514-46d5-873d-8e9c2820efcd-kube-api-access-lclxj\") pod \"kuadrant-operator-controller-manager-86878c769f-c655b\" (UID: \"00d07ac4-3514-46d5-873d-8e9c2820efcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.293850 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.293827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00d07ac4-3514-46d5-873d-8e9c2820efcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c655b\" (UID: \"00d07ac4-3514-46d5-873d-8e9c2820efcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.308147 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.308092 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lclxj\" (UniqueName: \"kubernetes.io/projected/00d07ac4-3514-46d5-873d-8e9c2820efcd-kube-api-access-lclxj\") pod \"kuadrant-operator-controller-manager-86878c769f-c655b\" (UID: \"00d07ac4-3514-46d5-873d-8e9c2820efcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.400201 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.400161 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.549238 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.549203 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b"] Jun 15 15:18:47.551561 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:18:47.551528 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d07ac4_3514_46d5_873d_8e9c2820efcd.slice/crio-5e783a5c6bf3fb4a04c94bd5918a59a9a51b65e374fa95d60ebc036bf98ff347 WatchSource:0}: Error finding container 5e783a5c6bf3fb4a04c94bd5918a59a9a51b65e374fa95d60ebc036bf98ff347: Status 404 returned error can't find the container with id 5e783a5c6bf3fb4a04c94bd5918a59a9a51b65e374fa95d60ebc036bf98ff347 Jun 15 15:18:47.796561 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.796522 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" event={"ID":"00d07ac4-3514-46d5-873d-8e9c2820efcd","Type":"ContainerStarted","Data":"d61e888c654096047ed080f4ba6d00bd2ee7763398ebb86722cee7ff3ab77177"} Jun 15 15:18:47.796957 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.796578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" event={"ID":"00d07ac4-3514-46d5-873d-8e9c2820efcd","Type":"ContainerStarted","Data":"5e783a5c6bf3fb4a04c94bd5918a59a9a51b65e374fa95d60ebc036bf98ff347"} Jun 15 15:18:47.796957 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.796626 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:47.816583 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:47.816476 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" podStartSLOduration=0.816454312 podStartE2EDuration="816.454312ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:18:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:18:47.814716182 +0000 UTC m=+726.473669895" watchObservedRunningTime="2026-06-15 15:18:47.816454312 +0000 UTC m=+726.475408011" Jun 15 15:18:58.803760 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:58.803723 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c655b" Jun 15 15:18:58.858876 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:58.858834 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x"] Jun 15 15:18:58.859217 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:58.859087 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" podUID="58e37851-aa87-443d-86c7-f3cee09dc4e8" containerName="manager" containerID="cri-o://45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c" gracePeriod=10 Jun 15 15:18:59.116312 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.116287 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:59.207172 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.207138 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58e37851-aa87-443d-86c7-f3cee09dc4e8-extensions-socket-volume\") pod \"58e37851-aa87-443d-86c7-f3cee09dc4e8\" (UID: \"58e37851-aa87-443d-86c7-f3cee09dc4e8\") " Jun 15 15:18:59.207373 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.207197 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68thr\" (UniqueName: \"kubernetes.io/projected/58e37851-aa87-443d-86c7-f3cee09dc4e8-kube-api-access-68thr\") pod \"58e37851-aa87-443d-86c7-f3cee09dc4e8\" (UID: \"58e37851-aa87-443d-86c7-f3cee09dc4e8\") " Jun 15 15:18:59.207568 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.207541 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e37851-aa87-443d-86c7-f3cee09dc4e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "58e37851-aa87-443d-86c7-f3cee09dc4e8" (UID: "58e37851-aa87-443d-86c7-f3cee09dc4e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 15:18:59.209581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.209555 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e37851-aa87-443d-86c7-f3cee09dc4e8-kube-api-access-68thr" (OuterVolumeSpecName: "kube-api-access-68thr") pod "58e37851-aa87-443d-86c7-f3cee09dc4e8" (UID: "58e37851-aa87-443d-86c7-f3cee09dc4e8"). InnerVolumeSpecName "kube-api-access-68thr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:18:59.308395 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.308356 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68thr\" (UniqueName: \"kubernetes.io/projected/58e37851-aa87-443d-86c7-f3cee09dc4e8-kube-api-access-68thr\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:18:59.308395 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.308386 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58e37851-aa87-443d-86c7-f3cee09dc4e8-extensions-socket-volume\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:18:59.853290 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.853252 2567 generic.go:356] "Generic (PLEG): container finished" podID="58e37851-aa87-443d-86c7-f3cee09dc4e8" containerID="45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c" exitCode=0 Jun 15 15:18:59.853737 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.853303 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" Jun 15 15:18:59.853737 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.853296 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" event={"ID":"58e37851-aa87-443d-86c7-f3cee09dc4e8","Type":"ContainerDied","Data":"45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c"} Jun 15 15:18:59.853737 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.853446 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x" event={"ID":"58e37851-aa87-443d-86c7-f3cee09dc4e8","Type":"ContainerDied","Data":"acfd0352ebed2acf0fdac22b4be261c6a3b83869fa6eb84a12de4b80f6456d1b"} Jun 15 15:18:59.853737 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.853478 2567 scope.go:117] "RemoveContainer" containerID="45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c" Jun 15 15:18:59.862661 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.862488 2567 scope.go:117] "RemoveContainer" containerID="45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c" Jun 15 15:18:59.862844 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:18:59.862818 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c\": container with ID starting with 45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c not found: ID does not exist" containerID="45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c" Jun 15 15:18:59.862887 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.862855 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c"} err="failed to get container status \"45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c\": rpc error: code = NotFound desc = could not find container \"45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c\": container with ID starting with 45fcc75728ac1ece7974591a1bbfc595ef9abf132e86d662cb1f62c0688aa48c not found: ID does not exist" Jun 15 15:18:59.883518 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.883480 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x"] Jun 15 15:18:59.889529 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:18:59.889496 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv46x"] Jun 15 15:19:01.842457 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:01.842421 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e37851-aa87-443d-86c7-f3cee09dc4e8" path="/var/lib/kubelet/pods/58e37851-aa87-443d-86c7-f3cee09dc4e8/volumes" Jun 15 15:19:03.180326 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.180291 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v"] Jun 15 15:19:03.180733 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.180656 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e37851-aa87-443d-86c7-f3cee09dc4e8" containerName="manager" Jun 15 15:19:03.180733 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.180667 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e37851-aa87-443d-86c7-f3cee09dc4e8" containerName="manager" Jun 15 15:19:03.180733 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.180722 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e37851-aa87-443d-86c7-f3cee09dc4e8" containerName="manager" Jun 15 15:19:03.183620 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.183590 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.186329 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.186310 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5dq6m\"" Jun 15 15:19:03.202305 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.202271 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v"] Jun 15 15:19:03.247495 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.247711 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.247711 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07297bd2-dbda-4ba7-b728-92254d114207-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.247711 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvd9\" (UniqueName: \"kubernetes.io/projected/07297bd2-dbda-4ba7-b728-92254d114207-kube-api-access-lsvd9\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.247711 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247661 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.247711 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07297bd2-dbda-4ba7-b728-92254d114207-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.247879 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.247879 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07297bd2-dbda-4ba7-b728-92254d114207-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.247879 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.247821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349053 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349301 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349301 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349301 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349162 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07297bd2-dbda-4ba7-b728-92254d114207-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349301 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvd9\" (UniqueName: \"kubernetes.io/projected/07297bd2-dbda-4ba7-b728-92254d114207-kube-api-access-lsvd9\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349301 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349264 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349301 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07297bd2-dbda-4ba7-b728-92254d114207-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349601 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349601 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07297bd2-dbda-4ba7-b728-92254d114207-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349601 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349502 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349601 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349532 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349807 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349630 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.349854 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.349801 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.350348 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.350319 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07297bd2-dbda-4ba7-b728-92254d114207-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.351780 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.351757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07297bd2-dbda-4ba7-b728-92254d114207-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.352039 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.352020 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07297bd2-dbda-4ba7-b728-92254d114207-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.357965 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.357936 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07297bd2-dbda-4ba7-b728-92254d114207-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.357965 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.357958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvd9\" (UniqueName: \"kubernetes.io/projected/07297bd2-dbda-4ba7-b728-92254d114207-kube-api-access-lsvd9\") pod \"maas-default-gateway-openshift-default-687ff6996-dnh6v\" (UID: \"07297bd2-dbda-4ba7-b728-92254d114207\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.493409 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.493376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:03.642382 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.642350 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v"] Jun 15 15:19:03.644463 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:19:03.644435 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07297bd2_dbda_4ba7_b728_92254d114207.slice/crio-bbc5f4cc7fd0aa2e342d20099455d074f927d849f0874b2aae7a4ef1929a8778 WatchSource:0}: Error finding container bbc5f4cc7fd0aa2e342d20099455d074f927d849f0874b2aae7a4ef1929a8778: Status 404 returned error can't find the container with id bbc5f4cc7fd0aa2e342d20099455d074f927d849f0874b2aae7a4ef1929a8778 Jun 15 15:19:03.646738 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.646702 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:19:03.646818 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.646776 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:19:03.646818 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.646803 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:19:03.875268 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.875164 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" event={"ID":"07297bd2-dbda-4ba7-b728-92254d114207","Type":"ContainerStarted","Data":"2245b0d59b4b697f8eaf46f0d846af5e01a2fdd3b845315507d62fdb3c28b7c8"} Jun 15 15:19:03.875268 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.875238 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" event={"ID":"07297bd2-dbda-4ba7-b728-92254d114207","Type":"ContainerStarted","Data":"bbc5f4cc7fd0aa2e342d20099455d074f927d849f0874b2aae7a4ef1929a8778"} Jun 15 15:19:03.896585 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:03.896525 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" podStartSLOduration=0.8965059 podStartE2EDuration="896.5059ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:19:03.893629878 +0000 UTC m=+742.552583578" watchObservedRunningTime="2026-06-15 15:19:03.8965059 +0000 UTC m=+742.555459600" Jun 15 15:19:04.494580 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:04.494543 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:04.499329 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:04.499292 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:04.880478 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:04.880390 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:04.881384 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:04.881366 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:19:19.221874 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.221833 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-27dzl"] Jun 15 15:19:19.224842 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.224822 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-27dzl" Jun 15 15:19:19.227695 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.227668 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-scwqd\"" Jun 15 15:19:19.234348 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.234322 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-27dzl"] Jun 15 15:19:19.401297 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.401261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxzzs\" (UniqueName: \"kubernetes.io/projected/d6477b31-93e7-4ed8-8415-4ad7eee7d304-kube-api-access-sxzzs\") pod \"authorino-58cd955675-27dzl\" (UID: \"d6477b31-93e7-4ed8-8415-4ad7eee7d304\") " pod="kuadrant-system/authorino-58cd955675-27dzl" Jun 15 15:19:19.502691 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.502657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxzzs\" (UniqueName: \"kubernetes.io/projected/d6477b31-93e7-4ed8-8415-4ad7eee7d304-kube-api-access-sxzzs\") pod \"authorino-58cd955675-27dzl\" (UID: \"d6477b31-93e7-4ed8-8415-4ad7eee7d304\") " pod="kuadrant-system/authorino-58cd955675-27dzl" Jun 15 15:19:19.511960 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.511928 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxzzs\" (UniqueName: \"kubernetes.io/projected/d6477b31-93e7-4ed8-8415-4ad7eee7d304-kube-api-access-sxzzs\") pod \"authorino-58cd955675-27dzl\" (UID: \"d6477b31-93e7-4ed8-8415-4ad7eee7d304\") " pod="kuadrant-system/authorino-58cd955675-27dzl" Jun 15 15:19:19.536528 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.536495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-27dzl" Jun 15 15:19:19.675892 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.675857 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-27dzl"] Jun 15 15:19:19.679398 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:19:19.679370 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6477b31_93e7_4ed8_8415_4ad7eee7d304.slice/crio-116c630a769d64b72ad5bb317d681749dcad0ff9b2d30a2a914297b6238e601b WatchSource:0}: Error finding container 116c630a769d64b72ad5bb317d681749dcad0ff9b2d30a2a914297b6238e601b: Status 404 returned error can't find the container with id 116c630a769d64b72ad5bb317d681749dcad0ff9b2d30a2a914297b6238e601b Jun 15 15:19:19.950055 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:19.949970 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-27dzl" event={"ID":"d6477b31-93e7-4ed8-8415-4ad7eee7d304","Type":"ContainerStarted","Data":"116c630a769d64b72ad5bb317d681749dcad0ff9b2d30a2a914297b6238e601b"} Jun 15 15:19:22.975274 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:22.975232 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-27dzl" event={"ID":"d6477b31-93e7-4ed8-8415-4ad7eee7d304","Type":"ContainerStarted","Data":"d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4"} Jun 15 15:19:23.006225 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:23.006164 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-27dzl" podStartSLOduration=0.926355664 podStartE2EDuration="4.00614349s" totalImagesPullingTime="3.079787826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:19:23.005494119 +0000 UTC m=+761.664447819" watchObservedRunningTime="2026-06-15 15:19:23.00614349 +0000 UTC m=+761.665097190" Jun 15 15:19:24.639975 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:24.639931 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-27dzl"] Jun 15 15:19:24.985213 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:24.985096 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-27dzl" podUID="d6477b31-93e7-4ed8-8415-4ad7eee7d304" containerName="authorino" containerID="cri-o://d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4" gracePeriod=30 Jun 15 15:19:25.243773 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.243746 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-27dzl" Jun 15 15:19:25.248283 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.248261 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxzzs\" (UniqueName: \"kubernetes.io/projected/d6477b31-93e7-4ed8-8415-4ad7eee7d304-kube-api-access-sxzzs\") pod \"d6477b31-93e7-4ed8-8415-4ad7eee7d304\" (UID: \"d6477b31-93e7-4ed8-8415-4ad7eee7d304\") " Jun 15 15:19:25.250462 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.250431 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6477b31-93e7-4ed8-8415-4ad7eee7d304-kube-api-access-sxzzs" (OuterVolumeSpecName: "kube-api-access-sxzzs") pod "d6477b31-93e7-4ed8-8415-4ad7eee7d304" (UID: "d6477b31-93e7-4ed8-8415-4ad7eee7d304"). InnerVolumeSpecName "kube-api-access-sxzzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:19:25.349084 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.349038 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxzzs\" (UniqueName: \"kubernetes.io/projected/d6477b31-93e7-4ed8-8415-4ad7eee7d304-kube-api-access-sxzzs\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:19:25.991258 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.991219 2567 generic.go:356] "Generic (PLEG): container finished" podID="d6477b31-93e7-4ed8-8415-4ad7eee7d304" containerID="d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4" exitCode=0 Jun 15 15:19:25.991742 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.991263 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-27dzl" Jun 15 15:19:25.991742 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.991308 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-27dzl" event={"ID":"d6477b31-93e7-4ed8-8415-4ad7eee7d304","Type":"ContainerDied","Data":"d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4"} Jun 15 15:19:25.991742 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.991366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-27dzl" event={"ID":"d6477b31-93e7-4ed8-8415-4ad7eee7d304","Type":"ContainerDied","Data":"116c630a769d64b72ad5bb317d681749dcad0ff9b2d30a2a914297b6238e601b"} Jun 15 15:19:25.991742 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:25.991391 2567 scope.go:117] "RemoveContainer" containerID="d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4" Jun 15 15:19:26.000152 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:26.000132 2567 scope.go:117] "RemoveContainer" containerID="d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4" Jun 15 15:19:26.000444 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:19:26.000422 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4\": container with ID starting with d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4 not found: ID does not exist" containerID="d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4" Jun 15 15:19:26.000502 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:26.000458 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4"} err="failed to get container status \"d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4\": rpc error: code = NotFound desc = could not find container \"d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4\": container with ID starting with d9d5584e1214fc5c77ed36de068a9988e02a4dab06d72a5b9fec3305179bcfe4 not found: ID does not exist" Jun 15 15:19:26.007443 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:26.007409 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-27dzl"] Jun 15 15:19:26.008841 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:26.008820 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-27dzl"] Jun 15 15:19:27.841516 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:19:27.841480 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6477b31-93e7-4ed8-8415-4ad7eee7d304" path="/var/lib/kubelet/pods/d6477b31-93e7-4ed8-8415-4ad7eee7d304/volumes" Jun 15 15:20:12.936812 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.936776 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:20:12.937581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.937147 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6477b31-93e7-4ed8-8415-4ad7eee7d304" containerName="authorino" Jun 15 15:20:12.937581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.937160 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6477b31-93e7-4ed8-8415-4ad7eee7d304" containerName="authorino" Jun 15 15:20:12.937581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.937232 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6477b31-93e7-4ed8-8415-4ad7eee7d304" containerName="authorino" Jun 15 15:20:12.939602 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.939582 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:12.942414 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.942385 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 15:20:12.942555 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.942390 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 15:20:12.942555 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.942396 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fx49k\"" Jun 15 15:20:12.942555 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.942447 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 15:20:12.950908 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.950881 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:20:12.997931 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:12.997899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvcf7\" (UniqueName: \"kubernetes.io/projected/8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7-kube-api-access-xvcf7\") pod \"maas-keycloak-0\" (UID: \"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:13.099219 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:13.099153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvcf7\" (UniqueName: \"kubernetes.io/projected/8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7-kube-api-access-xvcf7\") pod \"maas-keycloak-0\" (UID: \"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:13.107899 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:13.107863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvcf7\" (UniqueName: \"kubernetes.io/projected/8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7-kube-api-access-xvcf7\") pod \"maas-keycloak-0\" (UID: \"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:13.249830 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:13.249799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:13.390483 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:13.390452 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:20:13.392788 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:20:13.392758 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e69c585_3d87_4d3f_80a8_ad5c3a25a4e7.slice/crio-088030cf901bd99fce5c5fbb06455ab96288dc72363f8405675942d452d787f0 WatchSource:0}: Error finding container 088030cf901bd99fce5c5fbb06455ab96288dc72363f8405675942d452d787f0: Status 404 returned error can't find the container with id 088030cf901bd99fce5c5fbb06455ab96288dc72363f8405675942d452d787f0 Jun 15 15:20:14.213939 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:14.213896 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7","Type":"ContainerStarted","Data":"088030cf901bd99fce5c5fbb06455ab96288dc72363f8405675942d452d787f0"} Jun 15 15:20:19.245139 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:19.245084 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7","Type":"ContainerStarted","Data":"25b554393cdca4fb0a557ba9c790326fa946cbce6b4e25648fb200c67b968654"} Jun 15 15:20:19.250202 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:19.250169 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:19.252473 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:19.252428 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:19.264946 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:19.264888 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.439403639 podStartE2EDuration="7.264872204s" totalImagesPullingTime="4.825468565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:20:19.263550508 +0000 UTC m=+817.922504233" watchObservedRunningTime="2026-06-15 15:20:19.264872204 +0000 UTC m=+817.923825905" Jun 15 15:20:20.250657 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:20.250611 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:21.251029 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:21.250874 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:22.251415 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:22.251371 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:23.250350 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:23.250295 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:23.250713 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:23.250665 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:24.252187 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:24.252138 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:25.251333 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:25.251270 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:26.250790 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:26.250738 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:27.250640 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:27.250579 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:28.251283 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:28.251227 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:29.251396 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:29.251345 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:30.250510 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:30.250464 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:31.250573 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:31.250518 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 15 15:20:32.376062 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:32.376019 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:32.391546 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:32.391485 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 15:20:42.383264 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:42.383226 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 15:20:49.194706 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.194665 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d6498d7dc-9krdb"] Jun 15 15:20:49.202687 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.202657 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:49.204983 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.204958 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 15:20:49.205531 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.205508 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xtzkt\"" Jun 15 15:20:49.205650 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.205546 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 15:20:49.209080 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.209045 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d6498d7dc-9krdb"] Jun 15 15:20:49.269181 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.269109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert\") pod \"maas-controller-d6498d7dc-9krdb\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:49.269374 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.269224 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdzc\" (UniqueName: \"kubernetes.io/projected/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-kube-api-access-fhdzc\") pod \"maas-controller-d6498d7dc-9krdb\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:49.369835 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.369796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdzc\" (UniqueName: \"kubernetes.io/projected/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-kube-api-access-fhdzc\") pod \"maas-controller-d6498d7dc-9krdb\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:49.370025 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.369900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert\") pod \"maas-controller-d6498d7dc-9krdb\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:49.370025 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:20:49.369992 2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 15 15:20:49.370110 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:20:49.370051 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert podName:bf6e8759-9bd9-405a-bb6f-7b17c81a974e nodeName:}" failed. No retries permitted until 2026-06-15 15:20:49.870033205 +0000 UTC m=+848.528986884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert") pod "maas-controller-d6498d7dc-9krdb" (UID: "bf6e8759-9bd9-405a-bb6f-7b17c81a974e") : secret "maas-controller-webhook-cert" not found Jun 15 15:20:49.379092 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.379063 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdzc\" (UniqueName: \"kubernetes.io/projected/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-kube-api-access-fhdzc\") pod \"maas-controller-d6498d7dc-9krdb\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:49.381605 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.381576 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-764f4d48f5-j8b8b"] Jun 15 15:20:49.384345 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.384325 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:49.396642 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.396607 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-764f4d48f5-j8b8b"] Jun 15 15:20:49.470850 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.470754 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7nbc\" (UniqueName: \"kubernetes.io/projected/8876db8e-e42f-4cd1-b4d0-b41689cc0591-kube-api-access-w7nbc\") pod \"maas-controller-764f4d48f5-j8b8b\" (UID: \"8876db8e-e42f-4cd1-b4d0-b41689cc0591\") " pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:49.471004 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.470876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8876db8e-e42f-4cd1-b4d0-b41689cc0591-webhook-cert\") pod \"maas-controller-764f4d48f5-j8b8b\" (UID: \"8876db8e-e42f-4cd1-b4d0-b41689cc0591\") " pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:49.571568 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.571514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7nbc\" (UniqueName: \"kubernetes.io/projected/8876db8e-e42f-4cd1-b4d0-b41689cc0591-kube-api-access-w7nbc\") pod \"maas-controller-764f4d48f5-j8b8b\" (UID: \"8876db8e-e42f-4cd1-b4d0-b41689cc0591\") " pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:49.571743 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.571639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8876db8e-e42f-4cd1-b4d0-b41689cc0591-webhook-cert\") pod \"maas-controller-764f4d48f5-j8b8b\" (UID: \"8876db8e-e42f-4cd1-b4d0-b41689cc0591\") " pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:49.574581 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.574543 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8876db8e-e42f-4cd1-b4d0-b41689cc0591-webhook-cert\") pod \"maas-controller-764f4d48f5-j8b8b\" (UID: \"8876db8e-e42f-4cd1-b4d0-b41689cc0591\") " pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:49.579858 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.579833 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7nbc\" (UniqueName: \"kubernetes.io/projected/8876db8e-e42f-4cd1-b4d0-b41689cc0591-kube-api-access-w7nbc\") pod \"maas-controller-764f4d48f5-j8b8b\" (UID: \"8876db8e-e42f-4cd1-b4d0-b41689cc0591\") " pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:49.699290 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.699255 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:49.841996 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:20:49.841965 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8876db8e_e42f_4cd1_b4d0_b41689cc0591.slice/crio-8d60fd49a73000d6c07bf3356b11c86e5c03846b02a3bcca2385e4cb4206e8c3 WatchSource:0}: Error finding container 8d60fd49a73000d6c07bf3356b11c86e5c03846b02a3bcca2385e4cb4206e8c3: Status 404 returned error can't find the container with id 8d60fd49a73000d6c07bf3356b11c86e5c03846b02a3bcca2385e4cb4206e8c3 Jun 15 15:20:49.842300 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.842276 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-764f4d48f5-j8b8b"] Jun 15 15:20:49.874270 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.874221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert\") pod \"maas-controller-d6498d7dc-9krdb\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:49.876754 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:49.876733 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert\") pod \"maas-controller-d6498d7dc-9krdb\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:50.114777 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:50.114675 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:50.259206 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:50.259175 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d6498d7dc-9krdb"] Jun 15 15:20:50.260840 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:20:50.260809 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6e8759_9bd9_405a_bb6f_7b17c81a974e.slice/crio-ca9a23b610e2dd1b1ad4e3978a886d347f1a37720e8c28f283565eda797447bc WatchSource:0}: Error finding container ca9a23b610e2dd1b1ad4e3978a886d347f1a37720e8c28f283565eda797447bc: Status 404 returned error can't find the container with id ca9a23b610e2dd1b1ad4e3978a886d347f1a37720e8c28f283565eda797447bc Jun 15 15:20:50.452376 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:50.452288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-764f4d48f5-j8b8b" event={"ID":"8876db8e-e42f-4cd1-b4d0-b41689cc0591","Type":"ContainerStarted","Data":"8d60fd49a73000d6c07bf3356b11c86e5c03846b02a3bcca2385e4cb4206e8c3"} Jun 15 15:20:50.453771 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:50.453727 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6498d7dc-9krdb" event={"ID":"bf6e8759-9bd9-405a-bb6f-7b17c81a974e","Type":"ContainerStarted","Data":"ca9a23b610e2dd1b1ad4e3978a886d347f1a37720e8c28f283565eda797447bc"} Jun 15 15:20:53.471752 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:53.471705 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-764f4d48f5-j8b8b" event={"ID":"8876db8e-e42f-4cd1-b4d0-b41689cc0591","Type":"ContainerStarted","Data":"449f6f8ef4bcc8037cb52086bf68789432924274317d545e5305dd42d75d6dde"} Jun 15 15:20:53.472291 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:53.471943 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:20:53.473429 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:53.473400 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6498d7dc-9krdb" event={"ID":"bf6e8759-9bd9-405a-bb6f-7b17c81a974e","Type":"ContainerStarted","Data":"b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d"} Jun 15 15:20:53.473547 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:53.473480 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:20:53.489864 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:53.489813 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-764f4d48f5-j8b8b" podStartSLOduration=1.838922591 podStartE2EDuration="4.489799228s" totalImagesPullingTime="2.650876637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:20:53.488541041 +0000 UTC m=+852.147494745" watchObservedRunningTime="2026-06-15 15:20:53.489799228 +0000 UTC m=+852.148752928" Jun 15 15:20:53.507428 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:20:53.507374 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d6498d7dc-9krdb" podStartSLOduration=2.26890772 podStartE2EDuration="4.507357177s" totalImagesPullingTime="2.238449457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:20:53.505720309 +0000 UTC m=+852.164674029" watchObservedRunningTime="2026-06-15 15:20:53.507357177 +0000 UTC m=+852.166310909" Jun 15 15:21:04.486249 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.486213 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-764f4d48f5-j8b8b" Jun 15 15:21:04.486733 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.486309 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:21:04.554303 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.554268 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d6498d7dc-9krdb"] Jun 15 15:21:04.554744 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.554705 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d6498d7dc-9krdb" podUID="bf6e8759-9bd9-405a-bb6f-7b17c81a974e" containerName="manager" containerID="cri-o://b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d" gracePeriod=30 Jun 15 15:21:04.808855 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.808828 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:21:04.915624 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.915582 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhdzc\" (UniqueName: \"kubernetes.io/projected/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-kube-api-access-fhdzc\") pod \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " Jun 15 15:21:04.915784 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.915743 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert\") pod \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\" (UID: \"bf6e8759-9bd9-405a-bb6f-7b17c81a974e\") " Jun 15 15:21:04.918164 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.918127 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-kube-api-access-fhdzc" (OuterVolumeSpecName: "kube-api-access-fhdzc") pod "bf6e8759-9bd9-405a-bb6f-7b17c81a974e" (UID: "bf6e8759-9bd9-405a-bb6f-7b17c81a974e"). InnerVolumeSpecName "kube-api-access-fhdzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:21:04.918295 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:04.918215 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bf6e8759-9bd9-405a-bb6f-7b17c81a974e" (UID: "bf6e8759-9bd9-405a-bb6f-7b17c81a974e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 15:21:05.017217 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.017179 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-webhook-cert\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:21:05.017217 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.017209 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhdzc\" (UniqueName: \"kubernetes.io/projected/bf6e8759-9bd9-405a-bb6f-7b17c81a974e-kube-api-access-fhdzc\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:21:05.534472 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.534439 2567 generic.go:356] "Generic (PLEG): container finished" podID="bf6e8759-9bd9-405a-bb6f-7b17c81a974e" containerID="b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d" exitCode=0 Jun 15 15:21:05.534888 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.534486 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6498d7dc-9krdb" Jun 15 15:21:05.534888 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.534498 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6498d7dc-9krdb" event={"ID":"bf6e8759-9bd9-405a-bb6f-7b17c81a974e","Type":"ContainerDied","Data":"b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d"} Jun 15 15:21:05.534888 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.534556 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6498d7dc-9krdb" event={"ID":"bf6e8759-9bd9-405a-bb6f-7b17c81a974e","Type":"ContainerDied","Data":"ca9a23b610e2dd1b1ad4e3978a886d347f1a37720e8c28f283565eda797447bc"} Jun 15 15:21:05.534888 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.534577 2567 scope.go:117] "RemoveContainer" containerID="b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d" Jun 15 15:21:05.544357 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.544337 2567 scope.go:117] "RemoveContainer" containerID="b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d" Jun 15 15:21:05.544712 ip-10-0-139-197 kubenswrapper[2567]: E0615 15:21:05.544694 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d\": container with ID starting with b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d not found: ID does not exist" containerID="b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d" Jun 15 15:21:05.544775 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.544727 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d"} err="failed to get container status \"b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d\": rpc error: code = NotFound desc = could not find container \"b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d\": container with ID starting with b50db615956c102d83ce7d6338f12c5135b2e98875367b446500cfd24872049d not found: ID does not exist" Jun 15 15:21:05.556158 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.556110 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d6498d7dc-9krdb"] Jun 15 15:21:05.559529 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.559502 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d6498d7dc-9krdb"] Jun 15 15:21:05.841432 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:05.841350 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf6e8759-9bd9-405a-bb6f-7b17c81a974e" path="/var/lib/kubelet/pods/bf6e8759-9bd9-405a-bb6f-7b17c81a974e/volumes" Jun 15 15:21:23.922092 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.922049 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7cc8cbb54b-wwshz"] Jun 15 15:21:23.922578 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.922481 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf6e8759-9bd9-405a-bb6f-7b17c81a974e" containerName="manager" Jun 15 15:21:23.922578 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.922495 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf6e8759-9bd9-405a-bb6f-7b17c81a974e" containerName="manager" Jun 15 15:21:23.922578 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.922568 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf6e8759-9bd9-405a-bb6f-7b17c81a974e" containerName="manager" Jun 15 15:21:23.925534 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.925515 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:23.930171 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.930145 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 15 15:21:23.930323 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.930145 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cbqwp\"" Jun 15 15:21:23.939385 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.939354 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cc8cbb54b-wwshz"] Jun 15 15:21:23.993087 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.993041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5m9q\" (UniqueName: \"kubernetes.io/projected/34c746b7-728f-48a2-8732-78705c0a1479-kube-api-access-m5m9q\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:23.993300 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.993107 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c746b7-728f-48a2-8732-78705c0a1479-maas-api-tls\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:23.993300 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:23.993206 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c746b7-728f-48a2-8732-78705c0a1479-openshift-service-ca\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:24.094476 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.094438 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c746b7-728f-48a2-8732-78705c0a1479-maas-api-tls\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:24.094662 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.094490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c746b7-728f-48a2-8732-78705c0a1479-openshift-service-ca\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:24.094662 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.094558 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5m9q\" (UniqueName: \"kubernetes.io/projected/34c746b7-728f-48a2-8732-78705c0a1479-kube-api-access-m5m9q\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:24.095198 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.095176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c746b7-728f-48a2-8732-78705c0a1479-openshift-service-ca\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:24.097083 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.097049 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c746b7-728f-48a2-8732-78705c0a1479-maas-api-tls\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:24.106829 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.106791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5m9q\" (UniqueName: \"kubernetes.io/projected/34c746b7-728f-48a2-8732-78705c0a1479-kube-api-access-m5m9q\") pod \"maas-api-7cc8cbb54b-wwshz\" (UID: \"34c746b7-728f-48a2-8732-78705c0a1479\") " pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:24.236640 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.236539 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:24.392398 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.392368 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cc8cbb54b-wwshz"] Jun 15 15:21:24.394655 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:21:24.394622 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c746b7_728f_48a2_8732_78705c0a1479.slice/crio-38d3e066ff895b251dc920fd093f418b476cce85c29882485459a298e7857110 WatchSource:0}: Error finding container 38d3e066ff895b251dc920fd093f418b476cce85c29882485459a298e7857110: Status 404 returned error can't find the container with id 38d3e066ff895b251dc920fd093f418b476cce85c29882485459a298e7857110 Jun 15 15:21:24.396439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.396417 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 15:21:24.404009 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.403977 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-w76km"] Jun 15 15:21:24.408489 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.408465 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" Jun 15 15:21:24.410949 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.410921 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 15:21:24.411152 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.410979 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-68j5h\"" Jun 15 15:21:24.419952 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.419920 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-w76km"] Jun 15 15:21:24.436411 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.436378 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7qkb6"] Jun 15 15:21:24.439908 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.439882 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" Jun 15 15:21:24.447176 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.447138 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7qkb6"] Jun 15 15:21:24.498410 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.498365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zszp5\" (UniqueName: \"kubernetes.io/projected/0487fea5-e273-40a5-a575-88115f7eeba6-kube-api-access-zszp5\") pod \"payload-processing-699b6cd6c-7qkb6\" (UID: \"0487fea5-e273-40a5-a575-88115f7eeba6\") " pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" Jun 15 15:21:24.498624 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.498503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq55d\" (UniqueName: \"kubernetes.io/projected/908d2284-b0b7-4580-878b-7b2a78175f72-kube-api-access-xq55d\") pod \"payload-pre-processing-579785bc64-w76km\" (UID: \"908d2284-b0b7-4580-878b-7b2a78175f72\") " pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" Jun 15 15:21:24.599526 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.599492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq55d\" (UniqueName: \"kubernetes.io/projected/908d2284-b0b7-4580-878b-7b2a78175f72-kube-api-access-xq55d\") pod \"payload-pre-processing-579785bc64-w76km\" (UID: \"908d2284-b0b7-4580-878b-7b2a78175f72\") " pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" Jun 15 15:21:24.599683 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.599644 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zszp5\" (UniqueName: \"kubernetes.io/projected/0487fea5-e273-40a5-a575-88115f7eeba6-kube-api-access-zszp5\") pod \"payload-processing-699b6cd6c-7qkb6\" (UID: \"0487fea5-e273-40a5-a575-88115f7eeba6\") " pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" Jun 15 15:21:24.607617 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.607579 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zszp5\" (UniqueName: \"kubernetes.io/projected/0487fea5-e273-40a5-a575-88115f7eeba6-kube-api-access-zszp5\") pod \"payload-processing-699b6cd6c-7qkb6\" (UID: \"0487fea5-e273-40a5-a575-88115f7eeba6\") " pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" Jun 15 15:21:24.607617 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.607593 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq55d\" (UniqueName: \"kubernetes.io/projected/908d2284-b0b7-4580-878b-7b2a78175f72-kube-api-access-xq55d\") pod \"payload-pre-processing-579785bc64-w76km\" (UID: \"908d2284-b0b7-4580-878b-7b2a78175f72\") " pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" Jun 15 15:21:24.625997 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.625963 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cc8cbb54b-wwshz" event={"ID":"34c746b7-728f-48a2-8732-78705c0a1479","Type":"ContainerStarted","Data":"38d3e066ff895b251dc920fd093f418b476cce85c29882485459a298e7857110"} Jun 15 15:21:24.720624 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.720582 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" Jun 15 15:21:24.752167 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.752056 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" Jun 15 15:21:24.876999 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.876966 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-w76km"] Jun 15 15:21:24.879494 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:21:24.879445 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908d2284_b0b7_4580_878b_7b2a78175f72.slice/crio-082d27f3d9b5289cbc38867602d53ab12e1de4d6283001e48484b29c96ad3eb6 WatchSource:0}: Error finding container 082d27f3d9b5289cbc38867602d53ab12e1de4d6283001e48484b29c96ad3eb6: Status 404 returned error can't find the container with id 082d27f3d9b5289cbc38867602d53ab12e1de4d6283001e48484b29c96ad3eb6 Jun 15 15:21:24.917593 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:24.917564 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7qkb6"] Jun 15 15:21:25.639928 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:25.639774 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" event={"ID":"0487fea5-e273-40a5-a575-88115f7eeba6","Type":"ContainerStarted","Data":"192d6c197b46253732a4eb35f5f70e32a95b148db1a179fd587a8312934cebfe"} Jun 15 15:21:25.641863 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:25.641830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" event={"ID":"908d2284-b0b7-4580-878b-7b2a78175f72","Type":"ContainerStarted","Data":"082d27f3d9b5289cbc38867602d53ab12e1de4d6283001e48484b29c96ad3eb6"} Jun 15 15:21:28.662918 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.662806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" event={"ID":"908d2284-b0b7-4580-878b-7b2a78175f72","Type":"ContainerStarted","Data":"6623cc85d9e0106ce26abc60531cd4e61a4e28e37cfdea50f6c24440fcd96c48"} Jun 15 15:21:28.663758 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.663724 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" Jun 15 15:21:28.666270 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.666232 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cc8cbb54b-wwshz" event={"ID":"34c746b7-728f-48a2-8732-78705c0a1479","Type":"ContainerStarted","Data":"c061889aa8a6a0c4480e40a9510e87fd30700e048f7b85d8ab03cfffcf74b88e"} Jun 15 15:21:28.666888 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.666858 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:28.670224 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.670180 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" event={"ID":"0487fea5-e273-40a5-a575-88115f7eeba6","Type":"ContainerStarted","Data":"4d8e1463cad7fa30097c877ce58c60db7d80c16687881e847438b064304c5271"} Jun 15 15:21:28.671075 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.671051 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" Jun 15 15:21:28.682016 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.681911 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" podStartSLOduration=1.19743914 podStartE2EDuration="4.681888883s" totalImagesPullingTime="3.484449743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:21:28.678940424 +0000 UTC m=+887.337894127" watchObservedRunningTime="2026-06-15 15:21:28.681888883 +0000 UTC m=+887.340842586" Jun 15 15:21:28.696044 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.695989 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7cc8cbb54b-wwshz" podStartSLOduration=1.790379523 podStartE2EDuration="5.695969521s" totalImagesPullingTime="3.905589998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:21:28.694640353 +0000 UTC m=+887.353594055" watchObservedRunningTime="2026-06-15 15:21:28.695969521 +0000 UTC m=+887.354923269" Jun 15 15:21:28.710577 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:28.710523 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" podStartSLOduration=1.254182538 podStartE2EDuration="4.710503419s" totalImagesPullingTime="3.456320881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:21:28.709154291 +0000 UTC m=+887.368107990" watchObservedRunningTime="2026-06-15 15:21:28.710503419 +0000 UTC m=+887.369457119" Jun 15 15:21:32.692992 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:32.692888 2567 generic.go:356] "Generic (PLEG): container finished" podID="07297bd2-dbda-4ba7-b728-92254d114207" containerID="2245b0d59b4b697f8eaf46f0d846af5e01a2fdd3b845315507d62fdb3c28b7c8" exitCode=0 Jun 15 15:21:32.692992 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:32.692961 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" event={"ID":"07297bd2-dbda-4ba7-b728-92254d114207","Type":"ContainerDied","Data":"2245b0d59b4b697f8eaf46f0d846af5e01a2fdd3b845315507d62fdb3c28b7c8"} Jun 15 15:21:32.693506 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:32.693463 2567 scope.go:117] "RemoveContainer" containerID="2245b0d59b4b697f8eaf46f0d846af5e01a2fdd3b845315507d62fdb3c28b7c8" Jun 15 15:21:32.694521 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:32.694471 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:21:32.694594 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:32.694563 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:21:32.694594 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:32.694594 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 15:21:33.700794 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:33.700751 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" event={"ID":"07297bd2-dbda-4ba7-b728-92254d114207","Type":"ContainerStarted","Data":"9e960250cfdf85b27255b430b202144b4a8c26cf4090d048be8f9b172caf68e0"} Jun 15 15:21:34.493880 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:34.493838 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:21:34.494853 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:34.494816 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-dnh6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 15 15:21:34.494998 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:34.494887 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" podUID="07297bd2-dbda-4ba7-b728-92254d114207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 15 15:21:34.881152 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:34.881021 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:21:35.494564 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:35.494516 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-dnh6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 15 15:21:35.494768 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:35.494579 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" podUID="07297bd2-dbda-4ba7-b728-92254d114207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 15 15:21:35.686539 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:35.686509 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7cc8cbb54b-wwshz" Jun 15 15:21:36.494475 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:36.494441 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-dnh6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 15 15:21:36.494889 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:36.494496 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" podUID="07297bd2-dbda-4ba7-b728-92254d114207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 15 15:21:36.924661 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:36.924568 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:21:36.924829 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:36.924779 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" containerID="cri-o://25b554393cdca4fb0a557ba9c790326fa946cbce6b4e25648fb200c67b968654" gracePeriod=30 Jun 15 15:21:37.494698 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:37.494648 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-dnh6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 15 15:21:37.495231 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:37.494716 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" podUID="07297bd2-dbda-4ba7-b728-92254d114207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 15 15:21:38.498794 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:38.498759 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:21:38.500176 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:38.500148 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dnh6v" Jun 15 15:21:38.727647 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:38.727551 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerID="25b554393cdca4fb0a557ba9c790326fa946cbce6b4e25648fb200c67b968654" exitCode=143 Jun 15 15:21:38.727647 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:38.727629 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7","Type":"ContainerDied","Data":"25b554393cdca4fb0a557ba9c790326fa946cbce6b4e25648fb200c67b968654"} Jun 15 15:21:38.987283 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:38.987207 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:39.041376 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.041337 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvcf7\" (UniqueName: \"kubernetes.io/projected/8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7-kube-api-access-xvcf7\") pod \"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7\" (UID: \"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7\") " Jun 15 15:21:39.043754 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.043721 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7-kube-api-access-xvcf7" (OuterVolumeSpecName: "kube-api-access-xvcf7") pod "8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" (UID: "8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7"). InnerVolumeSpecName "kube-api-access-xvcf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 15:21:39.142592 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.142554 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvcf7\" (UniqueName: \"kubernetes.io/projected/8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7-kube-api-access-xvcf7\") on node \"ip-10-0-139-197.ec2.internal\" DevicePath \"\"" Jun 15 15:21:39.678797 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.678758 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-7qkb6" Jun 15 15:21:39.734087 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.734056 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:39.734293 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.734049 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7","Type":"ContainerDied","Data":"088030cf901bd99fce5c5fbb06455ab96288dc72363f8405675942d452d787f0"} Jun 15 15:21:39.734293 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.734228 2567 scope.go:117] "RemoveContainer" containerID="25b554393cdca4fb0a557ba9c790326fa946cbce6b4e25648fb200c67b968654" Jun 15 15:21:39.757467 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.757431 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:21:39.764043 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.764009 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:21:39.785539 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.785503 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:21:39.785894 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.785881 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" Jun 15 15:21:39.785939 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.785896 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" Jun 15 15:21:39.785975 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.785953 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" containerName="keycloak" Jun 15 15:21:39.788971 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.788950 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:39.791610 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.791581 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 15:21:39.791610 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.791581 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 15:21:39.791794 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.791692 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 15:21:39.791895 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.791880 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 15 15:21:39.791963 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.791883 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fx49k\"" Jun 15 15:21:39.799267 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.799242 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:21:39.841919 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.841881 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7" path="/var/lib/kubelet/pods/8e69c585-3d87-4d3f-80a8-ad5c3a25a4e7/volumes" Jun 15 15:21:39.849247 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.849212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b9nr\" (UniqueName: \"kubernetes.io/projected/29554551-3ac6-492b-a692-ad6cead0826d-kube-api-access-2b9nr\") pod \"maas-keycloak-0\" (UID: \"29554551-3ac6-492b-a692-ad6cead0826d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:39.849403 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.849262 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29554551-3ac6-492b-a692-ad6cead0826d-test-realms\") pod \"maas-keycloak-0\" (UID: \"29554551-3ac6-492b-a692-ad6cead0826d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:39.949868 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.949764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29554551-3ac6-492b-a692-ad6cead0826d-test-realms\") pod \"maas-keycloak-0\" (UID: \"29554551-3ac6-492b-a692-ad6cead0826d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:39.950042 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.949918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b9nr\" (UniqueName: \"kubernetes.io/projected/29554551-3ac6-492b-a692-ad6cead0826d-kube-api-access-2b9nr\") pod \"maas-keycloak-0\" (UID: \"29554551-3ac6-492b-a692-ad6cead0826d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:39.950520 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.950501 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29554551-3ac6-492b-a692-ad6cead0826d-test-realms\") pod \"maas-keycloak-0\" (UID: \"29554551-3ac6-492b-a692-ad6cead0826d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:39.960437 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:39.960405 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b9nr\" (UniqueName: \"kubernetes.io/projected/29554551-3ac6-492b-a692-ad6cead0826d-kube-api-access-2b9nr\") pod \"maas-keycloak-0\" (UID: \"29554551-3ac6-492b-a692-ad6cead0826d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:40.099533 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:40.099487 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:40.240424 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:40.240359 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 15:21:40.243305 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:21:40.243256 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29554551_3ac6_492b_a692_ad6cead0826d.slice/crio-58b516c25fdb7c95750a651c36c3ef4145aaf44def990d02acb071ac57471a65 WatchSource:0}: Error finding container 58b516c25fdb7c95750a651c36c3ef4145aaf44def990d02acb071ac57471a65: Status 404 returned error can't find the container with id 58b516c25fdb7c95750a651c36c3ef4145aaf44def990d02acb071ac57471a65 Jun 15 15:21:40.684001 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:40.683972 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-w76km" Jun 15 15:21:40.742700 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:40.742651 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"29554551-3ac6-492b-a692-ad6cead0826d","Type":"ContainerStarted","Data":"7c5ca9bea9e76469650b7789f465f083a2c8d2f6ea749d106b13a7bad299c37c"} Jun 15 15:21:40.742886 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:40.742726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"29554551-3ac6-492b-a692-ad6cead0826d","Type":"ContainerStarted","Data":"58b516c25fdb7c95750a651c36c3ef4145aaf44def990d02acb071ac57471a65"} Jun 15 15:21:40.759978 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:40.759924 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.476688596 podStartE2EDuration="1.75990362s" totalImagesPullingTime="283.215024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:21:40.759314966 +0000 UTC m=+899.418268667" watchObservedRunningTime="2026-06-15 15:21:40.75990362 +0000 UTC m=+899.418857321" Jun 15 15:21:41.099946 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:41.099903 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:41.101973 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:41.101924 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:41.855732 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:41.855703 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:21:41.857210 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:41.857189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:21:41.862185 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:41.862161 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:21:41.863159 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:41.863100 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:21:42.100763 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:42.100702 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:43.100001 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:43.099953 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:44.100847 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:44.100777 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:45.100371 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:45.100309 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:46.100069 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:46.100017 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:47.100274 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:47.100213 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:48.101383 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:48.101329 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:49.100241 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:49.100190 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:50.100552 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:50.100489 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:50.101071 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:50.100929 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:51.100991 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:51.100939 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:52.100630 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:52.100579 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:53.100843 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:53.100785 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:54.100635 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:54.100579 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 15 15:21:55.236798 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:55.236746 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 15:21:55.258488 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:21:55.258443 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="29554551-3ac6-492b-a692-ad6cead0826d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 15:22:05.243535 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:05.243492 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 15:22:30.649857 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.649813 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt"] Jun 15 15:22:30.653562 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.653537 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.656159 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.656131 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 15:22:30.656954 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.656928 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 15 15:22:30.657072 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.656934 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7zmjm\"" Jun 15 15:22:30.657072 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.657033 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 15:22:30.664570 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.664538 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt"] Jun 15 15:22:30.777365 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.777299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.777365 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.777369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8811d693-1b51-4b83-8282-b01cdce12ad9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.777656 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.777435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.777656 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.777483 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.777656 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.777509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.777656 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.777599 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8pxk\" (UniqueName: \"kubernetes.io/projected/8811d693-1b51-4b83-8282-b01cdce12ad9-kube-api-access-n8pxk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.878830 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.878781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8811d693-1b51-4b83-8282-b01cdce12ad9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.879046 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.878857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.879046 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.878903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.879046 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.878933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.879046 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.878965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8pxk\" (UniqueName: \"kubernetes.io/projected/8811d693-1b51-4b83-8282-b01cdce12ad9-kube-api-access-n8pxk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.879046 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.878996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.879437 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.879408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.879509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.879440 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.879509 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.879463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.881431 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.881404 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8811d693-1b51-4b83-8282-b01cdce12ad9-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.881723 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.881705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8811d693-1b51-4b83-8282-b01cdce12ad9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.887553 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.887525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8pxk\" (UniqueName: \"kubernetes.io/projected/8811d693-1b51-4b83-8282-b01cdce12ad9-kube-api-access-n8pxk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt\" (UID: \"8811d693-1b51-4b83-8282-b01cdce12ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:30.965519 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:30.965430 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:22:31.147037 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:31.146998 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt"] Jun 15 15:22:31.150315 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:22:31.150281 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8811d693_1b51_4b83_8282_b01cdce12ad9.slice/crio-8f8b668c0783782afdf63f0eb3618b593295eaaa5738e14e2f4da28b9164e369 WatchSource:0}: Error finding container 8f8b668c0783782afdf63f0eb3618b593295eaaa5738e14e2f4da28b9164e369: Status 404 returned error can't find the container with id 8f8b668c0783782afdf63f0eb3618b593295eaaa5738e14e2f4da28b9164e369 Jun 15 15:22:32.052570 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:32.052529 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" event={"ID":"8811d693-1b51-4b83-8282-b01cdce12ad9","Type":"ContainerStarted","Data":"8f8b668c0783782afdf63f0eb3618b593295eaaa5738e14e2f4da28b9164e369"} Jun 15 15:22:35.080219 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:35.080168 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" event={"ID":"8811d693-1b51-4b83-8282-b01cdce12ad9","Type":"ContainerStarted","Data":"7b8c41f17574dad8bf988308b617d030e9bb3a2bc7be28c871087d7dae00d2d6"} Jun 15 15:22:55.165274 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.165186 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf"] Jun 15 15:22:55.168406 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.168387 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.170670 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.170644 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 15 15:22:55.178193 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.178165 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf"] Jun 15 15:22:55.314043 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.314006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2f8e456-966e-4175-a8b8-c90f3297d3c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.314245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.314093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.314245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.314147 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.314245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.314166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.314245 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.314203 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.314558 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.314288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csnth\" (UniqueName: \"kubernetes.io/projected/e2f8e456-966e-4175-a8b8-c90f3297d3c8-kube-api-access-csnth\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.415578 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.415471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.415578 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.415528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnth\" (UniqueName: \"kubernetes.io/projected/e2f8e456-966e-4175-a8b8-c90f3297d3c8-kube-api-access-csnth\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.415825 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.415586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2f8e456-966e-4175-a8b8-c90f3297d3c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.415825 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.415669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.415825 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.415694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.415825 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.415718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.416037 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.415992 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.416037 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.416026 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.416177 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.416159 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.418175 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.418152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2f8e456-966e-4175-a8b8-c90f3297d3c8-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.418357 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.418339 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2f8e456-966e-4175-a8b8-c90f3297d3c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.424615 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.424588 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csnth\" (UniqueName: \"kubernetes.io/projected/e2f8e456-966e-4175-a8b8-c90f3297d3c8-kube-api-access-csnth\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-sdjsf\" (UID: \"e2f8e456-966e-4175-a8b8-c90f3297d3c8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.481034 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.480992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:22:55.623041 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:55.623010 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf"] Jun 15 15:22:55.625422 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:22:55.625390 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f8e456_966e_4175_a8b8_c90f3297d3c8.slice/crio-7932e75d3d769024236ed96569ee4b284f4ea1a9eea36a5253bb015beef43bc9 WatchSource:0}: Error finding container 7932e75d3d769024236ed96569ee4b284f4ea1a9eea36a5253bb015beef43bc9: Status 404 returned error can't find the container with id 7932e75d3d769024236ed96569ee4b284f4ea1a9eea36a5253bb015beef43bc9 Jun 15 15:22:56.190042 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:56.190006 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" event={"ID":"e2f8e456-966e-4175-a8b8-c90f3297d3c8","Type":"ContainerStarted","Data":"bd492efd8556eeeb5f0cdbb350d94008e5e86dc09dec7b63bb1f8886e3469901"} Jun 15 15:22:56.190487 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:56.190073 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" event={"ID":"e2f8e456-966e-4175-a8b8-c90f3297d3c8","Type":"ContainerStarted","Data":"7932e75d3d769024236ed96569ee4b284f4ea1a9eea36a5253bb015beef43bc9"} Jun 15 15:22:57.196573 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:57.196535 2567 generic.go:356] "Generic (PLEG): container finished" podID="e2f8e456-966e-4175-a8b8-c90f3297d3c8" containerID="bd492efd8556eeeb5f0cdbb350d94008e5e86dc09dec7b63bb1f8886e3469901" exitCode=0 Jun 15 15:22:57.196972 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:57.196574 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" event={"ID":"e2f8e456-966e-4175-a8b8-c90f3297d3c8","Type":"ContainerDied","Data":"bd492efd8556eeeb5f0cdbb350d94008e5e86dc09dec7b63bb1f8886e3469901"} Jun 15 15:22:59.209064 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:59.209026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" event={"ID":"e2f8e456-966e-4175-a8b8-c90f3297d3c8","Type":"ContainerStarted","Data":"d27b1a9f37008ccbc5c68c2b6201a1eca28519d151db744662435cc819b1429e"} Jun 15 15:22:59.229602 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:22:59.229543 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" podStartSLOduration=1.659179637 podStartE2EDuration="4.229520837s" totalImagesPullingTime="1.194553279s" totalInitContainerRuntime="1.375787921s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:22:59.226541628 +0000 UTC m=+977.885495326" watchObservedRunningTime="2026-06-15 15:22:59.229520837 +0000 UTC m=+977.888474537" Jun 15 15:23:01.056011 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.055968 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484"] Jun 15 15:23:01.058966 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.058936 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.061694 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.061667 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 15 15:23:01.070186 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.070157 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484"] Jun 15 15:23:01.172086 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.172041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.172306 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.172162 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txpvl\" (UniqueName: \"kubernetes.io/projected/68851446-60c7-46c8-852d-a437e0b509b1-kube-api-access-txpvl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.172306 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.172205 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.172306 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.172252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68851446-60c7-46c8-852d-a437e0b509b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.172451 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.172356 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.172451 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.172381 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.272995 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.272952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.273267 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.273019 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txpvl\" (UniqueName: \"kubernetes.io/projected/68851446-60c7-46c8-852d-a437e0b509b1-kube-api-access-txpvl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.273267 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.273051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.273267 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.273077 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68851446-60c7-46c8-852d-a437e0b509b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.273267 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.273250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.273452 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.273292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.273599 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.273576 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.273641 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.273623 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.273689 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.273661 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.275593 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.275570 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68851446-60c7-46c8-852d-a437e0b509b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.275873 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.275854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68851446-60c7-46c8-852d-a437e0b509b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.283143 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.283083 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txpvl\" (UniqueName: \"kubernetes.io/projected/68851446-60c7-46c8-852d-a437e0b509b1-kube-api-access-txpvl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484\" (UID: \"68851446-60c7-46c8-852d-a437e0b509b1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.371409 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.371314 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:01.515745 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:01.515718 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484"] Jun 15 15:23:01.518003 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:23:01.517972 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68851446_60c7_46c8_852d_a437e0b509b1.slice/crio-f7f4e6add8791a723dba060689d2bea2f1f02b1fd8067efb53ab3093f165e686 WatchSource:0}: Error finding container f7f4e6add8791a723dba060689d2bea2f1f02b1fd8067efb53ab3093f165e686: Status 404 returned error can't find the container with id f7f4e6add8791a723dba060689d2bea2f1f02b1fd8067efb53ab3093f165e686 Jun 15 15:23:02.236651 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:02.236613 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" event={"ID":"68851446-60c7-46c8-852d-a437e0b509b1","Type":"ContainerStarted","Data":"f759f3ab062c021c4fa949f1ffd7f8310a0b3fd4768c73da94e6edbac1fb0f2d"} Jun 15 15:23:02.237146 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:02.236699 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" event={"ID":"68851446-60c7-46c8-852d-a437e0b509b1","Type":"ContainerStarted","Data":"f7f4e6add8791a723dba060689d2bea2f1f02b1fd8067efb53ab3093f165e686"} Jun 15 15:23:05.481931 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:05.481883 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:23:05.482386 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:05.481967 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:23:05.494712 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:05.494685 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:23:06.268931 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:06.268893 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-sdjsf" Jun 15 15:23:35.412469 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:35.412431 2567 generic.go:356] "Generic (PLEG): container finished" podID="8811d693-1b51-4b83-8282-b01cdce12ad9" containerID="7b8c41f17574dad8bf988308b617d030e9bb3a2bc7be28c871087d7dae00d2d6" exitCode=0 Jun 15 15:23:35.412931 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:35.412491 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" event={"ID":"8811d693-1b51-4b83-8282-b01cdce12ad9","Type":"ContainerDied","Data":"7b8c41f17574dad8bf988308b617d030e9bb3a2bc7be28c871087d7dae00d2d6"} Jun 15 15:23:36.420440 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:36.420403 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" event={"ID":"8811d693-1b51-4b83-8282-b01cdce12ad9","Type":"ContainerStarted","Data":"227fbbb26cc4e333c4a13e8ace37f717e606684f9ebf39b7e08132fa65fecfed"} Jun 15 15:23:36.438859 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:36.438803 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" podStartSLOduration=2.581384929 podStartE2EDuration="1m6.438785451s" totalImagesPullingTime="4.057233152s" totalInitContainerRuntime="59.80016737s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:22:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:23:36.437604012 +0000 UTC m=+1015.096557723" watchObservedRunningTime="2026-06-15 15:23:36.438785451 +0000 UTC m=+1015.097739150" Jun 15 15:23:40.965697 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:40.965662 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:23:40.966263 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:40.965842 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:23:40.979003 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:40.978971 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:23:41.447784 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:41.447750 2567 generic.go:356] "Generic (PLEG): container finished" podID="68851446-60c7-46c8-852d-a437e0b509b1" containerID="f759f3ab062c021c4fa949f1ffd7f8310a0b3fd4768c73da94e6edbac1fb0f2d" exitCode=0 Jun 15 15:23:41.447970 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:41.447823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" event={"ID":"68851446-60c7-46c8-852d-a437e0b509b1","Type":"ContainerDied","Data":"f759f3ab062c021c4fa949f1ffd7f8310a0b3fd4768c73da94e6edbac1fb0f2d"} Jun 15 15:23:41.459965 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:41.459931 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt" Jun 15 15:23:42.457243 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:42.457209 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" event={"ID":"68851446-60c7-46c8-852d-a437e0b509b1","Type":"ContainerStarted","Data":"ba7afd6f4f3f21e8fa4eee48a2171337fc5fa217e880964b02ace415770f299d"} Jun 15 15:23:42.478580 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:42.478516 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" podStartSLOduration=2.041323627 podStartE2EDuration="41.478497514s" totalImagesPullingTime="266.581619ms" totalInitContainerRuntime="39.170592268s" isStatefulPod=false podCreationTimestamp="2026-06-15 15:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:23:42.475896961 +0000 UTC m=+1021.134850708" watchObservedRunningTime="2026-06-15 15:23:42.478497514 +0000 UTC m=+1021.137451214" Jun 15 15:23:51.371791 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:51.371733 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:51.372232 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:51.371827 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:51.384986 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:51.384957 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:23:51.518763 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:23:51.518726 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484" Jun 15 15:26:41.891778 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:26:41.891745 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:26:41.893980 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:26:41.893343 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:26:41.897247 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:26:41.897224 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:26:41.898778 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:26:41.898758 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvx64_a37ee4ff-d563-4d2a-96a2-f8d9af0c81b9/ovn-acl-logging/0.log" Jun 15 15:27:26.622427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:26.622350 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7d44784fcb-7sv49_51904ebc-599b-4a5a-a3eb-a6487cee66aa/nginx/0.log" Jun 15 15:27:27.058323 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:27.058286 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7cc8cbb54b-wwshz_34c746b7-728f-48a2-8732-78705c0a1479/maas-api/0.log" Jun 15 15:27:27.174944 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:27.174911 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-764f4d48f5-j8b8b_8876db8e-e42f-4cd1-b4d0-b41689cc0591/manager/0.log" Jun 15 15:27:27.615996 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:27.615969 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x_82d6a98c-e211-4462-a0f0-2aaf311719fb/copy-manifests/0.log" Jun 15 15:27:27.622308 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:27.622277 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x_82d6a98c-e211-4462-a0f0-2aaf311719fb/manager/0.log" Jun 15 15:27:29.192344 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:29.192301 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ds4df_a0a0a01a-fbac-4bd3-94c9-43bce806f117/manager/0.log" Jun 15 15:27:29.298503 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:29.298464 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qvcrd_1b28a8b1-6cbf-418b-96e2-8030ac716f98/manager/0.log" Jun 15 15:27:29.511285 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:29.511243 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ss6cs_9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c/registry-server/0.log" Jun 15 15:27:29.623690 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:29.623647 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-c655b_00d07ac4-3514-46d5-873d-8e9c2820efcd/manager/0.log" Jun 15 15:27:30.176910 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:30.176870 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lsc65_2895183e-516a-4a1e-949e-c14dc29af8d1/istio-proxy/0.log" Jun 15 15:27:30.615884 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:30.615854 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/1.log" Jun 15 15:27:30.723387 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:30.723356 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-w76km_908d2284-b0b7-4580-878b-7b2a78175f72/payload-pre-processing/0.log" Jun 15 15:27:30.828002 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:30.827972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7qkb6_0487fea5-e273-40a5-a575-88115f7eeba6/payload-processing/0.log" Jun 15 15:27:31.275993 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:31.275954 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt_8811d693-1b51-4b83-8282-b01cdce12ad9/storage-initializer/0.log" Jun 15 15:27:31.283682 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:31.283658 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-9hcpt_8811d693-1b51-4b83-8282-b01cdce12ad9/main/0.log" Jun 15 15:27:31.389011 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:31.388970 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-sdjsf_e2f8e456-966e-4175-a8b8-c90f3297d3c8/storage-initializer/0.log" Jun 15 15:27:31.396020 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:31.395992 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-sdjsf_e2f8e456-966e-4175-a8b8-c90f3297d3c8/main/0.log" Jun 15 15:27:31.499841 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:31.499813 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484_68851446-60c7-46c8-852d-a437e0b509b1/main/0.log" Jun 15 15:27:31.506736 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:31.506712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fg484_68851446-60c7-46c8-852d-a437e0b509b1/storage-initializer/0.log" Jun 15 15:27:38.608441 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:38.608406 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pjnbp_a71ca1be-b3d3-49b1-9d11-06e9f9c11f8d/global-pull-secret-syncer/0.log" Jun 15 15:27:38.744109 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:38.744074 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vtb9c_79f6d2e9-7c20-4a2a-b0e9-9cc8b898d452/konnectivity-agent/0.log" Jun 15 15:27:38.808771 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:38.808739 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-197.ec2.internal_a3142153b10a482aab63586672c9641f/haproxy/0.log" Jun 15 15:27:43.429483 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:43.429446 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ds4df_a0a0a01a-fbac-4bd3-94c9-43bce806f117/manager/0.log" Jun 15 15:27:43.456170 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:43.456106 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qvcrd_1b28a8b1-6cbf-418b-96e2-8030ac716f98/manager/0.log" Jun 15 15:27:43.520435 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:43.520398 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ss6cs_9bf84e6d-2db3-4b2e-9ef3-b948fe5a5b0c/registry-server/0.log" Jun 15 15:27:43.564473 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:43.564442 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-c655b_00d07ac4-3514-46d5-873d-8e9c2820efcd/manager/0.log" Jun 15 15:27:45.493771 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.493742 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee35cce2-7c71-4563-a0ae-15fe79c63278/alertmanager/0.log" Jun 15 15:27:45.518562 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.518516 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee35cce2-7c71-4563-a0ae-15fe79c63278/config-reloader/0.log" Jun 15 15:27:45.542813 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.542784 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee35cce2-7c71-4563-a0ae-15fe79c63278/kube-rbac-proxy-web/0.log" Jun 15 15:27:45.565563 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.565530 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee35cce2-7c71-4563-a0ae-15fe79c63278/kube-rbac-proxy/0.log" Jun 15 15:27:45.591548 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.591521 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee35cce2-7c71-4563-a0ae-15fe79c63278/kube-rbac-proxy-metric/0.log" Jun 15 15:27:45.618327 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.618295 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee35cce2-7c71-4563-a0ae-15fe79c63278/prom-label-proxy/0.log" Jun 15 15:27:45.641823 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.641775 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee35cce2-7c71-4563-a0ae-15fe79c63278/init-config-reloader/0.log" Jun 15 15:27:45.795618 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.795590 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-669657c594-lc2mj_6da38f2a-9db0-4ec2-9e37-f188202667d9/metrics-server/0.log" Jun 15 15:27:45.824499 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.824475 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-qxzk5_a09ceceb-a955-461c-a028-8e320fc001b8/monitoring-plugin/0.log" Jun 15 15:27:45.944628 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.944596 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6c4w_98b52f65-e0f5-496e-923d-14eab776672c/node-exporter/0.log" Jun 15 15:27:45.966937 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.966908 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6c4w_98b52f65-e0f5-496e-923d-14eab776672c/kube-rbac-proxy/0.log" Jun 15 15:27:45.989528 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:45.989495 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6c4w_98b52f65-e0f5-496e-923d-14eab776672c/init-textfile/0.log" Jun 15 15:27:46.240560 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:46.240535 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d04265cd-735d-4271-8cb9-f7db7b79ed33/prometheus/0.log" Jun 15 15:27:46.275749 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:46.275719 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d04265cd-735d-4271-8cb9-f7db7b79ed33/config-reloader/0.log" Jun 15 15:27:46.305879 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:46.305856 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d04265cd-735d-4271-8cb9-f7db7b79ed33/thanos-sidecar/0.log" Jun 15 15:27:46.331840 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:46.331817 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d04265cd-735d-4271-8cb9-f7db7b79ed33/kube-rbac-proxy-web/0.log" Jun 15 15:27:46.354655 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:46.354628 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d04265cd-735d-4271-8cb9-f7db7b79ed33/kube-rbac-proxy/0.log" Jun 15 15:27:46.377203 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:46.377172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d04265cd-735d-4271-8cb9-f7db7b79ed33/kube-rbac-proxy-thanos/0.log" Jun 15 15:27:46.402757 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:46.402732 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d04265cd-735d-4271-8cb9-f7db7b79ed33/init-config-reloader/0.log" Jun 15 15:27:48.787451 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:48.787425 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/1.log" Jun 15 15:27:48.792675 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:48.792642 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dr992_519b47c6-9b46-4b1e-8d0e-5462ff5ece38/console-operator/2.log" Jun 15 15:27:49.302072 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.302043 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bd7775f85-cjnbk_2efdd55c-3867-4c82-b217-e55704234787/console/0.log" Jun 15 15:27:49.336079 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.336042 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-26xjd_e2302079-56c0-4b22-9d65-0360dd2884be/download-server/0.log" Jun 15 15:27:49.598002 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.597920 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z"] Jun 15 15:27:49.602415 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.602392 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.605159 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.605096 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cpc85\"/\"openshift-service-ca.crt\"" Jun 15 15:27:49.606089 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.606072 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cpc85\"/\"default-dockercfg-vdgfd\"" Jun 15 15:27:49.606089 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.606083 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cpc85\"/\"kube-root-ca.crt\"" Jun 15 15:27:49.610843 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.610810 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z"] Jun 15 15:27:49.731562 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.731527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-sys\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.731562 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.731574 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-podres\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.731800 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.731699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-proc\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.731800 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.731763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-lib-modules\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.731800 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.731788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rjgd\" (UniqueName: \"kubernetes.io/projected/9ec09121-ac48-442d-92d0-f948c9f59928-kube-api-access-8rjgd\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.832649 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-lib-modules\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.833155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rjgd\" (UniqueName: \"kubernetes.io/projected/9ec09121-ac48-442d-92d0-f948c9f59928-kube-api-access-8rjgd\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.833155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-sys\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.833155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-podres\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.833155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832805 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-lib-modules\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.833155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-podres\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.833155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-sys\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.833155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832927 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-proc\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.833155 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.832968 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ec09121-ac48-442d-92d0-f948c9f59928-proc\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.841938 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.841908 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rjgd\" (UniqueName: \"kubernetes.io/projected/9ec09121-ac48-442d-92d0-f948c9f59928-kube-api-access-8rjgd\") pod \"perf-node-gather-daemonset-bfn5z\" (UID: \"9ec09121-ac48-442d-92d0-f948c9f59928\") " pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:49.913934 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:49.913832 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:50.056139 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:50.056084 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z"] Jun 15 15:27:50.058476 ip-10-0-139-197 kubenswrapper[2567]: W0615 15:27:50.058434 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9ec09121_ac48_442d_92d0_f948c9f59928.slice/crio-e394c1c54698ad0b61a14dbe61d46578cb540c9a37b2192c4e2f59a886fda729 WatchSource:0}: Error finding container e394c1c54698ad0b61a14dbe61d46578cb540c9a37b2192c4e2f59a886fda729: Status 404 returned error can't find the container with id e394c1c54698ad0b61a14dbe61d46578cb540c9a37b2192c4e2f59a886fda729 Jun 15 15:27:50.749238 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:50.749203 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" event={"ID":"9ec09121-ac48-442d-92d0-f948c9f59928","Type":"ContainerStarted","Data":"16186c96ecfc8b7b6868e7c4ee08870fe359a8559b9c7473a0cd66746b3cd2e1"} Jun 15 15:27:50.749461 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:50.749297 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" event={"ID":"9ec09121-ac48-442d-92d0-f948c9f59928","Type":"ContainerStarted","Data":"e394c1c54698ad0b61a14dbe61d46578cb540c9a37b2192c4e2f59a886fda729"} Jun 15 15:27:50.749461 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:50.749376 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:50.765174 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:50.765084 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" podStartSLOduration=1.765068325 podStartE2EDuration="1.765068325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 15:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 15:27:50.763704976 +0000 UTC m=+1269.422658675" watchObservedRunningTime="2026-06-15 15:27:50.765068325 +0000 UTC m=+1269.424022025" Jun 15 15:27:51.281961 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:51.281928 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qc99f_241e1504-b585-4f67-9b5d-f62ec6ad02b7/dns/0.log" Jun 15 15:27:51.310126 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:51.310086 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qc99f_241e1504-b585-4f67-9b5d-f62ec6ad02b7/kube-rbac-proxy/0.log" Jun 15 15:27:51.384420 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:51.384387 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sdklf_9324414c-0a51-46e7-8345-0b7342d71197/dns-node-resolver/0.log" Jun 15 15:27:51.976205 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:51.976172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-szp6n_f0833d8c-5be6-4af7-b8de-288f14458838/node-ca/0.log" Jun 15 15:27:52.924574 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:52.924542 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lsc65_2895183e-516a-4a1e-949e-c14dc29af8d1/istio-proxy/0.log" Jun 15 15:27:53.057825 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:53.057789 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/1.log" Jun 15 15:27:53.058206 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:53.058185 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/0.log" Jun 15 15:27:53.080800 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:53.080771 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-w76km_908d2284-b0b7-4580-878b-7b2a78175f72/payload-pre-processing/0.log" Jun 15 15:27:53.105878 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:53.105850 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7qkb6_0487fea5-e273-40a5-a575-88115f7eeba6/payload-processing/0.log" Jun 15 15:27:53.742296 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:53.742264 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-67kdg_8e238c45-ed86-46d2-b94a-9746d23687b5/serve-healthcheck-canary/0.log" Jun 15 15:27:54.459192 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:54.459168 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x86jq_32e23802-1d42-40b8-8e6d-512ed3ed0301/kube-rbac-proxy/0.log" Jun 15 15:27:54.483288 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:54.483264 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x86jq_32e23802-1d42-40b8-8e6d-512ed3ed0301/exporter/0.log" Jun 15 15:27:54.505214 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:54.505186 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x86jq_32e23802-1d42-40b8-8e6d-512ed3ed0301/extractor/0.log" Jun 15 15:27:56.692287 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:56.692248 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7d44784fcb-7sv49_51904ebc-599b-4a5a-a3eb-a6487cee66aa/nginx/0.log" Jun 15 15:27:56.767728 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:56.767699 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cpc85/perf-node-gather-daemonset-bfn5z" Jun 15 15:27:56.816606 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:56.816576 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7cc8cbb54b-wwshz_34c746b7-728f-48a2-8732-78705c0a1479/maas-api/0.log" Jun 15 15:27:56.845898 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:56.845868 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-764f4d48f5-j8b8b_8876db8e-e42f-4cd1-b4d0-b41689cc0591/manager/0.log" Jun 15 15:27:57.031662 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:57.031630 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x_82d6a98c-e211-4462-a0f0-2aaf311719fb/manager/0.log" Jun 15 15:27:57.052173 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:57.052112 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc6bcf95f-8vv9x_82d6a98c-e211-4462-a0f0-2aaf311719fb/copy-manifests/0.log" Jun 15 15:27:58.685633 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:27:58.685604 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d9bccfb8-cbmpk_e8023fa8-a40d-4662-9774-0c4fed652806/manager/0.log" Jun 15 15:28:03.486952 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:03.486924 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lsc65_2895183e-516a-4a1e-949e-c14dc29af8d1/istio-proxy/0.log" Jun 15 15:28:03.573634 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:03.573606 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/1.log" Jun 15 15:28:03.573883 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:03.573865 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/0.log" Jun 15 15:28:03.584731 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:03.584691 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-w76km_908d2284-b0b7-4580-878b-7b2a78175f72/payload-pre-processing/0.log" Jun 15 15:28:03.602427 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:03.602404 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7qkb6_0487fea5-e273-40a5-a575-88115f7eeba6/payload-processing/0.log" Jun 15 15:28:04.818824 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:04.818792 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lsc65_2895183e-516a-4a1e-949e-c14dc29af8d1/istio-proxy/0.log" Jun 15 15:28:04.906425 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:04.906400 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/1.log" Jun 15 15:28:04.906693 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:04.906677 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/0.log" Jun 15 15:28:04.920143 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:04.920086 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-w76km_908d2284-b0b7-4580-878b-7b2a78175f72/payload-pre-processing/0.log" Jun 15 15:28:04.937560 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:04.937522 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7qkb6_0487fea5-e273-40a5-a575-88115f7eeba6/payload-processing/0.log" Jun 15 15:28:06.066453 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.066421 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z6mqx_6fba54d3-7374-4b55-8f28-20c86dd68da3/kube-multus-additional-cni-plugins/0.log" Jun 15 15:28:06.090037 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.090003 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z6mqx_6fba54d3-7374-4b55-8f28-20c86dd68da3/egress-router-binary-copy/0.log" Jun 15 15:28:06.113297 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.113260 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z6mqx_6fba54d3-7374-4b55-8f28-20c86dd68da3/cni-plugins/0.log" Jun 15 15:28:06.135439 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.135412 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z6mqx_6fba54d3-7374-4b55-8f28-20c86dd68da3/bond-cni-plugin/0.log" Jun 15 15:28:06.163156 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.163061 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z6mqx_6fba54d3-7374-4b55-8f28-20c86dd68da3/routeoverride-cni/0.log" Jun 15 15:28:06.184471 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.184444 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z6mqx_6fba54d3-7374-4b55-8f28-20c86dd68da3/whereabouts-cni-bincopy/0.log" Jun 15 15:28:06.206136 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.206102 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z6mqx_6fba54d3-7374-4b55-8f28-20c86dd68da3/whereabouts-cni/0.log" Jun 15 15:28:06.297619 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.297590 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mnm77_ae70438f-1f5e-4be5-b768-92b0386707fe/kube-multus/0.log" Jun 15 15:28:06.322677 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.322645 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-98xgq_6d11743e-081e-4d7d-8cf1-674fec0019a8/network-metrics-daemon/0.log" Jun 15 15:28:06.344208 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.344180 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-98xgq_6d11743e-081e-4d7d-8cf1-674fec0019a8/kube-rbac-proxy/0.log" Jun 15 15:28:06.531905 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.531879 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lsc65_2895183e-516a-4a1e-949e-c14dc29af8d1/istio-proxy/0.log" Jun 15 15:28:06.610436 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.610404 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/1.log" Jun 15 15:28:06.610675 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.610656 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dnh6v_07297bd2-dbda-4ba7-b728-92254d114207/istio-proxy/0.log" Jun 15 15:28:06.619250 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.619209 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-w76km_908d2284-b0b7-4580-878b-7b2a78175f72/payload-pre-processing/0.log" Jun 15 15:28:06.632510 ip-10-0-139-197 kubenswrapper[2567]: I0615 15:28:06.632486 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7qkb6_0487fea5-e273-40a5-a575-88115f7eeba6/payload-processing/0.log"