Jul 01 17:45:04.810450 ip-10-0-136-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 17:45:04.810461 ip-10-0-136-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 17:45:04.810468 ip-10-0-136-118 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 17:45:04.810686 ip-10-0-136-118 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 17:45:14.899021 ip-10-0-136-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 17:45:14.899036 ip-10-0-136-118 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f20165cd38614437b89c41b6b66602bf -- Jul 01 17:47:21.825579 ip-10-0-136-118 systemd[1]: Starting Kubernetes Kubelet... Jul 01 17:47:22.271996 ip-10-0-136-118 systemd[1]: Started Kubernetes Kubelet. Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.199102 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203187 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203198 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203202 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203206 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203209 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203212 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203214 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:47:22.293093 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203217 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203219 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203222 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203224 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203227 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203230 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203232 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203234 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203237 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203240 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203243 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203246 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203249 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203252 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203260 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203263 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203266 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203268 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203271 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203274 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:47:22.294078 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203277 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203279 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203282 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203285 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203287 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203290 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203293 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203296 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203298 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203301 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203303 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203306 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203309 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203328 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203332 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203335 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203340 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203342 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203345 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203348 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:47:22.294901 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203350 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203353 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203355 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203358 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203360 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203363 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203366 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203369 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203372 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203374 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203377 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203380 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203382 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203385 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203387 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203390 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203392 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203395 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203397 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203400 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:47:22.295705 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203403 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203405 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203407 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203411 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203413 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203416 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203419 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203422 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203425 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203428 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203430 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203433 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203435 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203438 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203441 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203443 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203447 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203451 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203455 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203458 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:47:22.297343 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203461 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203464 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203467 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203470 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203473 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203477 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203481 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203484 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203487 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203490 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203493 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.203496 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204929 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204937 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204940 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204944 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204947 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204950 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204952 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204955 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:47:22.298393 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204958 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204961 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204964 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204967 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204969 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204972 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204974 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204978 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204980 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204983 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204985 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204989 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204993 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204996 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.204999 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205002 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205005 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205007 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205010 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:47:22.433236 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205013 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205016 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205018 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205021 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205024 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205026 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205029 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205031 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205034 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205036 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205039 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205041 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205044 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205046 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205049 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205052 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205055 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205057 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205060 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205062 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:47:22.457355 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205065 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205067 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205069 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205072 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205075 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205077 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205081 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205084 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205087 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205089 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205092 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205094 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205097 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205099 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205103 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205106 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205109 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205112 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205116 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:47:22.458222 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205119 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205122 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205124 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205127 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205130 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205134 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205137 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205140 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205142 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205146 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205149 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205151 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205154 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205157 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205159 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205162 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205164 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205167 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205169 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:47:22.458918 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205172 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205175 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205177 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205180 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205182 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205184 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205187 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205189 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205192 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205194 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205197 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205199 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205203 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205206 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205599 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205605 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205608 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205612 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205616 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205618 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:47:22.459687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205621 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205623 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205626 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205629 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205632 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205634 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205637 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205639 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205642 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205644 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205647 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205650 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205653 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205655 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205658 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205661 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205663 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205666 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205669 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205673 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:47:22.460370 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205676 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205679 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205681 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205684 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205689 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205692 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205694 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205697 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205699 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205702 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205705 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205707 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205710 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205712 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205715 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205719 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205723 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205726 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205728 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:47:22.461182 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205731 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205735 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205738 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205741 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205744 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205746 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205749 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205751 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205754 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205756 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205759 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205762 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205764 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205766 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205769 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205771 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205774 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205778 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205781 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205783 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:47:22.461870 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205787 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205791 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205795 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205798 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205801 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205804 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205807 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205809 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205812 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205815 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205818 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205821 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205823 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205826 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205829 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205832 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205835 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205838 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205840 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205842 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:47:22.462548 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205845 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205848 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205850 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205852 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205855 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205857 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205860 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205862 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205864 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205869 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205871 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205874 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205876 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.205879 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205939 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205945 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205950 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205955 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205959 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205962 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205966 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 17:47:22.463687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205969 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205978 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205981 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205984 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205987 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205990 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205994 2564 flags.go:64] FLAG: --cgroup-root="" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.205998 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206000 2564 flags.go:64] FLAG: --client-ca-file="" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206003 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206006 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206017 2564 flags.go:64] FLAG: --cluster-domain="" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206020 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206023 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206027 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206030 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206033 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206036 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206039 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206042 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206046 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206050 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206053 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206056 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 17:47:22.464355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206059 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206063 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206066 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206068 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206071 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206074 2564 flags.go:64] FLAG: --enable-server="true" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206077 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206081 2564 flags.go:64] FLAG: --event-burst="100" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206084 2564 flags.go:64] FLAG: --event-qps="50" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206087 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206090 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206093 2564 flags.go:64] FLAG: --eviction-hard="" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206097 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206100 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206104 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206107 2564 flags.go:64] FLAG: --eviction-soft="" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206110 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206112 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206115 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206118 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206121 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206124 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206127 2564 flags.go:64] FLAG: --feature-gates="" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206130 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206133 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 17:47:22.465260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206136 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206139 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206142 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206146 2564 flags.go:64] FLAG: --help="false" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206149 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206152 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206155 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206157 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206161 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206164 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206167 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206169 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206172 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206175 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206178 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206181 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206184 2564 flags.go:64] FLAG: --kube-reserved="" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206186 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206190 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206193 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206195 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206199 2564 flags.go:64] FLAG: --lock-file="" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206202 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206205 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 17:47:22.466152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206207 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206215 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206218 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206221 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206223 2564 flags.go:64] FLAG: --logging-format="text" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206226 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206229 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206232 2564 flags.go:64] FLAG: --manifest-url="" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206235 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206239 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206241 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206246 2564 flags.go:64] FLAG: --max-pods="110" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206250 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206252 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206255 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206258 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206261 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206264 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206267 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206273 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206276 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206279 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206282 2564 flags.go:64] FLAG: --pod-cidr="" Jul 01 17:47:22.466928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206285 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206290 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206293 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206296 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206300 2564 flags.go:64] FLAG: --port="10250" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206303 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206307 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-076c827911ff11afd" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206323 2564 flags.go:64] FLAG: --qos-reserved="" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206326 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206329 2564 flags.go:64] FLAG: --register-node="true" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206332 2564 flags.go:64] FLAG: --register-with-taints="" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206335 2564 flags.go:64] FLAG: --registry-burst="10" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206338 2564 flags.go:64] FLAG: --registry-qps="5" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206341 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206344 2564 flags.go:64] FLAG: --reserved-memory="" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206347 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206350 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206353 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206356 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206358 2564 flags.go:64] FLAG: --runonce="false" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206361 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206366 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206369 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206372 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206374 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206377 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 17:47:22.467621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206380 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206383 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206386 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206388 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206391 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206394 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206397 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206399 2564 flags.go:64] FLAG: --system-cgroups="" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206402 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206407 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206410 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206413 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206422 2564 flags.go:64] FLAG: --tls-min-version="" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206425 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206428 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206431 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206434 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206437 2564 flags.go:64] FLAG: --v="2" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206440 2564 flags.go:64] FLAG: --version="false" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206444 2564 flags.go:64] FLAG: --vmodule="" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206448 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.206451 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206566 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206570 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:47:22.468411 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206573 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206577 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206579 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206583 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206586 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206588 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206591 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206593 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206596 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206599 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206601 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206604 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206606 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206608 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206611 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206614 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206616 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206619 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206622 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206624 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:47:22.469118 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206629 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206631 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206634 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206637 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206639 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206642 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206644 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206647 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206649 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206652 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206654 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206657 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206660 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206663 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206665 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206669 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206671 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206674 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206676 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:47:22.469771 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206680 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206684 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206686 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206690 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206692 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206695 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206698 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206701 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206704 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206707 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206709 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206712 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206714 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206718 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206722 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206726 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206729 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206740 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206743 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:47:22.470418 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206746 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206749 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206751 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206754 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206757 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206760 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206763 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206766 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206768 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206773 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206776 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206778 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206781 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206784 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206786 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206789 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206791 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206794 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206796 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206799 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:47:22.471037 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206801 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206804 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206806 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206809 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206811 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206814 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206818 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206821 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206824 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206827 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206831 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206834 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206837 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206839 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206842 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206844 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206846 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206849 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:47:22.471949 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.206852 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.207438 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.214850 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.214864 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.214877 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.214882 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214934 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214939 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214942 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214945 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214948 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214951 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214954 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214957 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214959 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:47:22.472536 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214963 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214968 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214971 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214975 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214978 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214980 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214983 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214986 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214989 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214992 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214994 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.214997 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215000 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215003 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215005 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215008 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215011 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215013 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215017 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:47:22.660679 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215021 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215024 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215027 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215030 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215032 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215035 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215038 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215040 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215043 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215045 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215048 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215050 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215053 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215057 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215059 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215062 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215064 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215067 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215069 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215072 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:47:22.661645 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215076 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215079 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215082 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215085 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215088 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215090 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215093 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215096 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215098 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215101 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215104 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215106 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215109 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215111 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215117 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215120 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215122 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215125 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215127 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215130 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:47:22.662309 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215133 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215136 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215138 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215141 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215143 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215148 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215150 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215153 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215155 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215158 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215161 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215163 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215166 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215168 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215172 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215175 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215177 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215180 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215182 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:47:22.662937 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215185 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215187 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215190 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215193 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215195 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215198 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215200 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215202 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215205 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215208 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215210 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215213 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.215218 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215340 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215346 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:47:22.663503 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215349 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215352 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215354 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215359 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215362 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215364 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215367 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215369 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215372 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215374 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215377 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215379 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215382 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215386 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215389 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215393 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215396 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215399 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215402 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:47:22.663973 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215406 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215409 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215412 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215414 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215417 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215419 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215422 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215425 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215427 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215430 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215432 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215435 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215438 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215440 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215442 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215445 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215449 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215452 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215454 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215457 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:47:22.664532 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215460 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215462 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215465 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215468 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215470 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215473 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215477 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215479 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215482 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215484 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215487 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215489 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215492 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215494 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215498 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215501 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215504 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215507 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215509 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215512 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:47:22.665168 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215515 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215517 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215520 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215522 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215525 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215527 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215530 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215532 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215536 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215539 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215543 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215546 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215548 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215551 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215553 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215555 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215558 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215560 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215564 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:47:22.665760 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215567 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215569 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215572 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215574 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215577 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215579 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215582 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215584 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215587 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215589 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215592 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215594 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215597 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215599 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215603 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215605 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215607 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215610 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:47:22.666338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:22.215612 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.215617 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.215709 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.218962 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.220141 2564 server.go:1019] "Starting client certificate rotation" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.220249 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.220295 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.223102 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.227736 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.241600 2564 log.go:25] "Validated CRI v1 runtime API" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.243556 2564 log.go:25] "Validated CRI v1 image API" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.244495 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 17:47:22.666868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.246667 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a6b3a0a7-ad67-4e04-95df-d4f5481d27aa:/dev/nvme0n1p3 d2ae1200-64d9-4e66-a197-eff4b6608b9b:/dev/nvme0n1p4] Jul 01 17:47:22.667278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.246681 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 17:47:22.667356 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.250650 2564 manager.go:216] Machine: {Timestamp:2026-07-01 17:47:22.2501618 +0000 UTC m=+0.314197963 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100942 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e6cc8eb2c6ebfdba9b1713c6e1c20 SystemUUID:ec2e6cc8-eb2c-6ebf-dba9-b1713c6e1c20 BootID:f20165cd-3861-4437-b89c-41b6b66602bf Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:7b:a5:a5:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:7b:a5:a5:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:1f:db:f3:80:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 17:47:22.667356 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.250757 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 17:47:22.667356 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.250818 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 17:47:22.667356 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.253148 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:47:22.667356 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.254615 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 17:47:22.667356 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.254639 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 17:47:22.667356 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.256137 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.256147 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.256159 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.256808 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.257627 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.261434 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.261536 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.261562 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.261570 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.261583 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.261594 2564 kubelet.go:398] "Adding apiserver pod source" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.261602 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.262028 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.262066 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.265798 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.267231 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.267259 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.267475 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.267490 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.267495 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.267500 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.267509 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.267514 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.268047 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.268055 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.268062 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.268068 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.268076 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.268084 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.268107 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.268112 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.271161 2564 server.go:1268] "Started kubelet" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.271229 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.271267 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.271886 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.272517 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.277919 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.277980 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.278112 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.278728 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 01 17:47:22.667677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.282338 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.282347 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.282456 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.282950 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.282960 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.282974 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.283058 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.283070 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.283027 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-118.ec2.internal.18be3b9baba4c482 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-118.ec2.internal,UID:ip-10-0-136-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-118.ec2.internal,},FirstTimestamp:2026-07-01 17:47:22.270966914 +0000 UTC m=+0.335003078,LastTimestamp:2026-07-01 17:47:22.270966914 +0000 UTC m=+0.335003078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-118.ec2.internal,}" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.285445 2564 factory.go:55] Registering systemd factory Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.285458 2564 factory.go:223] Registration of the systemd container factory successfully Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.285612 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.285672 2564 factory.go:153] Registering CRI-O factory Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.285684 2564 factory.go:223] Registration of the crio container factory successfully Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.285731 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.285752 2564 factory.go:103] Registering Raw factory Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.285765 2564 manager.go:1196] Started watching for new ooms in manager Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.286129 2564 manager.go:349] Starting recovery of all containers Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.287442 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.287554 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.296115 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tf4fw" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.300804 2564 manager.go:354] Recovery completed Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.301774 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tf4fw" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.305373 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.307090 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.307114 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.307128 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.307742 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.307752 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.307769 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.309811 2564 policy_none.go:49] "None policy: Start" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.309827 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.309839 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 17:47:22.668781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.311842 2564 policy_none.go:47] "Start" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.312580 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.312930 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-118.ec2.internal.18be3b9badcc2b5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-118.ec2.internal,UID:ip-10-0-136-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-118.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-118.ec2.internal,},FirstTimestamp:2026-07-01 17:47:22.307103579 +0000 UTC m=+0.371139746,LastTimestamp:2026-07-01 17:47:22.307103579 +0000 UTC m=+0.371139746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-118.ec2.internal,}" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.313346 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.313368 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.313379 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.357005 2564 manager.go:337] "Starting Device Plugin manager" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.357037 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.357046 2564 server.go:87] "Starting device plugin registration server" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.357242 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.357252 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.357364 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.357450 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.357458 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.357912 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.357965 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.375210 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.376439 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.376472 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.376491 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.376521 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.378870 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.457801 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.459536 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.459563 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.459579 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.459609 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.466632 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.466648 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-118.ec2.internal\": node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.476696 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal"] Jul 01 17:47:22.669757 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.476751 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.483538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc9dbc8ee411bb875214358c5168d68e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"cc9dbc8ee411bb875214358c5168d68e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.483568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9dbc8ee411bb875214358c5168d68e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"cc9dbc8ee411bb875214358c5168d68e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.483950 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.483978 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.483988 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.486333 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.486432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.486459 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.487375 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.487397 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.487384 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.487411 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.487424 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.487513 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.490879 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.491345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.491364 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.492709 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.492740 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.492758 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.511934 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-118.ec2.internal\" not found" node="ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.519327 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-118.ec2.internal\" not found" node="ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.584620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc9dbc8ee411bb875214358c5168d68e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"cc9dbc8ee411bb875214358c5168d68e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.670640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.584642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9dbc8ee411bb875214358c5168d68e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"cc9dbc8ee411bb875214358c5168d68e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.671383 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.584661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6bfb7656da3d3c6e9389e9a4775b6152-config\") pod \"kube-apiserver-proxy-ip-10-0-136-118.ec2.internal\" (UID: \"6bfb7656da3d3c6e9389e9a4775b6152\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.671383 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.584712 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc9dbc8ee411bb875214358c5168d68e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"cc9dbc8ee411bb875214358c5168d68e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.671383 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.584728 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9dbc8ee411bb875214358c5168d68e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"cc9dbc8ee411bb875214358c5168d68e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.671383 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.591984 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:22.867800 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.684812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6bfb7656da3d3c6e9389e9a4775b6152-config\") pod \"kube-apiserver-proxy-ip-10-0-136-118.ec2.internal\" (UID: \"6bfb7656da3d3c6e9389e9a4775b6152\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.867800 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.684861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6bfb7656da3d3c6e9389e9a4775b6152-config\") pod \"kube-apiserver-proxy-ip-10-0-136-118.ec2.internal\" (UID: \"6bfb7656da3d3c6e9389e9a4775b6152\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.867800 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.692489 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:22.867800 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.792646 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:22.867800 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.816570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:22.867800 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:22.823009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" Jul 01 17:47:23.093353 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.893685 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:23.093353 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:22.994515 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:23.094723 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:23.094610 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:23.304453 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:23.195467 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:23.304453 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.221581 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 17:47:23.304453 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.221706 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 17:47:23.304453 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:23.295707 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:23.308338 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.306468 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 17:42:23 +0000 UTC" deadline="2028-03-18 04:36:29.61770003 +0000 UTC" Jul 01 17:47:23.308338 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.306493 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15010h49m6.311210418s" Jul 01 17:47:23.487691 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:23.396456 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:23.662175 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:23.496780 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found" Jul 01 17:47:23.662175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.510537 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:47:23.662175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.544152 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:47:23.662175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.585278 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" Jul 01 17:47:23.662175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.603821 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:47:23.662175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.605647 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" Jul 01 17:47:23.662175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.615738 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:47:23.831191 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:23.740045 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9dbc8ee411bb875214358c5168d68e.slice/crio-d0f5fa88596846c6c5e8f6d9297b15da727812aa2e14a12a064c9d0bf9d53d2e WatchSource:0}: Error finding container d0f5fa88596846c6c5e8f6d9297b15da727812aa2e14a12a064c9d0bf9d53d2e: Status 404 returned error can't find the container with id d0f5fa88596846c6c5e8f6d9297b15da727812aa2e14a12a064c9d0bf9d53d2e Jul 01 17:47:23.831191 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.745205 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:47:24.007698 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:23.863458 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfb7656da3d3c6e9389e9a4775b6152.slice/crio-c87dfae8e8f4222238423a759c3d84e828fb675e8e06459d19323d3aab1b2f38 WatchSource:0}: Error finding container c87dfae8e8f4222238423a759c3d84e828fb675e8e06459d19323d3aab1b2f38: Status 404 returned error can't find the container with id c87dfae8e8f4222238423a759c3d84e828fb675e8e06459d19323d3aab1b2f38 Jul 01 17:47:24.007698 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:23.876576 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.241491 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.265250 2564 apiserver.go:52] "Watching apiserver" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.277308 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.279065 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-zpbhg","kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6","openshift-cluster-node-tuning-operator/tuned-7fwc4","openshift-dns/node-resolver-qwj6r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal","openshift-multus/network-metrics-daemon-v7sf7","openshift-network-diagnostics/network-check-target-tp4vq","kube-system/global-pull-secret-syncer-ww66v","openshift-image-registry/node-ca-pms5d","openshift-multus/multus-7mkmk","openshift-multus/multus-additional-cni-plugins-rvrbz","openshift-network-operator/iptables-alerter-ksckp","openshift-ovn-kubernetes/ovnkube-node-qdxnd"] Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.281641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.281738 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.283421 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.283829 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.285970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.288339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.290621 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.292720 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8sdv2\"" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.292735 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.292735 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.292823 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r98mn\"" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.293087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.293541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.293575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28j6f\" (UniqueName: \"kubernetes.io/projected/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-kube-api-access-28j6f\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.293600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-iptables-alerter-script\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.336371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.293638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-host-slash\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.293667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zgg6\" (UniqueName: \"kubernetes.io/projected/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-kube-api-access-5zgg6\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.295616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.295684 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.295911 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.295922 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.296051 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.296143 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.296474 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.296627 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fgpjl\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.296678 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.298154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.298918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.298931 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.299682 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.299715 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.299728 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.299763 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.300059 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lcf4t\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.300119 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.300135 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p662f\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.300662 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.301132 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m2hlk\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.301222 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.301413 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.301731 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.301787 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:24.338196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.302865 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.304230 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.307024 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.308839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s2v4q\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.309193 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.309231 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.309242 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.309799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.329545 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ftqw5" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.331716 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.331853 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.331946 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xmbv4\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.332362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xh9qx\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.332382 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.332366 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.332684 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.332712 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 17:47:24.340229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.339618 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ftqw5" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.381809 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" event={"ID":"6bfb7656da3d3c6e9389e9a4775b6152","Type":"ContainerStarted","Data":"c87dfae8e8f4222238423a759c3d84e828fb675e8e06459d19323d3aab1b2f38"} Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.383225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" event={"ID":"cc9dbc8ee411bb875214358c5168d68e","Type":"ContainerStarted","Data":"d0f5fa88596846c6c5e8f6d9297b15da727812aa2e14a12a064c9d0bf9d53d2e"} Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.383984 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-device-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-env-overrides\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-netns\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-daemon-config\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-sys-fs\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysconfig\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-system-cni-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-conf-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-var-lib-kubelet\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.429278 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-kubelet\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-socket-dir-parent\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.394993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-kubernetes\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-systemd\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa9a7281-047c-49c7-9918-135e2def1c39-etc-tuned\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-systemd\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-var-lib-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-sys\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.432090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-lib-modules\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56dba866-0ae2-4f09-8844-c88073be934a-host\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-dbus\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysctl-conf\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6hrf\" (UniqueName: \"kubernetes.io/projected/fa9a7281-047c-49c7-9918-135e2def1c39-kube-api-access-f6hrf\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395386 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-systemd-units\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-modprobe-d\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9a7281-047c-49c7-9918-135e2def1c39-tmp\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.395514 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.433079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kmpn\" (UniqueName: \"kubernetes.io/projected/d6423e5c-8d79-422f-a2a9-16ecdca417d0-kube-api-access-8kmpn\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.395581 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs podName:12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e nodeName:}" failed. No retries permitted until 2026-07-01 17:47:24.895560293 +0000 UTC m=+2.959596471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs") pod "network-metrics-daemon-v7sf7" (UID: "12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b245e59d-dbcb-4f33-bff1-ce335c189944-tmp-dir\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-cni-binary-copy\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-host\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-os-release\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-cni-multus\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cnibin\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-run-netns\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-etc-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-kubelet-config\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395909 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-k8s-cni-cncf-io\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.435432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4bs8\" (UniqueName: \"kubernetes.io/projected/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-kube-api-access-k4bs8\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-cni-bin\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.395981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8bg9\" (UniqueName: \"kubernetes.io/projected/56dba866-0ae2-4f09-8844-c88073be934a-kube-api-access-p8bg9\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-system-cni-dir\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-cnibin\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396096 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-kubelet\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysctl-d\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-cni-netd\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396168 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5-konnectivity-ca\") pod \"konnectivity-agent-zpbhg\" (UID: \"601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5\") " pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-cni-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-cni-bin\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-socket-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-registration-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-ovn\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.436631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56dba866-0ae2-4f09-8844-c88073be934a-serviceca\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-multus-certs\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4whmn\" (UniqueName: \"kubernetes.io/projected/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-kube-api-access-4whmn\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-os-release\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovnkube-script-lib\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5-agent-certs\") pod \"konnectivity-agent-zpbhg\" (UID: \"601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5\") " pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-host-slash\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fkhx\" (UniqueName: \"kubernetes.io/projected/afbd4cb1-f60a-40ef-a43a-1ede18eca065-kube-api-access-2fkhx\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-host-slash\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-run\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-log-socket\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-hostroot\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b245e59d-dbcb-4f33-bff1-ce335c189944-hosts-file\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lc4h\" (UniqueName: \"kubernetes.io/projected/b245e59d-dbcb-4f33-bff1-ce335c189944-kube-api-access-7lc4h\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.441828 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-etc-kubernetes\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396842 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28j6f\" (UniqueName: \"kubernetes.io/projected/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-kube-api-access-28j6f\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-iptables-alerter-script\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zgg6\" (UniqueName: \"kubernetes.io/projected/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-kube-api-access-5zgg6\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-slash\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-node-log\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.396964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovnkube-config\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.397551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-iptables-alerter-script\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.404215 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.408468 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28j6f\" (UniqueName: \"kubernetes.io/projected/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-kube-api-access-28j6f\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:24.442571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.408487 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zgg6\" (UniqueName: \"kubernetes.io/projected/b4bc9e3d-31ed-4b59-bf77-cadb29f09206-kube-api-access-5zgg6\") pod \"iptables-alerter-ksckp\" (UID: \"b4bc9e3d-31ed-4b59-bf77-cadb29f09206\") " pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-log-socket\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-hostroot\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497513 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-log-socket\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b245e59d-dbcb-4f33-bff1-ce335c189944-hosts-file\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lc4h\" (UniqueName: \"kubernetes.io/projected/b245e59d-dbcb-4f33-bff1-ce335c189944-kube-api-access-7lc4h\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-etc-kubernetes\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-hostroot\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-slash\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b245e59d-dbcb-4f33-bff1-ce335c189944-hosts-file\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-node-log\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497649 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-etc-kubernetes\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovnkube-config\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497680 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-slash\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-device-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.532231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-env-overrides\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497726 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-node-log\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-netns\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-daemon-config\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-sys-fs\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysconfig\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-system-cni-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.497931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-conf-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysconfig\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-var-lib-kubelet\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498043 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-kubelet\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498087 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-kubelet\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.534953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498056 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498151 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-system-cni-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498166 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-device-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498146 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-conf-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-netns\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498211 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-var-lib-kubelet\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-sys-fs\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-socket-dir-parent\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-kubernetes\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498402 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-socket-dir-parent\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-systemd\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498489 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-kubernetes\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.535647 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa9a7281-047c-49c7-9918-135e2def1c39-etc-tuned\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-systemd\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-systemd\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-var-lib-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498623 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-systemd\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498647 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-daemon-config\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-var-lib-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-sys\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.498708 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-lib-modules\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56dba866-0ae2-4f09-8844-c88073be934a-host\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.616822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.498823 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret podName:d5ca0dc4-4f82-4ed1-bc82-396932e508f0 nodeName:}" failed. No retries permitted until 2026-07-01 17:47:24.998800526 +0000 UTC m=+3.062836683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret") pod "global-pull-secret-syncer-ww66v" (UID: "d5ca0dc4-4f82-4ed1-bc82-396932e508f0") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498828 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-sys\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-dbus\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysctl-conf\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6hrf\" (UniqueName: \"kubernetes.io/projected/fa9a7281-047c-49c7-9918-135e2def1c39-kube-api-access-f6hrf\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498926 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovnkube-config\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-systemd-units\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-lib-modules\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499028 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-systemd-units\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499063 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-modprobe-d\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9a7281-047c-49c7-9918-135e2def1c39-tmp\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.618372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499109 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-dbus\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499123 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysctl-conf\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.498849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-env-overrides\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kmpn\" (UniqueName: \"kubernetes.io/projected/d6423e5c-8d79-422f-a2a9-16ecdca417d0-kube-api-access-8kmpn\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b245e59d-dbcb-4f33-bff1-ce335c189944-tmp-dir\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-modprobe-d\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499268 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499322 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56dba866-0ae2-4f09-8844-c88073be934a-host\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-cni-binary-copy\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-host\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.619301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-os-release\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-host\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499528 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-os-release\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-cni-multus\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499563 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b245e59d-dbcb-4f33-bff1-ce335c189944-tmp-dir\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499577 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cnibin\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-run-netns\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499644 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-cni-multus\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-etc-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-run-netns\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-kubelet-config\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-k8s-cni-cncf-io\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.620923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-kubelet-config\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499789 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-etc-openvswitch\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4bs8\" (UniqueName: \"kubernetes.io/projected/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-kube-api-access-k4bs8\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499807 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-k8s-cni-cncf-io\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-cni-bin\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-cni-bin\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-cnibin\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.499991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8bg9\" (UniqueName: \"kubernetes.io/projected/56dba866-0ae2-4f09-8844-c88073be934a-kube-api-access-p8bg9\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-system-cni-dir\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-cnibin\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500059 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-cni-binary-copy\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-kubelet\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-cnibin\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500099 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-system-cni-dir\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysctl-d\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.622046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-cni-netd\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5-konnectivity-ca\") pod \"konnectivity-agent-zpbhg\" (UID: \"601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5\") " pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-kubelet\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-cni-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-cni-bin\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-socket-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-registration-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500318 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-host-cni-netd\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-ovn\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500364 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-etc-sysctl-d\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500373 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6423e5c-8d79-422f-a2a9-16ecdca417d0-run-ovn\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56dba866-0ae2-4f09-8844-c88073be934a-serviceca\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-multus-certs\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4whmn\" (UniqueName: \"kubernetes.io/projected/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-kube-api-access-4whmn\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-socket-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.623513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-os-release\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500512 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-multus-cni-dir\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovnkube-script-lib\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-var-lib-cni-bin\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/afbd4cb1-f60a-40ef-a43a-1ede18eca065-registration-dir\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5-agent-certs\") pod \"konnectivity-agent-zpbhg\" (UID: \"601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5\") " pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500589 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-host-run-multus-certs\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fkhx\" (UniqueName: \"kubernetes.io/projected/afbd4cb1-f60a-40ef-a43a-1ede18eca065-kube-api-access-2fkhx\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-run\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-os-release\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5-konnectivity-ca\") pod \"konnectivity-agent-zpbhg\" (UID: \"601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5\") " pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.500946 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa9a7281-047c-49c7-9918-135e2def1c39-run\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.501006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56dba866-0ae2-4f09-8844-c88073be934a-serviceca\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.501419 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovnkube-script-lib\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.501553 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa9a7281-047c-49c7-9918-135e2def1c39-etc-tuned\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.624263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.501860 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9a7281-047c-49c7-9918-135e2def1c39-tmp\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.502890 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6423e5c-8d79-422f-a2a9-16ecdca417d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.503327 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5-agent-certs\") pod \"konnectivity-agent-zpbhg\" (UID: \"601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5\") " pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.507987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lc4h\" (UniqueName: \"kubernetes.io/projected/b245e59d-dbcb-4f33-bff1-ce335c189944-kube-api-access-7lc4h\") pod \"node-resolver-qwj6r\" (UID: \"b245e59d-dbcb-4f33-bff1-ce335c189944\") " pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.509001 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.509022 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.509036 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ttjhq for pod openshift-network-diagnostics/network-check-target-tp4vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.509094 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq podName:609f9bd1-c21c-4896-8d49-9dc004c0085b nodeName:}" failed. No retries permitted until 2026-07-01 17:47:25.009079269 +0000 UTC m=+3.073115427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ttjhq" (UniqueName: "kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq") pod "network-check-target-tp4vq" (UID: "609f9bd1-c21c-4896-8d49-9dc004c0085b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.512681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8bg9\" (UniqueName: \"kubernetes.io/projected/56dba866-0ae2-4f09-8844-c88073be934a-kube-api-access-p8bg9\") pod \"node-ca-pms5d\" (UID: \"56dba866-0ae2-4f09-8844-c88073be934a\") " pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.514511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4bs8\" (UniqueName: \"kubernetes.io/projected/a59d66bc-3586-4c9a-93f9-79ec1c600e8c-kube-api-access-k4bs8\") pod \"multus-additional-cni-plugins-rvrbz\" (UID: \"a59d66bc-3586-4c9a-93f9-79ec1c600e8c\") " pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.515086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fkhx\" (UniqueName: \"kubernetes.io/projected/afbd4cb1-f60a-40ef-a43a-1ede18eca065-kube-api-access-2fkhx\") pod \"aws-ebs-csi-driver-node-cjjv6\" (UID: \"afbd4cb1-f60a-40ef-a43a-1ede18eca065\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.515973 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kmpn\" (UniqueName: \"kubernetes.io/projected/d6423e5c-8d79-422f-a2a9-16ecdca417d0-kube-api-access-8kmpn\") pod \"ovnkube-node-qdxnd\" (UID: \"d6423e5c-8d79-422f-a2a9-16ecdca417d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.516190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6hrf\" (UniqueName: \"kubernetes.io/projected/fa9a7281-047c-49c7-9918-135e2def1c39-kube-api-access-f6hrf\") pod \"tuned-7fwc4\" (UID: \"fa9a7281-047c-49c7-9918-135e2def1c39\") " pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.516264 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4whmn\" (UniqueName: \"kubernetes.io/projected/1f7ee57d-7372-46b4-b0a0-0d18dc009c9c-kube-api-access-4whmn\") pod \"multus-7mkmk\" (UID: \"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c\") " pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.595844 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ksckp" Jul 01 17:47:24.625228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.604594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" Jul 01 17:47:24.627017 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:24.608254 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bc9e3d_31ed_4b59_bf77_cadb29f09206.slice/crio-b1cbcfa90d5926e178be346648073725b000b04cd2b6320131cccd1084495f69 WatchSource:0}: Error finding container b1cbcfa90d5926e178be346648073725b000b04cd2b6320131cccd1084495f69: Status 404 returned error can't find the container with id b1cbcfa90d5926e178be346648073725b000b04cd2b6320131cccd1084495f69 Jul 01 17:47:24.627017 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.612927 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" Jul 01 17:47:24.627017 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.619054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qwj6r" Jul 01 17:47:24.627699 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.627678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:24.629523 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:24.629503 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9a7281_047c_49c7_9918_135e2def1c39.slice/crio-7507163c4b3bed8c85d15c6959c143e819bf3152e86e91e6ccbd196bd30b7b2d WatchSource:0}: Error finding container 7507163c4b3bed8c85d15c6959c143e819bf3152e86e91e6ccbd196bd30b7b2d: Status 404 returned error can't find the container with id 7507163c4b3bed8c85d15c6959c143e819bf3152e86e91e6ccbd196bd30b7b2d Jul 01 17:47:24.630268 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:24.630250 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb245e59d_dbcb_4f33_bff1_ce335c189944.slice/crio-b835dfe671f3240cf7f02c5dfb5deebeb773d2dc48097233dc0120eac96dffbd WatchSource:0}: Error finding container b835dfe671f3240cf7f02c5dfb5deebeb773d2dc48097233dc0120eac96dffbd: Status 404 returned error can't find the container with id b835dfe671f3240cf7f02c5dfb5deebeb773d2dc48097233dc0120eac96dffbd Jul 01 17:47:24.634376 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.634355 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:24.638161 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:24.638054 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6423e5c_8d79_422f_a2a9_16ecdca417d0.slice/crio-007c4e81dc482b407c16a56d4c192835b172f78c1e73fb83967d0b7ebdf63401 WatchSource:0}: Error finding container 007c4e81dc482b407c16a56d4c192835b172f78c1e73fb83967d0b7ebdf63401: Status 404 returned error can't find the container with id 007c4e81dc482b407c16a56d4c192835b172f78c1e73fb83967d0b7ebdf63401 Jul 01 17:47:24.641916 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.641899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pms5d" Jul 01 17:47:24.644862 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:24.644838 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601316e7_6c4e_4ba1_ad0a_a2125b2aeaf5.slice/crio-dd83ff42e29546ed8eeb3b9a3768177877dd02b650a51b080443c1dd179c23c7 WatchSource:0}: Error finding container dd83ff42e29546ed8eeb3b9a3768177877dd02b650a51b080443c1dd179c23c7: Status 404 returned error can't find the container with id dd83ff42e29546ed8eeb3b9a3768177877dd02b650a51b080443c1dd179c23c7 Jul 01 17:47:24.651452 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.651425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mkmk" Jul 01 17:47:24.656494 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.656139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" Jul 01 17:47:24.672837 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:24.672775 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56dba866_0ae2_4f09_8844_c88073be934a.slice/crio-5598ca0c83234232f00d02b9585a0ae92062750ea2eac00cda46ab057eee9122 WatchSource:0}: Error finding container 5598ca0c83234232f00d02b9585a0ae92062750ea2eac00cda46ab057eee9122: Status 404 returned error can't find the container with id 5598ca0c83234232f00d02b9585a0ae92062750ea2eac00cda46ab057eee9122 Jul 01 17:47:24.681998 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:24.681979 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59d66bc_3586_4c9a_93f9_79ec1c600e8c.slice/crio-4da1e6d6b558d7d5f757414c8ff7b255d4c9c4b11d5055703f2f050166772183 WatchSource:0}: Error finding container 4da1e6d6b558d7d5f757414c8ff7b255d4c9c4b11d5055703f2f050166772183: Status 404 returned error can't find the container with id 4da1e6d6b558d7d5f757414c8ff7b255d4c9c4b11d5055703f2f050166772183 Jul 01 17:47:24.684477 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:47:24.684455 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7ee57d_7372_46b4_b0a0_0d18dc009c9c.slice/crio-e83f4c43c067f2563bf64fff1181128da8e904a18e6b2f1434ed41f0689c43e5 WatchSource:0}: Error finding container e83f4c43c067f2563bf64fff1181128da8e904a18e6b2f1434ed41f0689c43e5: Status 404 returned error can't find the container with id e83f4c43c067f2563bf64fff1181128da8e904a18e6b2f1434ed41f0689c43e5 Jul 01 17:47:24.903747 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:24.903665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:24.903891 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.903819 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:24.903891 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:24.903888 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs podName:12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e nodeName:}" failed. No retries permitted until 2026-07-01 17:47:25.903870136 +0000 UTC m=+3.967906300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs") pod "network-metrics-daemon-v7sf7" (UID: "12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:25.004745 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.004711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:25.004910 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:25.004880 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:25.004990 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:25.004955 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret podName:d5ca0dc4-4f82-4ed1-bc82-396932e508f0 nodeName:}" failed. No retries permitted until 2026-07-01 17:47:26.004934809 +0000 UTC m=+4.068970984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret") pod "global-pull-secret-syncer-ww66v" (UID: "d5ca0dc4-4f82-4ed1-bc82-396932e508f0") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:25.105442 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.105409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:25.105595 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:25.105575 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:47:25.105676 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:25.105600 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:47:25.105676 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:25.105614 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ttjhq for pod openshift-network-diagnostics/network-check-target-tp4vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:25.105788 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:25.105679 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq podName:609f9bd1-c21c-4896-8d49-9dc004c0085b nodeName:}" failed. No retries permitted until 2026-07-01 17:47:26.105659387 +0000 UTC m=+4.169695557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttjhq" (UniqueName: "kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq") pod "network-check-target-tp4vq" (UID: "609f9bd1-c21c-4896-8d49-9dc004c0085b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:25.343250 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.343170 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:42:24 +0000 UTC" deadline="2028-02-13 16:49:16.834725685 +0000 UTC" Jul 01 17:47:25.343250 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.343208 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14207h1m51.491526997s" Jul 01 17:47:25.386268 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.386234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"007c4e81dc482b407c16a56d4c192835b172f78c1e73fb83967d0b7ebdf63401"} Jul 01 17:47:25.387482 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.387457 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mkmk" event={"ID":"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c","Type":"ContainerStarted","Data":"e83f4c43c067f2563bf64fff1181128da8e904a18e6b2f1434ed41f0689c43e5"} Jul 01 17:47:25.388611 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.388588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pms5d" event={"ID":"56dba866-0ae2-4f09-8844-c88073be934a","Type":"ContainerStarted","Data":"5598ca0c83234232f00d02b9585a0ae92062750ea2eac00cda46ab057eee9122"} Jul 01 17:47:25.389601 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.389582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zpbhg" event={"ID":"601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5","Type":"ContainerStarted","Data":"dd83ff42e29546ed8eeb3b9a3768177877dd02b650a51b080443c1dd179c23c7"} Jul 01 17:47:25.390724 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.390704 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qwj6r" event={"ID":"b245e59d-dbcb-4f33-bff1-ce335c189944","Type":"ContainerStarted","Data":"b835dfe671f3240cf7f02c5dfb5deebeb773d2dc48097233dc0120eac96dffbd"} Jul 01 17:47:25.391804 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.391782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" event={"ID":"fa9a7281-047c-49c7-9918-135e2def1c39","Type":"ContainerStarted","Data":"7507163c4b3bed8c85d15c6959c143e819bf3152e86e91e6ccbd196bd30b7b2d"} Jul 01 17:47:25.392763 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.392740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" event={"ID":"afbd4cb1-f60a-40ef-a43a-1ede18eca065","Type":"ContainerStarted","Data":"81cfa40b20d02fef33b5a06cc24acb6d4f5ecb597ed2ac0a197d4e6211c699d9"} Jul 01 17:47:25.393862 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.393835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ksckp" event={"ID":"b4bc9e3d-31ed-4b59-bf77-cadb29f09206","Type":"ContainerStarted","Data":"b1cbcfa90d5926e178be346648073725b000b04cd2b6320131cccd1084495f69"} Jul 01 17:47:25.394860 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.394842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" event={"ID":"a59d66bc-3586-4c9a-93f9-79ec1c600e8c","Type":"ContainerStarted","Data":"4da1e6d6b558d7d5f757414c8ff7b255d4c9c4b11d5055703f2f050166772183"} Jul 01 17:47:25.913583 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:25.913486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:25.913990 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:25.913653 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:25.913990 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:25.913722 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs podName:12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e nodeName:}" failed. No retries permitted until 2026-07-01 17:47:27.913701498 +0000 UTC m=+5.977737654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs") pod "network-metrics-daemon-v7sf7" (UID: "12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:26.014960 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.014919 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:26.015142 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.015084 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:26.015202 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.015147 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret podName:d5ca0dc4-4f82-4ed1-bc82-396932e508f0 nodeName:}" failed. No retries permitted until 2026-07-01 17:47:28.015128568 +0000 UTC m=+6.079164728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret") pod "global-pull-secret-syncer-ww66v" (UID: "d5ca0dc4-4f82-4ed1-bc82-396932e508f0") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:26.116745 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.116024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:26.116745 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.116245 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:47:26.116745 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.116265 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:47:26.116745 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.116279 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ttjhq for pod openshift-network-diagnostics/network-check-target-tp4vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:26.116745 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.116377 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq podName:609f9bd1-c21c-4896-8d49-9dc004c0085b nodeName:}" failed. No retries permitted until 2026-07-01 17:47:28.116321903 +0000 UTC m=+6.180358063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttjhq" (UniqueName: "kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq") pod "network-check-target-tp4vq" (UID: "609f9bd1-c21c-4896-8d49-9dc004c0085b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:26.344263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.344102 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:42:24 +0000 UTC" deadline="2028-02-21 06:57:32.186584536 +0000 UTC" Jul 01 17:47:26.344263 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.344166 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14389h10m5.84242294s" Jul 01 17:47:26.380435 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.379484 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:26.380435 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.379632 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:26.380435 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.380084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:26.380435 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.380197 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:26.380435 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.380270 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:26.380435 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:26.380345 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:26.401486 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.401453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" event={"ID":"6bfb7656da3d3c6e9389e9a4775b6152","Type":"ContainerStarted","Data":"ddfffb1a79c025e55395a748244e3780c8377eec0de7ef0c6480166698bafea3"} Jul 01 17:47:26.422050 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:26.421995 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" podStartSLOduration=2.421978036 podStartE2EDuration="2.421978036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:26.421799216 +0000 UTC m=+4.485835420" watchObservedRunningTime="2026-07-01 17:47:26.421978036 +0000 UTC m=+4.486014207" Jul 01 17:47:27.934041 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:27.934002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:27.934579 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:27.934193 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:27.934579 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:27.934259 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs podName:12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e nodeName:}" failed. No retries permitted until 2026-07-01 17:47:31.934236502 +0000 UTC m=+9.998272658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs") pod "network-metrics-daemon-v7sf7" (UID: "12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:28.034850 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:28.034772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:28.035045 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.035024 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:28.035232 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.035214 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret podName:d5ca0dc4-4f82-4ed1-bc82-396932e508f0 nodeName:}" failed. No retries permitted until 2026-07-01 17:47:32.035191227 +0000 UTC m=+10.099227407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret") pod "global-pull-secret-syncer-ww66v" (UID: "d5ca0dc4-4f82-4ed1-bc82-396932e508f0") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:28.136184 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:28.135484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:28.136184 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.135703 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:47:28.136184 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.135731 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:47:28.136184 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.135746 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ttjhq for pod openshift-network-diagnostics/network-check-target-tp4vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:28.136184 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.135806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq podName:609f9bd1-c21c-4896-8d49-9dc004c0085b nodeName:}" failed. No retries permitted until 2026-07-01 17:47:32.135785169 +0000 UTC m=+10.199821324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttjhq" (UniqueName: "kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq") pod "network-check-target-tp4vq" (UID: "609f9bd1-c21c-4896-8d49-9dc004c0085b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:28.377882 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:28.377011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:28.377882 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.377175 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:28.377882 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:28.377241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:28.377882 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.377324 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:28.377882 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:28.377731 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:28.377882 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:28.377836 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:30.377758 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:30.377487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:30.378261 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:30.377901 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:30.378261 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:30.377503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:30.378261 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:30.378021 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:30.378261 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:30.377503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:30.378261 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:30.378094 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:31.967984 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:31.967947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:31.968516 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:31.968110 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:31.968516 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:31.968177 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs podName:12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e nodeName:}" failed. No retries permitted until 2026-07-01 17:47:39.968156139 +0000 UTC m=+18.032192299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs") pod "network-metrics-daemon-v7sf7" (UID: "12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:32.068635 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:32.068598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:32.068946 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.068820 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:32.068946 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.068922 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret podName:d5ca0dc4-4f82-4ed1-bc82-396932e508f0 nodeName:}" failed. No retries permitted until 2026-07-01 17:47:40.068901316 +0000 UTC m=+18.132937473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret") pod "global-pull-secret-syncer-ww66v" (UID: "d5ca0dc4-4f82-4ed1-bc82-396932e508f0") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:32.169355 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:32.169305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:32.169627 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.169604 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:47:32.169707 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.169636 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:47:32.169707 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.169647 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ttjhq for pod openshift-network-diagnostics/network-check-target-tp4vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:32.169819 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.169785 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq podName:609f9bd1-c21c-4896-8d49-9dc004c0085b nodeName:}" failed. No retries permitted until 2026-07-01 17:47:40.169766921 +0000 UTC m=+18.233803089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttjhq" (UniqueName: "kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq") pod "network-check-target-tp4vq" (UID: "609f9bd1-c21c-4896-8d49-9dc004c0085b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:32.377413 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:32.377359 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:32.378538 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.378498 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:32.378758 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:32.378738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:32.378987 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:32.378857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:32.378987 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.378940 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:32.378987 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:32.378957 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:34.378496 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:34.378412 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:34.378496 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:34.378440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:34.378926 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:34.378413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:34.378926 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:34.378592 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:34.378926 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:34.378722 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:34.378926 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:34.378806 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:36.377605 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:36.377563 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:36.377605 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:36.377590 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:36.378007 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:36.377563 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:36.378007 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:36.377676 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:36.378007 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:36.377769 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:36.378007 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:36.377833 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:38.377284 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:38.377243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:38.377284 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:38.377275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:38.377775 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:38.377399 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:38.377775 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:38.377455 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:38.377775 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:38.377500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:38.377775 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:38.377595 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:40.031529 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:40.031492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:40.031994 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.031617 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:40.031994 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.031673 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs podName:12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e nodeName:}" failed. No retries permitted until 2026-07-01 17:47:56.031655981 +0000 UTC m=+34.095692152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs") pod "network-metrics-daemon-v7sf7" (UID: "12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:40.132541 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:40.132505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:40.132701 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.132615 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:40.132701 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.132662 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret podName:d5ca0dc4-4f82-4ed1-bc82-396932e508f0 nodeName:}" failed. No retries permitted until 2026-07-01 17:47:56.132648246 +0000 UTC m=+34.196684397 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret") pod "global-pull-secret-syncer-ww66v" (UID: "d5ca0dc4-4f82-4ed1-bc82-396932e508f0") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:40.233538 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:40.233507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:40.233692 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.233671 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:47:40.233738 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.233700 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:47:40.233738 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.233711 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ttjhq for pod openshift-network-diagnostics/network-check-target-tp4vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:40.233814 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.233757 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq podName:609f9bd1-c21c-4896-8d49-9dc004c0085b nodeName:}" failed. No retries permitted until 2026-07-01 17:47:56.233744606 +0000 UTC m=+34.297780761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttjhq" (UniqueName: "kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq") pod "network-check-target-tp4vq" (UID: "609f9bd1-c21c-4896-8d49-9dc004c0085b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:40.377022 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:40.376947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:40.377022 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:40.376965 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:40.377239 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:40.376948 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:40.377239 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.377075 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:40.377239 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.377133 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:40.377239 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:40.377208 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:42.377369 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:42.377341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:42.377841 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:42.377408 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:42.377841 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:42.377430 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:42.377841 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:42.377507 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:42.377841 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:42.377532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:42.377841 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:42.377650 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:44.377715 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:44.377685 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:44.378166 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:44.377798 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:44.378166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:44.378159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:44.378283 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:44.378264 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:44.378362 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:44.378306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:44.378444 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:44.378421 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:45.445229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.444930 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mkmk" event={"ID":"1f7ee57d-7372-46b4-b0a0-0d18dc009c9c","Type":"ContainerStarted","Data":"6a405605f891b35fa5610360504c82f2b7138a751c5047234e06a3e1e8d922b7"} Jul 01 17:47:45.446740 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.446582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pms5d" event={"ID":"56dba866-0ae2-4f09-8844-c88073be934a","Type":"ContainerStarted","Data":"225f2468e221b99b3570bc26fc4b22afefc2fced9e6b81adedc9bc9d0b5730c1"} Jul 01 17:47:45.447824 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.447799 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zpbhg" event={"ID":"601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5","Type":"ContainerStarted","Data":"e5b6591cd625e48b8fe96dd846109dfdf2baf0324d03be328f1624b16300ec89"} Jul 01 17:47:45.449221 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.449203 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qwj6r" event={"ID":"b245e59d-dbcb-4f33-bff1-ce335c189944","Type":"ContainerStarted","Data":"e601a4e427f5a00102dd8050a27ef967a4d14305c9d0017d4007070416aae9d3"} Jul 01 17:47:45.450710 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.450452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" event={"ID":"fa9a7281-047c-49c7-9918-135e2def1c39","Type":"ContainerStarted","Data":"4164193fd74d46d8381d10579c136228129b384fd89056b41a4fb5dc60ef785d"} Jul 01 17:47:45.451775 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.451755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" event={"ID":"afbd4cb1-f60a-40ef-a43a-1ede18eca065","Type":"ContainerStarted","Data":"d082e7aff95cec5a2210510b0b578115f2940a357765cec989270a77386b1ccd"} Jul 01 17:47:45.456340 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.456253 2564 generic.go:356] "Generic (PLEG): container finished" podID="cc9dbc8ee411bb875214358c5168d68e" containerID="ec432249bbbd736f5f72a0d431368742a71a371bc33a400927c47a5e46956660" exitCode=0 Jul 01 17:47:45.456430 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.456405 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" event={"ID":"cc9dbc8ee411bb875214358c5168d68e","Type":"ContainerDied","Data":"ec432249bbbd736f5f72a0d431368742a71a371bc33a400927c47a5e46956660"} Jul 01 17:47:45.458160 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.458140 2564 generic.go:356] "Generic (PLEG): container finished" podID="a59d66bc-3586-4c9a-93f9-79ec1c600e8c" containerID="1a291f8129c16835e62d023ee03b3691ec22a2b56442bdb2dbefcfdbb4d1b466" exitCode=0 Jul 01 17:47:45.458245 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.458205 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" event={"ID":"a59d66bc-3586-4c9a-93f9-79ec1c600e8c","Type":"ContainerDied","Data":"1a291f8129c16835e62d023ee03b3691ec22a2b56442bdb2dbefcfdbb4d1b466"} Jul 01 17:47:45.460995 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.460974 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:47:45.461350 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.461239 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6423e5c-8d79-422f-a2a9-16ecdca417d0" containerID="74a6dbac22a369567292d6aa31c19178b0fd08c18a0da0c7e5053438f288d235" exitCode=1 Jul 01 17:47:45.461350 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.461263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"c93c74c1d86fb3c0e89c6bf36139f73deebb064ab2dd9fc1013a504d6a95902c"} Jul 01 17:47:45.461350 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.461305 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerDied","Data":"74a6dbac22a369567292d6aa31c19178b0fd08c18a0da0c7e5053438f288d235"} Jul 01 17:47:45.461350 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.461351 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"a722dc800a581c82ee9c9424b52b5225d9ff0aab5d4bf1440df7bdb1449edf60"} Jul 01 17:47:45.511023 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.510984 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pms5d" podStartSLOduration=6.106986743 podStartE2EDuration="22.510971676s" totalImagesPullingTime="16.403984933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:45.5104915 +0000 UTC m=+23.574527676" watchObservedRunningTime="2026-07-01 17:47:45.510971676 +0000 UTC m=+23.575007850" Jul 01 17:47:45.511118 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.511062 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7mkmk" podStartSLOduration=2.1574256800000002 podStartE2EDuration="22.511056115s" totalImagesPullingTime="20.353630435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:45.491134604 +0000 UTC m=+23.555170788" watchObservedRunningTime="2026-07-01 17:47:45.511056115 +0000 UTC m=+23.575092291" Jul 01 17:47:45.654144 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.654104 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zpbhg" podStartSLOduration=2.318249352 podStartE2EDuration="22.654089844s" totalImagesPullingTime="20.335840492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:45.653612018 +0000 UTC m=+23.717648192" watchObservedRunningTime="2026-07-01 17:47:45.654089844 +0000 UTC m=+23.718126017" Jul 01 17:47:45.654302 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.654284 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qwj6r" podStartSLOduration=2.302589303 podStartE2EDuration="22.654279269s" totalImagesPullingTime="20.351689966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:45.631414031 +0000 UTC m=+23.695450203" watchObservedRunningTime="2026-07-01 17:47:45.654279269 +0000 UTC m=+23.718315445" Jul 01 17:47:45.688729 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:45.688689 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7fwc4" podStartSLOduration=2.315270531 podStartE2EDuration="22.688674309s" totalImagesPullingTime="20.373403778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:45.687668219 +0000 UTC m=+23.751704382" watchObservedRunningTime="2026-07-01 17:47:45.688674309 +0000 UTC m=+23.752710521" Jul 01 17:47:46.377365 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.377296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:46.377535 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.377296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:46.377535 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:46.377436 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:46.377535 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.377500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:46.377688 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:46.377608 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:46.377743 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:46.377695 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:46.465137 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.465096 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ksckp" event={"ID":"b4bc9e3d-31ed-4b59-bf77-cadb29f09206","Type":"ContainerStarted","Data":"78aa6610df8b8d7ed72f362c471ab16bd1bd38d8fa69cf162c3ba5620aabb62c"} Jul 01 17:47:46.468139 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.468108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" event={"ID":"cc9dbc8ee411bb875214358c5168d68e","Type":"ContainerStarted","Data":"c5fe9a8eda56f0ef4cc9f0c8b52ab3163e669536cf671784885060b7bafdcdaa"} Jul 01 17:47:46.471599 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.471576 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:47:46.474464 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.474429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"c1a22df42090b1ddff7274f16bd0313dd9269dcc191005cd3ba6ef4331e51dda"} Jul 01 17:47:46.474590 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.474572 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"fbdcff63220d45235c07ac458389cb97b2c3f701988c925e5f312ffcee88fa87"} Jul 01 17:47:46.474673 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.474658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"8a6a8e0b46cfa0f0e4c4b9a5d71126f06d09aef7e309d46b4ea72d10ec3cc230"} Jul 01 17:47:46.546934 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.546896 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" podStartSLOduration=22.546883332 podStartE2EDuration="22.546883332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:46.54678039 +0000 UTC m=+24.610816563" watchObservedRunningTime="2026-07-01 17:47:46.546883332 +0000 UTC m=+24.610919498" Jul 01 17:47:46.547294 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.547263 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ksckp" podStartSLOduration=3.164311854 podStartE2EDuration="23.547255477s" totalImagesPullingTime="20.382943623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:46.51187378 +0000 UTC m=+24.575909953" watchObservedRunningTime="2026-07-01 17:47:46.547255477 +0000 UTC m=+24.611291651" Jul 01 17:47:46.964728 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:46.964705 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 17:47:47.372552 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:47.372463 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T17:47:46.964724216Z","UUID":"5ea6527b-aee0-4de8-b174-1abe607dbcb8","Handler":null,"Name":"","Endpoint":""} Jul 01 17:47:47.373896 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:47.373873 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 17:47:47.374026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:47.373912 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 17:47:47.479024 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:47.478987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" event={"ID":"afbd4cb1-f60a-40ef-a43a-1ede18eca065","Type":"ContainerStarted","Data":"fd56cbc63d81c848467b48a13b3559045899ba64b3089e5b53fff4c2c359c8b9"} Jul 01 17:47:47.530413 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:47.530382 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwj6r_b245e59d-dbcb-4f33-bff1-ce335c189944/dns-node-resolver/0.log" Jul 01 17:47:48.376905 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:48.376880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:48.377057 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:48.376885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:48.377057 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:48.376985 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:48.377179 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:48.377115 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:48.377179 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:48.377145 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:48.377282 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:48.377260 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:48.483732 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:48.483664 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" event={"ID":"afbd4cb1-f60a-40ef-a43a-1ede18eca065","Type":"ContainerStarted","Data":"e3a56b10e910a6249751b391349a08d0e52e6eaf736c733d83c3fe92b366069f"} Jul 01 17:47:48.487259 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:48.487238 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:47:48.487646 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:48.487620 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"2aa483e4e234e3bdbafe5e1d2979145344f48f46a48574591c61b659de8f0c1f"} Jul 01 17:47:48.679700 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:48.679638 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pms5d_56dba866-0ae2-4f09-8844-c88073be934a/node-ca/0.log" Jul 01 17:47:49.479660 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:49.479386 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:49.480092 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:49.480065 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:49.489459 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:49.489434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:49.489895 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:49.489770 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zpbhg" Jul 01 17:47:49.619241 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:49.619183 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjjv6" podStartSLOduration=3.402250728 podStartE2EDuration="26.619163762s" totalImagesPullingTime="23.216913034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:49.618783447 +0000 UTC m=+27.682819621" watchObservedRunningTime="2026-07-01 17:47:49.619163762 +0000 UTC m=+27.683199934" Jul 01 17:47:50.377549 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:50.377519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:50.377710 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:50.377522 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:50.377710 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:50.377629 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:50.377710 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:50.377525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:50.377876 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:50.377707 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:50.377876 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:50.377796 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:51.495150 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:51.494962 2564 generic.go:356] "Generic (PLEG): container finished" podID="a59d66bc-3586-4c9a-93f9-79ec1c600e8c" containerID="bd4a5f291fc42b926a55d53e055124fbccbf01d01f697aedd56db97392a01d62" exitCode=0 Jul 01 17:47:51.495994 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:51.495056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" event={"ID":"a59d66bc-3586-4c9a-93f9-79ec1c600e8c","Type":"ContainerDied","Data":"bd4a5f291fc42b926a55d53e055124fbccbf01d01f697aedd56db97392a01d62"} Jul 01 17:47:51.499331 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:51.499294 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:47:51.499715 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:51.499681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"09e303c714d6ffe4b738dcb8e4204a06533a9146524506325bf325802f02bb6b"} Jul 01 17:47:51.500145 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:51.500130 2564 scope.go:117] "RemoveContainer" containerID="74a6dbac22a369567292d6aa31c19178b0fd08c18a0da0c7e5053438f288d235" Jul 01 17:47:52.378213 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.378181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:52.378499 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:52.378252 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:52.378499 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.378398 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:52.378632 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.378530 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:52.378632 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:52.378524 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:52.378632 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:52.378624 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:52.505156 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.505122 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:47:52.505575 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.505445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" event={"ID":"d6423e5c-8d79-422f-a2a9-16ecdca417d0","Type":"ContainerStarted","Data":"e803870d9ecabcf03221b5ede9defe393b528ceefa01195305104099ceef255b"} Jul 01 17:47:52.505648 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.505630 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:52.505718 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.505703 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:52.505769 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.505755 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:52.520137 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.520112 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:52.520249 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.520199 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:47:52.559276 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:52.559230 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" podStartSLOduration=9.144596547999999 podStartE2EDuration="29.559217452s" totalImagesPullingTime="20.414620904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:52.556927719 +0000 UTC m=+30.620963891" watchObservedRunningTime="2026-07-01 17:47:52.559217452 +0000 UTC m=+30.623253625" Jul 01 17:47:53.509581 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:53.509547 2564 generic.go:356] "Generic (PLEG): container finished" podID="a59d66bc-3586-4c9a-93f9-79ec1c600e8c" containerID="30f2d57e5fe24b90078ead0869f84a15d89269e76f6f381086bfa7508374c203" exitCode=0 Jul 01 17:47:53.509950 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:53.509632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" event={"ID":"a59d66bc-3586-4c9a-93f9-79ec1c600e8c","Type":"ContainerDied","Data":"30f2d57e5fe24b90078ead0869f84a15d89269e76f6f381086bfa7508374c203"} Jul 01 17:47:54.376879 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:54.376852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:54.376983 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:54.376962 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:54.376983 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:54.376852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:54.377081 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:54.376999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:54.377081 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:54.377053 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:54.377159 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:54.377105 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:54.513732 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:54.513697 2564 generic.go:356] "Generic (PLEG): container finished" podID="a59d66bc-3586-4c9a-93f9-79ec1c600e8c" containerID="99b271f5230c89802da1b79bb9002d52f93eeae09907da07677b1db56f0bb8e2" exitCode=0 Jul 01 17:47:54.514126 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:54.513789 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" event={"ID":"a59d66bc-3586-4c9a-93f9-79ec1c600e8c","Type":"ContainerDied","Data":"99b271f5230c89802da1b79bb9002d52f93eeae09907da07677b1db56f0bb8e2"} Jul 01 17:47:56.054327 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:56.054277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:56.054745 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.054417 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:56.054745 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.054474 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs podName:12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e nodeName:}" failed. No retries permitted until 2026-07-01 17:48:28.054459414 +0000 UTC m=+66.118495569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs") pod "network-metrics-daemon-v7sf7" (UID: "12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:47:56.154549 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:56.154519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:56.154733 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.154665 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:56.154733 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.154723 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret podName:d5ca0dc4-4f82-4ed1-bc82-396932e508f0 nodeName:}" failed. No retries permitted until 2026-07-01 17:48:28.15470608 +0000 UTC m=+66.218742248 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret") pod "global-pull-secret-syncer-ww66v" (UID: "d5ca0dc4-4f82-4ed1-bc82-396932e508f0") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:47:56.255883 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:56.255850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:56.256031 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.256009 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:47:56.256083 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.256031 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:47:56.256083 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.256049 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ttjhq for pod openshift-network-diagnostics/network-check-target-tp4vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:56.256156 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.256105 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq podName:609f9bd1-c21c-4896-8d49-9dc004c0085b nodeName:}" failed. No retries permitted until 2026-07-01 17:48:28.256085932 +0000 UTC m=+66.320122085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttjhq" (UniqueName: "kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq") pod "network-check-target-tp4vq" (UID: "609f9bd1-c21c-4896-8d49-9dc004c0085b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:47:56.377449 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:56.377376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:56.377449 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:56.377395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:56.377632 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:56.377375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:56.377632 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.377505 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:56.377632 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.377584 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:56.377787 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:56.377701 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:58.377399 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:58.377369 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:47:58.377954 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:58.377404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:47:58.377954 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:58.377373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:47:58.377954 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:58.377498 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:47:58.377954 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:58.377574 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:47:58.377954 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:47:58.377646 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:47:59.527820 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:59.527776 2564 generic.go:356] "Generic (PLEG): container finished" podID="a59d66bc-3586-4c9a-93f9-79ec1c600e8c" containerID="79f09611e9e1a0ee0abd3ed5a3effbc0df1baa69037073e1a85129144950f760" exitCode=0 Jul 01 17:47:59.527820 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:47:59.527825 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" event={"ID":"a59d66bc-3586-4c9a-93f9-79ec1c600e8c","Type":"ContainerDied","Data":"79f09611e9e1a0ee0abd3ed5a3effbc0df1baa69037073e1a85129144950f760"} Jul 01 17:48:00.377214 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:00.377182 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:00.377214 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:00.377199 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:00.377446 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:00.377283 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:48:00.377446 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:00.377369 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:48:00.377446 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:00.377429 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:00.377540 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:00.377483 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:48:00.532452 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:00.532417 2564 generic.go:356] "Generic (PLEG): container finished" podID="a59d66bc-3586-4c9a-93f9-79ec1c600e8c" containerID="247557b048469fb0c1d83b56a817e0860699c475d7c930790854f1186ecb8e0c" exitCode=0 Jul 01 17:48:00.532822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:00.532473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" event={"ID":"a59d66bc-3586-4c9a-93f9-79ec1c600e8c","Type":"ContainerDied","Data":"247557b048469fb0c1d83b56a817e0860699c475d7c930790854f1186ecb8e0c"} Jul 01 17:48:01.538387 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:01.538352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" event={"ID":"a59d66bc-3586-4c9a-93f9-79ec1c600e8c","Type":"ContainerStarted","Data":"c4df87583c4756fec14a8e74561310ea56391df670e93e061198ae5b5578f428"} Jul 01 17:48:01.585941 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:01.585900 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rvrbz" podStartSLOduration=6.828852688 podStartE2EDuration="38.585886844s" totalImagesPullingTime="31.757034156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:01.585450872 +0000 UTC m=+39.649487045" watchObservedRunningTime="2026-07-01 17:48:01.585886844 +0000 UTC m=+39.649923046" Jul 01 17:48:02.377637 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:02.377609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:02.377791 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:02.377700 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:48:02.377791 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:02.377720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:02.377791 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:02.377746 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:02.377891 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:02.377808 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:48:02.377922 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:02.377889 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:48:04.376748 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:04.376709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:04.377206 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:04.376720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:04.377206 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:04.376835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:04.377206 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:04.376834 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:48:04.377206 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:04.376905 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:48:04.377206 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:04.377014 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:48:06.377146 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:06.377115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:06.377146 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:06.377133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:06.377146 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:06.377148 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:06.377700 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:06.377219 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:48:06.377700 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:06.377303 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:48:06.377700 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:06.377383 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:48:08.377478 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:08.377445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:08.378022 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:08.377445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:08.378022 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:08.377562 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:48:08.378022 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:08.377452 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:08.378022 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:08.377642 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:48:08.378022 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:08.377704 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:48:10.176723 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:10.176566 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tp4vq"] Jul 01 17:48:10.177244 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:10.176797 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:10.177244 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:10.176884 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:48:10.181395 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:10.181369 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7sf7"] Jul 01 17:48:10.181493 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:10.181454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:10.181541 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:10.181530 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:48:10.202646 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:10.202594 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ww66v"] Jul 01 17:48:10.202728 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:10.202662 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:10.202770 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:10.202729 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:48:11.377351 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:11.377303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:11.377831 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:11.377426 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:48:12.378498 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:12.378464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:12.378879 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:12.378570 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:48:12.378879 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:12.378624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:12.378879 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:12.378732 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:48:13.376796 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:13.376763 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:13.376946 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:13.376859 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ww66v" podUID="d5ca0dc4-4f82-4ed1-bc82-396932e508f0" Jul 01 17:48:14.377421 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.377386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:14.377798 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:14.377505 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tp4vq" podUID="609f9bd1-c21c-4896-8d49-9dc004c0085b" Jul 01 17:48:14.377798 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.377541 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:14.377798 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:14.377632 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7sf7" podUID="12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e" Jul 01 17:48:14.757269 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.757247 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeReady" Jul 01 17:48:14.757399 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.757366 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 17:48:14.848590 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.848569 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xxm9n"] Jul 01 17:48:14.862978 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.862956 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wfrvq"] Jul 01 17:48:14.863073 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.863041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xxm9n" Jul 01 17:48:14.867804 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.867763 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lc74g\"" Jul 01 17:48:14.867919 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.867761 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 17:48:14.868084 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.868060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 17:48:14.870526 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.870507 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 17:48:14.875219 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.875197 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xxm9n"] Jul 01 17:48:14.875324 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.875302 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:14.880386 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.880369 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 17:48:14.880570 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.880557 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ht4zq\"" Jul 01 17:48:14.880636 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.880624 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 17:48:14.880781 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.880753 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 17:48:14.880926 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.880910 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 17:48:14.882500 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.882478 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfrvq"] Jul 01 17:48:14.900379 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.900361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf01d151-3bde-4729-ac33-cad72a028d08-data-volume\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:14.900482 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.900385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf01d151-3bde-4729-ac33-cad72a028d08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:14.900482 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.900415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf01d151-3bde-4729-ac33-cad72a028d08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:14.900482 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.900469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48s7h\" (UniqueName: \"kubernetes.io/projected/ad93e5e9-caa5-4767-bd42-51e57510e4f3-kube-api-access-48s7h\") pod \"ingress-canary-xxm9n\" (UID: \"ad93e5e9-caa5-4767-bd42-51e57510e4f3\") " pod="openshift-ingress-canary/ingress-canary-xxm9n" Jul 01 17:48:14.900603 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.900510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf01d151-3bde-4729-ac33-cad72a028d08-crio-socket\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:14.900603 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.900527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqrbv\" (UniqueName: \"kubernetes.io/projected/cf01d151-3bde-4729-ac33-cad72a028d08-kube-api-access-qqrbv\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:14.900603 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.900542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad93e5e9-caa5-4767-bd42-51e57510e4f3-cert\") pod \"ingress-canary-xxm9n\" (UID: \"ad93e5e9-caa5-4767-bd42-51e57510e4f3\") " pod="openshift-ingress-canary/ingress-canary-xxm9n" Jul 01 17:48:14.953219 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.953199 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qq72d"] Jul 01 17:48:14.975070 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.975050 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qq72d"] Jul 01 17:48:14.975165 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.975150 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:14.978879 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.978861 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hwprk\"" Jul 01 17:48:14.979835 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.979808 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 17:48:14.980050 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:14.980036 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 17:48:15.000749 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.000731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-metrics-tls\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.000832 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.000756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbhg4\" (UniqueName: \"kubernetes.io/projected/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-kube-api-access-rbhg4\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.000832 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.000774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf01d151-3bde-4729-ac33-cad72a028d08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.000832 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.000790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48s7h\" (UniqueName: \"kubernetes.io/projected/ad93e5e9-caa5-4767-bd42-51e57510e4f3-kube-api-access-48s7h\") pod \"ingress-canary-xxm9n\" (UID: \"ad93e5e9-caa5-4767-bd42-51e57510e4f3\") " pod="openshift-ingress-canary/ingress-canary-xxm9n" Jul 01 17:48:15.000943 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.000834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-tmp-dir\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.000943 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.000906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf01d151-3bde-4729-ac33-cad72a028d08-crio-socket\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.000943 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.000937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqrbv\" (UniqueName: \"kubernetes.io/projected/cf01d151-3bde-4729-ac33-cad72a028d08-kube-api-access-qqrbv\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.001108 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.000952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad93e5e9-caa5-4767-bd42-51e57510e4f3-cert\") pod \"ingress-canary-xxm9n\" (UID: \"ad93e5e9-caa5-4767-bd42-51e57510e4f3\") " pod="openshift-ingress-canary/ingress-canary-xxm9n" Jul 01 17:48:15.001108 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.001061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf01d151-3bde-4729-ac33-cad72a028d08-data-volume\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.001223 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.001108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf01d151-3bde-4729-ac33-cad72a028d08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.001223 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.001077 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf01d151-3bde-4729-ac33-cad72a028d08-crio-socket\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.001223 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.001139 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-config-volume\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.001376 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.001356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf01d151-3bde-4729-ac33-cad72a028d08-data-volume\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.001418 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.001391 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf01d151-3bde-4729-ac33-cad72a028d08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.004617 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.004592 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf01d151-3bde-4729-ac33-cad72a028d08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.004794 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.004777 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad93e5e9-caa5-4767-bd42-51e57510e4f3-cert\") pod \"ingress-canary-xxm9n\" (UID: \"ad93e5e9-caa5-4767-bd42-51e57510e4f3\") " pod="openshift-ingress-canary/ingress-canary-xxm9n" Jul 01 17:48:15.017740 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.017690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqrbv\" (UniqueName: \"kubernetes.io/projected/cf01d151-3bde-4729-ac33-cad72a028d08-kube-api-access-qqrbv\") pod \"insights-runtime-extractor-wfrvq\" (UID: \"cf01d151-3bde-4729-ac33-cad72a028d08\") " pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.018631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.018612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48s7h\" (UniqueName: \"kubernetes.io/projected/ad93e5e9-caa5-4767-bd42-51e57510e4f3-kube-api-access-48s7h\") pod \"ingress-canary-xxm9n\" (UID: \"ad93e5e9-caa5-4767-bd42-51e57510e4f3\") " pod="openshift-ingress-canary/ingress-canary-xxm9n" Jul 01 17:48:15.046514 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.046489 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh"] Jul 01 17:48:15.077602 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.077583 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh"] Jul 01 17:48:15.077689 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.077593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" Jul 01 17:48:15.080435 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.080418 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 17:48:15.080514 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.080449 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-q7sjd\"" Jul 01 17:48:15.101928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.101906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4cdddd34-629b-4064-81d4-a25552ed01c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-9mjhh\" (UID: \"4cdddd34-629b-4064-81d4-a25552ed01c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" Jul 01 17:48:15.102007 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.101966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-config-volume\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.102042 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.102020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-metrics-tls\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.102075 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.102042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbhg4\" (UniqueName: \"kubernetes.io/projected/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-kube-api-access-rbhg4\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.102075 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.102069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-tmp-dir\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.102351 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.102336 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-tmp-dir\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.102496 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.102478 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-config-volume\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.103911 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.103896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-metrics-tls\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.113569 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.113551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbhg4\" (UniqueName: \"kubernetes.io/projected/02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9-kube-api-access-rbhg4\") pod \"dns-default-qq72d\" (UID: \"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9\") " pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.174847 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.174826 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xxm9n" Jul 01 17:48:15.184140 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.184121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfrvq" Jul 01 17:48:15.203001 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.202849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4cdddd34-629b-4064-81d4-a25552ed01c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-9mjhh\" (UID: \"4cdddd34-629b-4064-81d4-a25552ed01c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" Jul 01 17:48:15.205176 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.205159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4cdddd34-629b-4064-81d4-a25552ed01c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-9mjhh\" (UID: \"4cdddd34-629b-4064-81d4-a25552ed01c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" Jul 01 17:48:15.283944 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.283703 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:15.377176 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.377149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:15.380458 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.380439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:48:15.385427 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.385404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" Jul 01 17:48:15.395175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.395152 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfrvq"] Jul 01 17:48:15.397854 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.397831 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xxm9n"] Jul 01 17:48:15.399765 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:15.399722 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf01d151_3bde_4729_ac33_cad72a028d08.slice/crio-7631d9df8f72e76023179b5a6fdb962f06d04a7498ddc849e45eb48f132a0c7c WatchSource:0}: Error finding container 7631d9df8f72e76023179b5a6fdb962f06d04a7498ddc849e45eb48f132a0c7c: Status 404 returned error can't find the container with id 7631d9df8f72e76023179b5a6fdb962f06d04a7498ddc849e45eb48f132a0c7c Jul 01 17:48:15.401013 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:15.400994 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad93e5e9_caa5_4767_bd42_51e57510e4f3.slice/crio-4e232f8ea7aa84b5a701de2c7ca13ea5ed892c31fc3fc80a9281418a9cacc2b0 WatchSource:0}: Error finding container 4e232f8ea7aa84b5a701de2c7ca13ea5ed892c31fc3fc80a9281418a9cacc2b0: Status 404 returned error can't find the container with id 4e232f8ea7aa84b5a701de2c7ca13ea5ed892c31fc3fc80a9281418a9cacc2b0 Jul 01 17:48:15.445572 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.445541 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qq72d"] Jul 01 17:48:15.530253 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.530222 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh"] Jul 01 17:48:15.534605 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:15.534580 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdddd34_629b_4064_81d4_a25552ed01c8.slice/crio-08983837e459a00c7fe3007ca675722ac8ec4fc469b4b40fdb3a3f41b28054df WatchSource:0}: Error finding container 08983837e459a00c7fe3007ca675722ac8ec4fc469b4b40fdb3a3f41b28054df: Status 404 returned error can't find the container with id 08983837e459a00c7fe3007ca675722ac8ec4fc469b4b40fdb3a3f41b28054df Jul 01 17:48:15.569812 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.569786 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xxm9n" event={"ID":"ad93e5e9-caa5-4767-bd42-51e57510e4f3","Type":"ContainerStarted","Data":"4e232f8ea7aa84b5a701de2c7ca13ea5ed892c31fc3fc80a9281418a9cacc2b0"} Jul 01 17:48:15.570865 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.570837 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" event={"ID":"4cdddd34-629b-4064-81d4-a25552ed01c8","Type":"ContainerStarted","Data":"08983837e459a00c7fe3007ca675722ac8ec4fc469b4b40fdb3a3f41b28054df"} Jul 01 17:48:15.571843 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.571820 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq72d" event={"ID":"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9","Type":"ContainerStarted","Data":"d6ad921439e7605ced5d762c297a94f8d918f0a95887e92c10f7ea721913a3ea"} Jul 01 17:48:15.572776 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:15.572758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfrvq" event={"ID":"cf01d151-3bde-4729-ac33-cad72a028d08","Type":"ContainerStarted","Data":"7631d9df8f72e76023179b5a6fdb962f06d04a7498ddc849e45eb48f132a0c7c"} Jul 01 17:48:16.378476 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:16.377824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:16.378476 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:16.378071 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:16.383074 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:16.382876 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c954b\"" Jul 01 17:48:16.385212 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:16.383814 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:48:16.385212 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:16.384127 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:48:16.385212 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:16.384343 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:48:16.385212 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:16.385042 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b2flm\"" Jul 01 17:48:20.588023 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.587988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfrvq" event={"ID":"cf01d151-3bde-4729-ac33-cad72a028d08","Type":"ContainerStarted","Data":"76d888d610133c1a2ef5d87d2c5e5191486754462f23580d1a415a2d1685b7f8"} Jul 01 17:48:20.589577 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.589549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" event={"ID":"4cdddd34-629b-4064-81d4-a25552ed01c8","Type":"ContainerStarted","Data":"517ef506b61142c84e272d8d95291914a6cda4bca3bd7b56a1608eff8c95259b"} Jul 01 17:48:20.589761 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.589743 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" Jul 01 17:48:20.591419 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.591392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq72d" event={"ID":"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9","Type":"ContainerStarted","Data":"666fa3d492ad971da290b24bfb9429b6491375eaa1554bc71ab2a66fc02e342d"} Jul 01 17:48:20.591539 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.591444 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq72d" event={"ID":"02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9","Type":"ContainerStarted","Data":"0774f9ae5c06250c72a4b3e3e08d03ba3cde64d8d9de9f1373bad6ef666a45dd"} Jul 01 17:48:20.591602 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.591592 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:20.595388 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.595365 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" Jul 01 17:48:20.621197 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.621151 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-9mjhh" podStartSLOduration=1.329455773 podStartE2EDuration="5.621136559s" totalImagesPullingTime="4.291680786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:20.620966887 +0000 UTC m=+58.685003061" watchObservedRunningTime="2026-07-01 17:48:20.621136559 +0000 UTC m=+58.685172731" Jul 01 17:48:20.718476 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:20.718425 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qq72d" podStartSLOduration=2.335748407 podStartE2EDuration="6.718405455s" totalImagesPullingTime="4.382657048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:20.716760034 +0000 UTC m=+58.780796207" watchObservedRunningTime="2026-07-01 17:48:20.718405455 +0000 UTC m=+58.782441629" Jul 01 17:48:21.222937 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.222906 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-6hpck"] Jul 01 17:48:21.225697 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.225678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.231442 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.231420 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pb6qp\"" Jul 01 17:48:21.231593 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.231478 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 17:48:21.231838 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.231813 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 17:48:21.231838 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.231825 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 17:48:21.232238 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.232035 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 17:48:21.232238 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.232074 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 17:48:21.251636 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.251612 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-6hpck"] Jul 01 17:48:21.299831 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.299802 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66bdc76dd4-vqv5h"] Jul 01 17:48:21.301905 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.301875 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.309831 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.309411 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 17:48:21.309831 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.309426 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 17:48:21.309831 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.309684 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 17:48:21.309831 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.309705 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 17:48:21.310868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.310846 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d4smv\"" Jul 01 17:48:21.310868 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.310856 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 17:48:21.311501 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.311476 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 17:48:21.312600 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.312584 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 17:48:21.325505 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.325486 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 17:48:21.345090 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.345060 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bdc76dd4-vqv5h"] Jul 01 17:48:21.350422 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-console-config\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.350520 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350434 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-trusted-ca-bundle\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.350520 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350463 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.350648 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-oauth-serving-cert\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.350648 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5n7v\" (UniqueName: \"kubernetes.io/projected/b1397dc3-b66f-4655-826f-106c870303b9-kube-api-access-h5n7v\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.350648 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-service-ca\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.350648 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkzd\" (UniqueName: \"kubernetes.io/projected/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-kube-api-access-chkzd\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.350848 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-serving-cert\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.350848 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-oauth-config\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.350848 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.350848 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.350752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.451843 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.451814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-oauth-serving-cert\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.451843 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.451845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5n7v\" (UniqueName: \"kubernetes.io/projected/b1397dc3-b66f-4655-826f-106c870303b9-kube-api-access-h5n7v\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.452039 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.451870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-service-ca\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.452039 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.451887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chkzd\" (UniqueName: \"kubernetes.io/projected/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-kube-api-access-chkzd\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.452139 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-serving-cert\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.452245 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-oauth-config\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.452336 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.452336 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.452453 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-console-config\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.452453 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-trusted-ca-bundle\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.452453 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.453075 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452688 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-service-ca\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.453075 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.452737 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-oauth-serving-cert\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.453375 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.453356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-console-config\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.453604 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.453555 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.453958 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.453932 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-trusted-ca-bundle\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.456298 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.456266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-oauth-config\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.456429 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.456406 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-serving-cert\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.456529 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.456406 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.456645 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.456626 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.465188 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.465170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5n7v\" (UniqueName: \"kubernetes.io/projected/b1397dc3-b66f-4655-826f-106c870303b9-kube-api-access-h5n7v\") pod \"console-66bdc76dd4-vqv5h\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.466026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.466003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkzd\" (UniqueName: \"kubernetes.io/projected/9379bfbb-ea6b-4dbe-8e9c-52e9062481b0-kube-api-access-chkzd\") pod \"prometheus-operator-7b7d896497-6hpck\" (UID: \"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.536039 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.536014 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" Jul 01 17:48:21.596616 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.596580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfrvq" event={"ID":"cf01d151-3bde-4729-ac33-cad72a028d08","Type":"ContainerStarted","Data":"c9717ff5b9b3dfec5f1e755a8453f542e4ceaf4ff072b31dfc4c0419c03f6027"} Jul 01 17:48:21.613221 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.613198 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:21.820673 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.820589 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bdc76dd4-vqv5h"] Jul 01 17:48:21.825878 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:21.825850 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1397dc3_b66f_4655_826f_106c870303b9.slice/crio-5d9d8fbc404540464bc4071b06c99465f0b37e6844127379d6eef62f7e9c2e99 WatchSource:0}: Error finding container 5d9d8fbc404540464bc4071b06c99465f0b37e6844127379d6eef62f7e9c2e99: Status 404 returned error can't find the container with id 5d9d8fbc404540464bc4071b06c99465f0b37e6844127379d6eef62f7e9c2e99 Jul 01 17:48:21.843738 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:21.843715 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-6hpck"] Jul 01 17:48:21.847148 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:21.847123 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9379bfbb_ea6b_4dbe_8e9c_52e9062481b0.slice/crio-b83bf3cba5ff01ac44e394461b26dbeea0c9bc9ed5657bed8f460b8e7d6e5297 WatchSource:0}: Error finding container b83bf3cba5ff01ac44e394461b26dbeea0c9bc9ed5657bed8f460b8e7d6e5297: Status 404 returned error can't find the container with id b83bf3cba5ff01ac44e394461b26dbeea0c9bc9ed5657bed8f460b8e7d6e5297 Jul 01 17:48:22.601789 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:22.601743 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" event={"ID":"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0","Type":"ContainerStarted","Data":"b83bf3cba5ff01ac44e394461b26dbeea0c9bc9ed5657bed8f460b8e7d6e5297"} Jul 01 17:48:22.604537 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:22.604263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xxm9n" event={"ID":"ad93e5e9-caa5-4767-bd42-51e57510e4f3","Type":"ContainerStarted","Data":"9c607cade1b2e7ade1bc98054ee80a4bd4c6ad7c490c817c8ad28e073cb68816"} Jul 01 17:48:22.606156 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:22.606123 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bdc76dd4-vqv5h" event={"ID":"b1397dc3-b66f-4655-826f-106c870303b9","Type":"ContainerStarted","Data":"5d9d8fbc404540464bc4071b06c99465f0b37e6844127379d6eef62f7e9c2e99"} Jul 01 17:48:22.658233 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:22.658172 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xxm9n" podStartSLOduration=2.358092406 podStartE2EDuration="8.65815466s" totalImagesPullingTime="6.300062254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:22.657268048 +0000 UTC m=+60.721304252" watchObservedRunningTime="2026-07-01 17:48:22.65815466 +0000 UTC m=+60.722190832" Jul 01 17:48:23.611979 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:23.611907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" event={"ID":"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0","Type":"ContainerStarted","Data":"9e422f627f619bde890e99287cebae34d694f24b96ced488d5ddd6b32fc057bc"} Jul 01 17:48:24.529861 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:24.529831 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdxnd" Jul 01 17:48:24.617492 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:24.617448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" event={"ID":"9379bfbb-ea6b-4dbe-8e9c-52e9062481b0","Type":"ContainerStarted","Data":"d5422adc518b2095d01863e02a6e67a6b6ba49af017f3a2715d139f1f06b8c03"} Jul 01 17:48:24.654360 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:24.654295 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-6hpck" podStartSLOduration=2.058364223 podStartE2EDuration="3.654278801s" totalImagesPullingTime="1.595914578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:24.653410421 +0000 UTC m=+62.717446596" watchObservedRunningTime="2026-07-01 17:48:24.654278801 +0000 UTC m=+62.718314973" Jul 01 17:48:26.625303 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:26.625268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfrvq" event={"ID":"cf01d151-3bde-4729-ac33-cad72a028d08","Type":"ContainerStarted","Data":"e036ea57bd054946b7fa56b58e26735085e293d3aeaa87b61d937f118efda9de"} Jul 01 17:48:26.626792 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:26.626768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bdc76dd4-vqv5h" event={"ID":"b1397dc3-b66f-4655-826f-106c870303b9","Type":"ContainerStarted","Data":"9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43"} Jul 01 17:48:26.699425 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:26.699385 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wfrvq" podStartSLOduration=2.098775384 podStartE2EDuration="12.699373887s" totalImagesPullingTime="10.600598503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:48:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:26.699145629 +0000 UTC m=+64.763181824" watchObservedRunningTime="2026-07-01 17:48:26.699373887 +0000 UTC m=+64.763410060" Jul 01 17:48:26.785484 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:26.785447 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66bdc76dd4-vqv5h" podStartSLOduration=1.456123155 podStartE2EDuration="5.785434359s" totalImagesPullingTime="4.329311204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:26.783478494 +0000 UTC m=+64.847514690" watchObservedRunningTime="2026-07-01 17:48:26.785434359 +0000 UTC m=+64.849470532" Jul 01 17:48:27.518608 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.518571 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47"] Jul 01 17:48:27.520933 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.520910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.524502 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:27.524474 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"openshift-state-metrics-57f99c8b49-qqb47\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="7bcd944e-87b0-45c6-aff6-0a49fe114f25" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.524588 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:27.524503 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-state-metrics-dockercfg-mztph\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mztph\"" type="*v1.Secret" Jul 01 17:48:27.525515 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.525499 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 17:48:27.527413 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.527387 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 17:48:27.575715 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.575693 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-68f7f"] Jul 01 17:48:27.577692 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.577636 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47"] Jul 01 17:48:27.577780 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.577729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.587596 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.587577 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-pwn87"] Jul 01 17:48:27.589538 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.589525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.601227 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.601207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bcd944e-87b0-45c6-aff6-0a49fe114f25-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.601342 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.601272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bcd944e-87b0-45c6-aff6-0a49fe114f25-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.601414 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.601345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bcd944e-87b0-45c6-aff6-0a49fe114f25-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.601414 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.601387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tpx5\" (UniqueName: \"kubernetes.io/projected/7bcd944e-87b0-45c6-aff6-0a49fe114f25-kube-api-access-9tpx5\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.620186 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.620168 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 17:48:27.620290 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.620272 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5nzfb\"" Jul 01 17:48:27.621463 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.621438 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 17:48:27.621536 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.621459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 17:48:27.621536 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.621517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 17:48:27.621631 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.621574 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 17:48:27.621677 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.621652 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k5bd7\"" Jul 01 17:48:27.621822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.621807 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 17:48:27.660382 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.660362 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-pwn87"] Jul 01 17:48:27.702155 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702126 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-accelerators-collector-config\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.702272 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bcd944e-87b0-45c6-aff6-0a49fe114f25-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.702272 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-wtmp\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.702272 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.702272 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-textfile\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.702553 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tpx5\" (UniqueName: \"kubernetes.io/projected/7bcd944e-87b0-45c6-aff6-0a49fe114f25-kube-api-access-9tpx5\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.702674 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-tls\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.702674 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-root\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.702674 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bcd944e-87b0-45c6-aff6-0a49fe114f25-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.702824 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.702824 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fzlh\" (UniqueName: \"kubernetes.io/projected/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-api-access-7fzlh\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.702934 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.702934 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-metrics-client-ca\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.702934 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-sys\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.703063 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.702955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.703063 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.703016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bcd944e-87b0-45c6-aff6-0a49fe114f25-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.703169 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.703145 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.703219 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.703190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb01fd8-737b-4955-8687-24000a9d7ef2-metrics-client-ca\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.703270 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.703222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j927\" (UniqueName: \"kubernetes.io/projected/bdb01fd8-737b-4955-8687-24000a9d7ef2-kube-api-access-9j927\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.703393 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.703367 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bcd944e-87b0-45c6-aff6-0a49fe114f25-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.704567 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.704547 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bcd944e-87b0-45c6-aff6-0a49fe114f25-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.705206 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.705190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7bcd944e-87b0-45c6-aff6-0a49fe114f25-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.731303 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.731276 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tpx5\" (UniqueName: \"kubernetes.io/projected/7bcd944e-87b0-45c6-aff6-0a49fe114f25-kube-api-access-9tpx5\") pod \"openshift-state-metrics-57f99c8b49-qqb47\" (UID: \"7bcd944e-87b0-45c6-aff6-0a49fe114f25\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:27.804509 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-accelerators-collector-config\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804509 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-wtmp\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804638 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.804638 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-textfile\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804638 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-tls\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804786 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-wtmp\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804786 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-root\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804786 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804786 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fzlh\" (UniqueName: \"kubernetes.io/projected/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-api-access-7fzlh\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.804965 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.804965 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804801 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-root\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804965 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-metrics-client-ca\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.804965 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-sys\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804965 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.804965 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-textfile\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.804965 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.805335 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.804981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb01fd8-737b-4955-8687-24000a9d7ef2-metrics-client-ca\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.805335 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.805005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j927\" (UniqueName: \"kubernetes.io/projected/bdb01fd8-737b-4955-8687-24000a9d7ef2-kube-api-access-9j927\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.805335 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.805030 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-accelerators-collector-config\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.805335 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.805202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdb01fd8-737b-4955-8687-24000a9d7ef2-sys\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.805335 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.805291 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.805639 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.805536 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.805639 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.805537 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-metrics-client-ca\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.805813 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.805787 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb01fd8-737b-4955-8687-24000a9d7ef2-metrics-client-ca\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.806799 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.806779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-tls\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.807154 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.807137 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.807196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.807165 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb01fd8-737b-4955-8687-24000a9d7ef2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.807666 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.807650 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.826061 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.826030 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j927\" (UniqueName: \"kubernetes.io/projected/bdb01fd8-737b-4955-8687-24000a9d7ef2-kube-api-access-9j927\") pod \"node-exporter-68f7f\" (UID: \"bdb01fd8-737b-4955-8687-24000a9d7ef2\") " pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.826872 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.826856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fzlh\" (UniqueName: \"kubernetes.io/projected/16f8d71d-947c-45b7-bbfb-9b38fcf8cc34-kube-api-access-7fzlh\") pod \"kube-state-metrics-845b954455-pwn87\" (UID: \"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:27.885682 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.885662 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-68f7f" Jul 01 17:48:27.895670 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:27.895644 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb01fd8_737b_4955_8687_24000a9d7ef2.slice/crio-d3604c338b25ca13beaee8da0ddb08369d1cc777d76a05ccd87d6d4d1550f0d9 WatchSource:0}: Error finding container d3604c338b25ca13beaee8da0ddb08369d1cc777d76a05ccd87d6d4d1550f0d9: Status 404 returned error can't find the container with id d3604c338b25ca13beaee8da0ddb08369d1cc777d76a05ccd87d6d4d1550f0d9 Jul 01 17:48:27.896398 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:27.896383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" Jul 01 17:48:28.044351 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.044303 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-pwn87"] Jul 01 17:48:28.047921 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:28.047891 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f8d71d_947c_45b7_bbfb_9b38fcf8cc34.slice/crio-c8aae260d5c104d549e9786da9ce7626678ca4fcdea56b79cd1ee808f4669fac WatchSource:0}: Error finding container c8aae260d5c104d549e9786da9ce7626678ca4fcdea56b79cd1ee808f4669fac: Status 404 returned error can't find the container with id c8aae260d5c104d549e9786da9ce7626678ca4fcdea56b79cd1ee808f4669fac Jul 01 17:48:28.107208 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.107158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:28.113105 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.113089 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:48:28.119746 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.119721 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e-metrics-certs\") pod \"network-metrics-daemon-v7sf7\" (UID: \"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e\") " pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:28.208449 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.208425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:28.214431 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.214414 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:48:28.221190 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.221174 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ca0dc4-4f82-4ed1-bc82-396932e508f0-original-pull-secret\") pod \"global-pull-secret-syncer-ww66v\" (UID: \"d5ca0dc4-4f82-4ed1-bc82-396932e508f0\") " pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:28.287371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.287348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww66v" Jul 01 17:48:28.309345 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.309304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:28.312488 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.312468 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:48:28.327570 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.327553 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:48:28.333554 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.333532 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttjhq\" (UniqueName: \"kubernetes.io/projected/609f9bd1-c21c-4896-8d49-9dc004c0085b-kube-api-access-ttjhq\") pod \"network-check-target-tp4vq\" (UID: \"609f9bd1-c21c-4896-8d49-9dc004c0085b\") " pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:28.420695 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.420672 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c954b\"" Jul 01 17:48:28.420884 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.420866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b2flm\"" Jul 01 17:48:28.423957 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.423944 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:28.425135 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.425105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7sf7" Jul 01 17:48:28.486402 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.485229 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ww66v"] Jul 01 17:48:28.490404 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:28.490337 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ca0dc4_4f82_4ed1_bc82_396932e508f0.slice/crio-fff75201ac43b0805f3a855acf98f4d4e4c68916e59f2a9ff090344495c75f78 WatchSource:0}: Error finding container fff75201ac43b0805f3a855acf98f4d4e4c68916e59f2a9ff090344495c75f78: Status 404 returned error can't find the container with id fff75201ac43b0805f3a855acf98f4d4e4c68916e59f2a9ff090344495c75f78 Jul 01 17:48:28.598600 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.598577 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tp4vq"] Jul 01 17:48:28.600892 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:28.600864 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609f9bd1_c21c_4896_8d49_9dc004c0085b.slice/crio-2b13e1e9d396de17485483037d125fcc820b9ea625edf7b4c30c6536e8a328d0 WatchSource:0}: Error finding container 2b13e1e9d396de17485483037d125fcc820b9ea625edf7b4c30c6536e8a328d0: Status 404 returned error can't find the container with id 2b13e1e9d396de17485483037d125fcc820b9ea625edf7b4c30c6536e8a328d0 Jul 01 17:48:28.621911 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.621858 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7sf7"] Jul 01 17:48:28.624779 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:28.624743 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12eca6e8_6fb7_49e2_b94b_ae8f5818ae9e.slice/crio-f1debb2efd04c110db4a8555289769dc49130040930ec8ca038493b921b14b2c WatchSource:0}: Error finding container f1debb2efd04c110db4a8555289769dc49130040930ec8ca038493b921b14b2c: Status 404 returned error can't find the container with id f1debb2efd04c110db4a8555289769dc49130040930ec8ca038493b921b14b2c Jul 01 17:48:28.634454 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.634422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ww66v" event={"ID":"d5ca0dc4-4f82-4ed1-bc82-396932e508f0","Type":"ContainerStarted","Data":"fff75201ac43b0805f3a855acf98f4d4e4c68916e59f2a9ff090344495c75f78"} Jul 01 17:48:28.635487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.635444 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tp4vq" event={"ID":"609f9bd1-c21c-4896-8d49-9dc004c0085b","Type":"ContainerStarted","Data":"2b13e1e9d396de17485483037d125fcc820b9ea625edf7b4c30c6536e8a328d0"} Jul 01 17:48:28.636597 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.636576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-68f7f" event={"ID":"bdb01fd8-737b-4955-8687-24000a9d7ef2","Type":"ContainerStarted","Data":"d3604c338b25ca13beaee8da0ddb08369d1cc777d76a05ccd87d6d4d1550f0d9"} Jul 01 17:48:28.637795 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.637767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" event={"ID":"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34","Type":"ContainerStarted","Data":"c8aae260d5c104d549e9786da9ce7626678ca4fcdea56b79cd1ee808f4669fac"} Jul 01 17:48:28.638919 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.638897 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7sf7" event={"ID":"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e","Type":"ContainerStarted","Data":"f1debb2efd04c110db4a8555289769dc49130040930ec8ca038493b921b14b2c"} Jul 01 17:48:28.647534 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.647516 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:48:28.650624 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.650609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.659923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.659896 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 17:48:28.659923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.659906 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 17:48:28.660117 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.659906 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 17:48:28.660117 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.659989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 17:48:28.660117 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.660002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 17:48:28.660117 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.660059 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 17:48:28.660380 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.660346 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xpbgw\"" Jul 01 17:48:28.664969 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.664954 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 17:48:28.669388 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.669374 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 17:48:28.669457 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.669440 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 17:48:28.712740 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.712559 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:48:28.713334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqblq\" (UniqueName: \"kubernetes.io/projected/80686061-9e4e-420d-b30d-99e600516c02-kube-api-access-rqblq\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80686061-9e4e-420d-b30d-99e600516c02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80686061-9e4e-420d-b30d-99e600516c02-config-out\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-web-config\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80686061-9e4e-420d-b30d-99e600516c02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-config-volume\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713807 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713807 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713807 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80686061-9e4e-420d-b30d-99e600516c02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713807 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80686061-9e4e-420d-b30d-99e600516c02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.713807 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.713573 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.814560 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.814530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80686061-9e4e-420d-b30d-99e600516c02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.814676 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.814572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80686061-9e4e-420d-b30d-99e600516c02-config-out\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.814676 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.814600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-web-config\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.814676 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.814624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80686061-9e4e-420d-b30d-99e600516c02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.814676 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.814654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.814677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-config-volume\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.814955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80686061-9e4e-420d-b30d-99e600516c02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.815016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.815049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.815085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.815122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80686061-9e4e-420d-b30d-99e600516c02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.815149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80686061-9e4e-420d-b30d-99e600516c02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.815202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815660 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.815260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqblq\" (UniqueName: \"kubernetes.io/projected/80686061-9e4e-420d-b30d-99e600516c02-kube-api-access-rqblq\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.815660 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.815615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80686061-9e4e-420d-b30d-99e600516c02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.816588 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.816559 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80686061-9e4e-420d-b30d-99e600516c02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.817723 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.817700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-config-volume\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.818221 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.818172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.818221 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.818182 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.818456 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.818411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.818566 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.818457 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80686061-9e4e-420d-b30d-99e600516c02-config-out\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.818704 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.818681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80686061-9e4e-420d-b30d-99e600516c02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.818810 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.818795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-web-config\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.818872 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.818851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.819833 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.819812 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80686061-9e4e-420d-b30d-99e600516c02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.830089 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.830064 2564 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jul 01 17:48:28.830186 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.830138 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" Jul 01 17:48:28.832067 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.832047 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqblq\" (UniqueName: \"kubernetes.io/projected/80686061-9e4e-420d-b30d-99e600516c02-kube-api-access-rqblq\") pod \"alertmanager-main-0\" (UID: \"80686061-9e4e-420d-b30d-99e600516c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.959764 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.959736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:48:28.975236 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:28.975213 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47"] Jul 01 17:48:28.977338 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:28.977294 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bcd944e_87b0_45c6_aff6_0a49fe114f25.slice/crio-3146689468ea85a6026b522830513b7b9ae8fec8d73102084fb295a7b1bb3fa7 WatchSource:0}: Error finding container 3146689468ea85a6026b522830513b7b9ae8fec8d73102084fb295a7b1bb3fa7: Status 404 returned error can't find the container with id 3146689468ea85a6026b522830513b7b9ae8fec8d73102084fb295a7b1bb3fa7 Jul 01 17:48:29.074879 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:29.074675 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mztph\"" Jul 01 17:48:29.134123 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:29.134044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:48:29.137614 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:29.137582 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80686061_9e4e_420d_b30d_99e600516c02.slice/crio-11301f740a2e503356c8651fe9c888dea3564a00ebcf402e4bb94d05311031a6 WatchSource:0}: Error finding container 11301f740a2e503356c8651fe9c888dea3564a00ebcf402e4bb94d05311031a6: Status 404 returned error can't find the container with id 11301f740a2e503356c8651fe9c888dea3564a00ebcf402e4bb94d05311031a6 Jul 01 17:48:29.646599 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:29.646475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80686061-9e4e-420d-b30d-99e600516c02","Type":"ContainerStarted","Data":"11301f740a2e503356c8651fe9c888dea3564a00ebcf402e4bb94d05311031a6"} Jul 01 17:48:29.648925 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:29.648787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" event={"ID":"7bcd944e-87b0-45c6-aff6-0a49fe114f25","Type":"ContainerStarted","Data":"3899dd2e57ebc5a0b9ef327f26254513e0e885e0a63759d25a63e0f936814556"} Jul 01 17:48:29.648925 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:29.648853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" event={"ID":"7bcd944e-87b0-45c6-aff6-0a49fe114f25","Type":"ContainerStarted","Data":"9fe4d3cf1bf21ecb081b3e79d55de00318fd7db19313791bd894d862fdd67dd0"} Jul 01 17:48:29.648925 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:29.648884 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" event={"ID":"7bcd944e-87b0-45c6-aff6-0a49fe114f25","Type":"ContainerStarted","Data":"3146689468ea85a6026b522830513b7b9ae8fec8d73102084fb295a7b1bb3fa7"} Jul 01 17:48:30.598570 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:30.598541 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qq72d" Jul 01 17:48:30.655678 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:30.655645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7sf7" event={"ID":"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e","Type":"ContainerStarted","Data":"a43737ab1a5842d5a4f3b688d391f36f214895a1eeeb3638847e5077d4a139e2"} Jul 01 17:48:30.655836 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:30.655704 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7sf7" event={"ID":"12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e","Type":"ContainerStarted","Data":"4b794fcc8ba1ca80c32f356ed07e8b09bf366e76ff1463d0e2d39a0ec30a97f0"} Jul 01 17:48:30.657927 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:30.657895 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" event={"ID":"7bcd944e-87b0-45c6-aff6-0a49fe114f25","Type":"ContainerStarted","Data":"9dd891e3f66ab4f6146462d07860ee6129a57297a078d6faba25eaa752def839"} Jul 01 17:48:30.814964 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:30.814913 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-qqb47" podStartSLOduration=2.749254493 podStartE2EDuration="3.814892286s" totalImagesPullingTime="1.065637793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:30.812402852 +0000 UTC m=+68.876439026" watchObservedRunningTime="2026-07-01 17:48:30.814892286 +0000 UTC m=+68.878928461" Jul 01 17:48:30.815959 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:30.815920 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v7sf7" podStartSLOduration=66.64309772 podStartE2EDuration="1m7.815908235s" totalImagesPullingTime="1.172810515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:30.716486585 +0000 UTC m=+68.780522759" watchObservedRunningTime="2026-07-01 17:48:30.815908235 +0000 UTC m=+68.879944428" Jul 01 17:48:31.438928 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.438894 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5547bcdb64-d28vg"] Jul 01 17:48:31.466687 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.466656 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.474375 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.474340 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 17:48:31.474639 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.474624 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 17:48:31.474798 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.474783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 17:48:31.474848 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.474792 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5547bcdb64-d28vg"] Jul 01 17:48:31.475017 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.474989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 17:48:31.475132 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.475091 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 17:48:31.475196 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.475091 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-595mg\"" Jul 01 17:48:31.477041 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.476836 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8tqitbkosp8ij\"" Jul 01 17:48:31.539840 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.539799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4sx\" (UniqueName: \"kubernetes.io/projected/b4202fe3-d19d-424a-a0cb-62a4858ed33d-kube-api-access-ff4sx\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.540005 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.539900 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-tls\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.540005 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.539962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.540130 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.540013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.540130 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.540041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.540130 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.540067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.540130 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.540109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-grpc-tls\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.541934 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.540186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4202fe3-d19d-424a-a0cb-62a4858ed33d-metrics-client-ca\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.580424 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.580389 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-66qrf"] Jul 01 17:48:31.595168 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.595139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:31.599360 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.599336 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 17:48:31.599713 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.599523 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6l84w\"" Jul 01 17:48:31.609280 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.609257 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-66qrf"] Jul 01 17:48:31.613494 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.613456 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:31.613601 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.613503 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:31.615039 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.615014 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-679b84f984-9x9l5"] Jul 01 17:48:31.635065 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.635037 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:31.635181 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.635143 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.639268 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.639243 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679b84f984-9x9l5"] Jul 01 17:48:31.640777 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.640755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-tls\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.640894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.640787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.640894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.640812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.640894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.640828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.640894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.640849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.640894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.640874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-grpc-tls\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.641147 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.640912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4202fe3-d19d-424a-a0cb-62a4858ed33d-metrics-client-ca\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.641147 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.640941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4sx\" (UniqueName: \"kubernetes.io/projected/b4202fe3-d19d-424a-a0cb-62a4858ed33d-kube-api-access-ff4sx\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.641909 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.641812 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4202fe3-d19d-424a-a0cb-62a4858ed33d-metrics-client-ca\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.643831 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.643810 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-tls\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.645609 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.645235 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-grpc-tls\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.645609 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.645565 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.646658 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.646623 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.646759 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.646708 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.647346 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.647301 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4202fe3-d19d-424a-a0cb-62a4858ed33d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.657323 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.657287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4sx\" (UniqueName: \"kubernetes.io/projected/b4202fe3-d19d-424a-a0cb-62a4858ed33d-kube-api-access-ff4sx\") pod \"thanos-querier-5547bcdb64-d28vg\" (UID: \"b4202fe3-d19d-424a-a0cb-62a4858ed33d\") " pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.667447 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.667424 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:48:31.742079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwdjd\" (UniqueName: \"kubernetes.io/projected/f4c85bc3-e547-46c4-8987-549f9adaf8d2-kube-api-access-dwdjd\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.742229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcngc\" (UniqueName: \"kubernetes.io/projected/2a41f888-5095-4905-ae99-a09736bf5ad8-kube-api-access-qcngc\") pod \"monitoring-plugin-cd8656b8-66qrf\" (UID: \"2a41f888-5095-4905-ae99-a09736bf5ad8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:31.742289 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-serving-cert\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.742368 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-config\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.742423 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-service-ca\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.742543 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-oauth-serving-cert\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.742543 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-oauth-config\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.742543 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a41f888-5095-4905-ae99-a09736bf5ad8-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-66qrf\" (UID: \"2a41f888-5095-4905-ae99-a09736bf5ad8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:31.742697 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.742649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-trusted-ca-bundle\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.785039 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.785012 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:31.843108 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-trusted-ca-bundle\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.843227 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwdjd\" (UniqueName: \"kubernetes.io/projected/f4c85bc3-e547-46c4-8987-549f9adaf8d2-kube-api-access-dwdjd\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.843227 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcngc\" (UniqueName: \"kubernetes.io/projected/2a41f888-5095-4905-ae99-a09736bf5ad8-kube-api-access-qcngc\") pod \"monitoring-plugin-cd8656b8-66qrf\" (UID: \"2a41f888-5095-4905-ae99-a09736bf5ad8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:31.843369 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-serving-cert\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.843369 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-config\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.843369 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-service-ca\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.843369 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-oauth-serving-cert\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.843369 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-oauth-config\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.843625 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843399 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a41f888-5095-4905-ae99-a09736bf5ad8-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-66qrf\" (UID: \"2a41f888-5095-4905-ae99-a09736bf5ad8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:31.843625 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:31.843507 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 01 17:48:31.843625 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:48:31.843565 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a41f888-5095-4905-ae99-a09736bf5ad8-monitoring-plugin-cert podName:2a41f888-5095-4905-ae99-a09736bf5ad8 nodeName:}" failed. No retries permitted until 2026-07-01 17:48:32.343544668 +0000 UTC m=+70.407580840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2a41f888-5095-4905-ae99-a09736bf5ad8-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-66qrf" (UID: "2a41f888-5095-4905-ae99-a09736bf5ad8") : secret "monitoring-plugin-cert" not found Jul 01 17:48:31.844012 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.843985 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-config\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.844012 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.844006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-service-ca\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.844229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.844106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-oauth-serving-cert\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.844684 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.844635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-trusted-ca-bundle\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.845849 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.845825 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-oauth-config\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.846077 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.846058 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-serving-cert\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.858190 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.858170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcngc\" (UniqueName: \"kubernetes.io/projected/2a41f888-5095-4905-ae99-a09736bf5ad8-kube-api-access-qcngc\") pod \"monitoring-plugin-cd8656b8-66qrf\" (UID: \"2a41f888-5095-4905-ae99-a09736bf5ad8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:31.881606 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.881584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwdjd\" (UniqueName: \"kubernetes.io/projected/f4c85bc3-e547-46c4-8987-549f9adaf8d2-kube-api-access-dwdjd\") pod \"console-679b84f984-9x9l5\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:31.971985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:31.971789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:32.349292 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.349032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a41f888-5095-4905-ae99-a09736bf5ad8-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-66qrf\" (UID: \"2a41f888-5095-4905-ae99-a09736bf5ad8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:32.352360 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.352305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a41f888-5095-4905-ae99-a09736bf5ad8-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-66qrf\" (UID: \"2a41f888-5095-4905-ae99-a09736bf5ad8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:32.431001 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.426906 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679b84f984-9x9l5"] Jul 01 17:48:32.432759 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:32.432634 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c85bc3_e547_46c4_8987_549f9adaf8d2.slice/crio-51d5ce30d95e35d4df1f24656b9ba6c3f7103fce2e5df56943b5be429ce77152 WatchSource:0}: Error finding container 51d5ce30d95e35d4df1f24656b9ba6c3f7103fce2e5df56943b5be429ce77152: Status 404 returned error can't find the container with id 51d5ce30d95e35d4df1f24656b9ba6c3f7103fce2e5df56943b5be429ce77152 Jul 01 17:48:32.433009 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:32.432984 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4202fe3_d19d_424a_a0cb_62a4858ed33d.slice/crio-17abf3b240dca44bed3bc914f9d837ffbcbe83568aa6dda414f56e5668e7d38f WatchSource:0}: Error finding container 17abf3b240dca44bed3bc914f9d837ffbcbe83568aa6dda414f56e5668e7d38f: Status 404 returned error can't find the container with id 17abf3b240dca44bed3bc914f9d837ffbcbe83568aa6dda414f56e5668e7d38f Jul 01 17:48:32.435610 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.435495 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5547bcdb64-d28vg"] Jul 01 17:48:32.506886 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.506703 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:32.537652 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.537624 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8"] Jul 01 17:48:32.541759 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.541738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.545673 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.545650 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b7253ojobmbd6\"" Jul 01 17:48:32.552234 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.552048 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:48:32.552362 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.552277 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 17:48:32.552699 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.552526 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 17:48:32.557814 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.557616 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 17:48:32.557814 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.557646 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vrj82\"" Jul 01 17:48:32.652026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.651617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-secret-metrics-server-tls\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.652026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.651670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-client-ca-bundle\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.652026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.651706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bedc4684-3a59-49fe-a40f-9f47009efb38-audit-log\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.652026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.651755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwvth\" (UniqueName: \"kubernetes.io/projected/bedc4684-3a59-49fe-a40f-9f47009efb38-kube-api-access-mwvth\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.652026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.651820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bedc4684-3a59-49fe-a40f-9f47009efb38-metrics-server-audit-profiles\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.652026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.651878 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bedc4684-3a59-49fe-a40f-9f47009efb38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.652026 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.651907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-secret-metrics-server-client-certs\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.671213 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.671174 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679b84f984-9x9l5" event={"ID":"f4c85bc3-e547-46c4-8987-549f9adaf8d2","Type":"ContainerStarted","Data":"1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db"} Jul 01 17:48:32.671385 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.671244 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679b84f984-9x9l5" event={"ID":"f4c85bc3-e547-46c4-8987-549f9adaf8d2","Type":"ContainerStarted","Data":"51d5ce30d95e35d4df1f24656b9ba6c3f7103fce2e5df56943b5be429ce77152"} Jul 01 17:48:32.674371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.673939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tp4vq" event={"ID":"609f9bd1-c21c-4896-8d49-9dc004c0085b","Type":"ContainerStarted","Data":"1c658aa7d05811d278cb40dd2c7eaf77bb08d1e4e533b5646b0085e9ea28f663"} Jul 01 17:48:32.674371 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.673997 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:48:32.675717 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.675627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" event={"ID":"b4202fe3-d19d-424a-a0cb-62a4858ed33d","Type":"ContainerStarted","Data":"17abf3b240dca44bed3bc914f9d837ffbcbe83568aa6dda414f56e5668e7d38f"} Jul 01 17:48:32.677544 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.677511 2564 generic.go:356] "Generic (PLEG): container finished" podID="80686061-9e4e-420d-b30d-99e600516c02" containerID="963dee551cd1645c8eed0c29fcb74fe4e297445938b6be3c61afff78324a85b3" exitCode=0 Jul 01 17:48:32.677881 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.677859 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80686061-9e4e-420d-b30d-99e600516c02","Type":"ContainerDied","Data":"963dee551cd1645c8eed0c29fcb74fe4e297445938b6be3c61afff78324a85b3"} Jul 01 17:48:32.692231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.692206 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8"] Jul 01 17:48:32.753014 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.752977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bedc4684-3a59-49fe-a40f-9f47009efb38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.753147 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.753133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-secret-metrics-server-client-certs\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.753330 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.753294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-secret-metrics-server-tls\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.753616 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.753587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-client-ca-bundle\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.753733 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.753661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bedc4684-3a59-49fe-a40f-9f47009efb38-audit-log\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.754361 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.753935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwvth\" (UniqueName: \"kubernetes.io/projected/bedc4684-3a59-49fe-a40f-9f47009efb38-kube-api-access-mwvth\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.754361 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.753981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bedc4684-3a59-49fe-a40f-9f47009efb38-metrics-server-audit-profiles\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.754361 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.754231 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bedc4684-3a59-49fe-a40f-9f47009efb38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.754361 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.753983 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bedc4684-3a59-49fe-a40f-9f47009efb38-audit-log\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.755181 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.755151 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bedc4684-3a59-49fe-a40f-9f47009efb38-metrics-server-audit-profiles\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.756302 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.756281 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-secret-metrics-server-tls\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.756915 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.756891 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-client-ca-bundle\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.757003 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.756939 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bedc4684-3a59-49fe-a40f-9f47009efb38-secret-metrics-server-client-certs\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.782977 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.782945 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwvth\" (UniqueName: \"kubernetes.io/projected/bedc4684-3a59-49fe-a40f-9f47009efb38-kube-api-access-mwvth\") pod \"metrics-server-79cd5dbfd6-mmcw8\" (UID: \"bedc4684-3a59-49fe-a40f-9f47009efb38\") " pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.856120 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.856084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:32.902954 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.902863 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-679b84f984-9x9l5" podStartSLOduration=1.9028435350000001 podStartE2EDuration="1.902843535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:32.899397446 +0000 UTC m=+70.963433620" watchObservedRunningTime="2026-07-01 17:48:32.902843535 +0000 UTC m=+70.966879702" Jul 01 17:48:32.974553 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:32.974505 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tp4vq" podStartSLOduration=66.489856421 podStartE2EDuration="1m9.974486564s" totalImagesPullingTime="3.484630143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:32.972464901 +0000 UTC m=+71.036501086" watchObservedRunningTime="2026-07-01 17:48:32.974486564 +0000 UTC m=+71.038522738" Jul 01 17:48:33.114463 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.114436 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-854fd9878f-nq65g"] Jul 01 17:48:33.117095 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.117072 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.122871 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.122828 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 17:48:33.122985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.122942 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 17:48:33.123105 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.123069 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 17:48:33.123213 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.123189 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 17:48:33.123295 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.123226 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 17:48:33.124880 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.124857 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kjshk\"" Jul 01 17:48:33.131798 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.131776 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 17:48:33.154692 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.154669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-854fd9878f-nq65g"] Jul 01 17:48:33.257810 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.257771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-secret-telemeter-client\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.257931 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.257869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.257996 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.257953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-metrics-client-ca\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.258053 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.258019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s7d6\" (UniqueName: \"kubernetes.io/projected/e0aac86c-7725-4be9-a885-add6abfd655f-kube-api-access-9s7d6\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.258111 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.258097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-telemeter-client-tls\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.258169 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.258122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-federate-client-tls\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.258292 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.258240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.258292 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.258271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-serving-certs-ca-bundle\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.359741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-secret-telemeter-client\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.359804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.359867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-metrics-client-ca\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.359908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s7d6\" (UniqueName: \"kubernetes.io/projected/e0aac86c-7725-4be9-a885-add6abfd655f-kube-api-access-9s7d6\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.359963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-telemeter-client-tls\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.359985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-federate-client-tls\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.360052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.360083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-serving-certs-ca-bundle\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.360819 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-serving-certs-ca-bundle\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361711 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.361406 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-metrics-client-ca\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.361711 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.361463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aac86c-7725-4be9-a885-add6abfd655f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.363504 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.363464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-telemeter-client-tls\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.364113 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.364069 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-federate-client-tls\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.364971 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.364933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-secret-telemeter-client\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.366704 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.365766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0aac86c-7725-4be9-a885-add6abfd655f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.372854 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.372755 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-66qrf"] Jul 01 17:48:33.374419 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.374399 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8"] Jul 01 17:48:33.393489 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:33.393403 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a41f888_5095_4905_ae99_a09736bf5ad8.slice/crio-bb88da5dff52942ad8dc9cb7314d5c51620836be60479cc27067ed2d68a42bd7 WatchSource:0}: Error finding container bb88da5dff52942ad8dc9cb7314d5c51620836be60479cc27067ed2d68a42bd7: Status 404 returned error can't find the container with id bb88da5dff52942ad8dc9cb7314d5c51620836be60479cc27067ed2d68a42bd7 Jul 01 17:48:33.396103 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.395895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s7d6\" (UniqueName: \"kubernetes.io/projected/e0aac86c-7725-4be9-a885-add6abfd655f-kube-api-access-9s7d6\") pod \"telemeter-client-854fd9878f-nq65g\" (UID: \"e0aac86c-7725-4be9-a885-add6abfd655f\") " pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.428938 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.428761 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" Jul 01 17:48:33.640410 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.640327 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-854fd9878f-nq65g"] Jul 01 17:48:33.644898 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:33.644854 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0aac86c_7725_4be9_a885_add6abfd655f.slice/crio-8cfdb9e3b64d6690bf246c0eb205d2723b79bac8af10c26c6a7893d216bb8b1c WatchSource:0}: Error finding container 8cfdb9e3b64d6690bf246c0eb205d2723b79bac8af10c26c6a7893d216bb8b1c: Status 404 returned error can't find the container with id 8cfdb9e3b64d6690bf246c0eb205d2723b79bac8af10c26c6a7893d216bb8b1c Jul 01 17:48:33.684953 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.684850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" event={"ID":"2a41f888-5095-4905-ae99-a09736bf5ad8","Type":"ContainerStarted","Data":"bb88da5dff52942ad8dc9cb7314d5c51620836be60479cc27067ed2d68a42bd7"} Jul 01 17:48:33.686725 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.686604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" event={"ID":"bedc4684-3a59-49fe-a40f-9f47009efb38","Type":"ContainerStarted","Data":"c1d20d09f4b3cd5a544dc33ba55a721ae5beb8430bbaef5f414ec8d1e8890d53"} Jul 01 17:48:33.688671 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.688643 2564 generic.go:356] "Generic (PLEG): container finished" podID="bdb01fd8-737b-4955-8687-24000a9d7ef2" containerID="84d453002169e6c41c532bfc19bbee04b70fb3db5e15da32b8609eaf9157b941" exitCode=0 Jul 01 17:48:33.688787 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.688752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-68f7f" event={"ID":"bdb01fd8-737b-4955-8687-24000a9d7ef2","Type":"ContainerDied","Data":"84d453002169e6c41c532bfc19bbee04b70fb3db5e15da32b8609eaf9157b941"} Jul 01 17:48:33.691905 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.691788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" event={"ID":"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34","Type":"ContainerStarted","Data":"e708c7bc2d876d65ea8d177afb951ecf383c01c90ae436e7a2939d5bed80cc41"} Jul 01 17:48:33.691905 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.691835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" event={"ID":"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34","Type":"ContainerStarted","Data":"8161ef7f2968cf70f7774dba2ed6690c8ca43b87edebd5d5495e3a1488528f17"} Jul 01 17:48:33.691905 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.691862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" event={"ID":"16f8d71d-947c-45b7-bbfb-9b38fcf8cc34","Type":"ContainerStarted","Data":"0d051451ba0d03d64e1b890533f5dc00af1048981b0f53438e7b64ef0e4dda3b"} Jul 01 17:48:33.695921 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.695896 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" event={"ID":"e0aac86c-7725-4be9-a885-add6abfd655f","Type":"ContainerStarted","Data":"8cfdb9e3b64d6690bf246c0eb205d2723b79bac8af10c26c6a7893d216bb8b1c"} Jul 01 17:48:33.782100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:33.782046 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-pwn87" podStartSLOduration=1.6873024239999999 podStartE2EDuration="6.782023269s" totalImagesPullingTime="5.094720845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:33.7809861 +0000 UTC m=+71.845022322" watchObservedRunningTime="2026-07-01 17:48:33.782023269 +0000 UTC m=+71.846059443" Jul 01 17:48:34.703564 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:34.703460 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-68f7f" event={"ID":"bdb01fd8-737b-4955-8687-24000a9d7ef2","Type":"ContainerStarted","Data":"9a31cd039dbc70894bd8a08e5d2f7919dcaae371a0215a5ca5cd34a321b5b07c"} Jul 01 17:48:34.703564 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:34.703527 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-68f7f" event={"ID":"bdb01fd8-737b-4955-8687-24000a9d7ef2","Type":"ContainerStarted","Data":"f55a834a90ecf1c6aa3eccf1bb5bcc760aec23a32cdbd981cef93997d051df18"} Jul 01 17:48:34.787017 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:34.786961 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-68f7f" podStartSLOduration=2.442337328 podStartE2EDuration="7.786940704s" totalImagesPullingTime="5.240623138s" totalInitContainerRuntime="103.980238ms" isStatefulPod=true podCreationTimestamp="2026-07-01 17:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:34.785234682 +0000 UTC m=+72.849270859" watchObservedRunningTime="2026-07-01 17:48:34.786940704 +0000 UTC m=+72.850976877" Jul 01 17:48:35.709656 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:35.709612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" event={"ID":"bedc4684-3a59-49fe-a40f-9f47009efb38","Type":"ContainerStarted","Data":"1c7300b14a7d313bd784e62a5e7d42e6e12252ac79da97b2af5497f91ac982c8"} Jul 01 17:48:35.711895 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:35.711861 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80686061-9e4e-420d-b30d-99e600516c02","Type":"ContainerStarted","Data":"bb3bc8ab598119a531fb9afd02f388ea95fbf05a6ed095dc8896be008322a7fa"} Jul 01 17:48:35.758707 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:35.758654 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" podStartSLOduration=1.931587414 podStartE2EDuration="3.758636827s" totalImagesPullingTime="1.827049413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:35.758212744 +0000 UTC m=+73.822248918" watchObservedRunningTime="2026-07-01 17:48:35.758636827 +0000 UTC m=+73.822673001" Jul 01 17:48:38.731862 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.731800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80686061-9e4e-420d-b30d-99e600516c02","Type":"ContainerStarted","Data":"af02d703e02ee67b3ab0ec1afbfb27e2fa84d0fa4955dc688c138cb4dcbb8d72"} Jul 01 17:48:38.732374 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.731921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80686061-9e4e-420d-b30d-99e600516c02","Type":"ContainerStarted","Data":"1151df7699e90f0593a2e6564de01b588a1752ae8fc4de336c4808c370f08fbd"} Jul 01 17:48:38.732374 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.731972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80686061-9e4e-420d-b30d-99e600516c02","Type":"ContainerStarted","Data":"0630b1b23ef8f29be67b9fe089b02d56031b3e92a62791dc24f7796266a3abe3"} Jul 01 17:48:38.732374 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.732013 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80686061-9e4e-420d-b30d-99e600516c02","Type":"ContainerStarted","Data":"8fbd96626dde052756d4ff51476ce02b9d70a68f4019aab04b9be486dc8d6361"} Jul 01 17:48:38.734037 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.734004 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ww66v" event={"ID":"d5ca0dc4-4f82-4ed1-bc82-396932e508f0","Type":"ContainerStarted","Data":"06083e05b06e316644cf622d2617ee1fdeb3335aa3d1352d853387fdadd257ee"} Jul 01 17:48:38.736773 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.736740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" event={"ID":"b4202fe3-d19d-424a-a0cb-62a4858ed33d","Type":"ContainerStarted","Data":"a37801096446cec5232107ff8db8619e4ee157456e0a7cab0d8e0b2eedab6cfb"} Jul 01 17:48:38.736891 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.736819 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" event={"ID":"b4202fe3-d19d-424a-a0cb-62a4858ed33d","Type":"ContainerStarted","Data":"d368f1941458525899db2614a72f0683295a3d2d36167c5cc362a08bb37b9d50"} Jul 01 17:48:38.736891 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.736873 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" event={"ID":"b4202fe3-d19d-424a-a0cb-62a4858ed33d","Type":"ContainerStarted","Data":"85d54fd3443a8f2134e915d8222f8a3d7a316c576d607bc83849378de20b94b7"} Jul 01 17:48:38.739443 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.739409 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" event={"ID":"e0aac86c-7725-4be9-a885-add6abfd655f","Type":"ContainerStarted","Data":"732008b9be500a731be3de565fa4d0aa0c6c533f09a4571629c6a16f75ea730d"} Jul 01 17:48:38.739599 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.739492 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" event={"ID":"e0aac86c-7725-4be9-a885-add6abfd655f","Type":"ContainerStarted","Data":"92af708749c8b46479729e58c05d6ee5c2606cb729b71a9a526796f29e1c71f8"} Jul 01 17:48:38.739599 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.739525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" event={"ID":"e0aac86c-7725-4be9-a885-add6abfd655f","Type":"ContainerStarted","Data":"6ae09cf6559add0cd5ca7fb400a118c206d7425b3f7a9535ea8c1f14e8b9b5a5"} Jul 01 17:48:38.761387 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.761305 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ww66v" podStartSLOduration=66.406690626 podStartE2EDuration="1m15.76129076s" totalImagesPullingTime="9.354600134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:38.75952192 +0000 UTC m=+76.823558101" watchObservedRunningTime="2026-07-01 17:48:38.76129076 +0000 UTC m=+76.825326984" Jul 01 17:48:38.795946 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:38.795905 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-854fd9878f-nq65g" podStartSLOduration=1.611054807 podStartE2EDuration="5.795889193s" totalImagesPullingTime="4.184834386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:38.795640359 +0000 UTC m=+76.859676531" watchObservedRunningTime="2026-07-01 17:48:38.795889193 +0000 UTC m=+76.859925367" Jul 01 17:48:39.570785 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.570753 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679b84f984-9x9l5"] Jul 01 17:48:39.657507 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.657469 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6859ccd9b7-tjxll"] Jul 01 17:48:39.660801 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.660785 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.689898 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.689871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6859ccd9b7-tjxll"] Jul 01 17:48:39.746578 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.746551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80686061-9e4e-420d-b30d-99e600516c02","Type":"ContainerStarted","Data":"b890adce37b33f33cbc0b9f16f8a87eceb71950a59bf5e12f81db6926fe9ec23"} Jul 01 17:48:39.823331 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.823269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-trusted-ca-bundle\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.823575 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.823555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-oauth-config\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.823649 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.823599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-oauth-serving-cert\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.823649 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.823618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-config\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.823738 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.823721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6b82\" (UniqueName: \"kubernetes.io/projected/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-kube-api-access-m6b82\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.823772 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.823753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-serving-cert\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.824003 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.823977 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-service-ca\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.848882 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.848837 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.40024844 podStartE2EDuration="11.848822554s" totalImagesPullingTime="6.416904846s" totalInitContainerRuntime="31.669268ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:39.848586142 +0000 UTC m=+77.912622315" watchObservedRunningTime="2026-07-01 17:48:39.848822554 +0000 UTC m=+77.912858727" Jul 01 17:48:39.925214 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.925188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-trusted-ca-bundle\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.925358 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.925235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-oauth-config\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.925358 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.925258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-oauth-serving-cert\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.925358 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.925283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-config\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.925358 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.925352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6b82\" (UniqueName: \"kubernetes.io/projected/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-kube-api-access-m6b82\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.925565 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.925386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-serving-cert\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.925613 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.925438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-service-ca\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.931999 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.926377 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-config\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.931999 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.926635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-trusted-ca-bundle\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.931999 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.926759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-service-ca\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.931999 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.926765 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-oauth-serving-cert\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.931999 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.928559 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-serving-cert\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.933042 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.933021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-oauth-config\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.944656 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.944632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6b82\" (UniqueName: \"kubernetes.io/projected/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-kube-api-access-m6b82\") pod \"console-6859ccd9b7-tjxll\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:39.969615 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:39.969596 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:40.124581 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:40.124418 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6859ccd9b7-tjxll"] Jul 01 17:48:40.128288 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:48:40.128259 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9afa3c_f5cc_49e1_bd05_e34151221bb1.slice/crio-93acc6585a5e069e554dea5dae9aa30bf5291fe5b92f92262aac474b348f6ec4 WatchSource:0}: Error finding container 93acc6585a5e069e554dea5dae9aa30bf5291fe5b92f92262aac474b348f6ec4: Status 404 returned error can't find the container with id 93acc6585a5e069e554dea5dae9aa30bf5291fe5b92f92262aac474b348f6ec4 Jul 01 17:48:40.752555 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:40.752512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6859ccd9b7-tjxll" event={"ID":"9e9afa3c-f5cc-49e1-bd05-e34151221bb1","Type":"ContainerStarted","Data":"0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772"} Jul 01 17:48:40.752985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:40.752572 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6859ccd9b7-tjxll" event={"ID":"9e9afa3c-f5cc-49e1-bd05-e34151221bb1","Type":"ContainerStarted","Data":"93acc6585a5e069e554dea5dae9aa30bf5291fe5b92f92262aac474b348f6ec4"} Jul 01 17:48:40.755370 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:40.755339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" event={"ID":"b4202fe3-d19d-424a-a0cb-62a4858ed33d","Type":"ContainerStarted","Data":"1855172a67f476c94a39245d3cdce9dfa38086447369af706736ed32ba2b15a9"} Jul 01 17:48:40.755487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:40.755396 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" event={"ID":"b4202fe3-d19d-424a-a0cb-62a4858ed33d","Type":"ContainerStarted","Data":"c6c65275c890e53213c98a25ecca43a0cc2305985247318d35c0df7160e60c21"} Jul 01 17:48:40.755487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:40.755424 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" event={"ID":"b4202fe3-d19d-424a-a0cb-62a4858ed33d","Type":"ContainerStarted","Data":"2603a1e7f2cdbdb28a4664a727b13ed9d04c02bdebdf0f0796a93554ea997acb"} Jul 01 17:48:40.755735 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:40.755718 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:40.788016 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:40.787977 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6859ccd9b7-tjxll" podStartSLOduration=1.787962587 podStartE2EDuration="1.787962587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:40.787431918 +0000 UTC m=+78.851468091" watchObservedRunningTime="2026-07-01 17:48:40.787962587 +0000 UTC m=+78.851998759" Jul 01 17:48:41.972767 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:41.972738 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:48:45.778023 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:45.777975 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" event={"ID":"2a41f888-5095-4905-ae99-a09736bf5ad8","Type":"ContainerStarted","Data":"05987af3e05e62182bd5ea84d37a3958a9919d24163b2d719ead141e938e0d43"} Jul 01 17:48:45.778554 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:45.778043 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:45.783736 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:45.783712 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" Jul 01 17:48:45.807413 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:45.807364 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-66qrf" podStartSLOduration=3.139905405 podStartE2EDuration="14.8073487s" totalImagesPullingTime="11.667443295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:45.805558228 +0000 UTC m=+83.869594419" watchObservedRunningTime="2026-07-01 17:48:45.8073487 +0000 UTC m=+83.871384870" Jul 01 17:48:45.807910 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:45.807886 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" podStartSLOduration=7.768973657 podStartE2EDuration="14.807878897s" totalImagesPullingTime="7.03890524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:40.826841818 +0000 UTC m=+78.890877988" watchObservedRunningTime="2026-07-01 17:48:45.807878897 +0000 UTC m=+83.871915079" Jul 01 17:48:46.766083 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:46.766056 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5547bcdb64-d28vg" Jul 01 17:48:49.970089 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:49.970057 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:49.970523 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:49.970141 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:49.975104 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:49.975080 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:50.801351 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:50.801300 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:48:50.896501 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:50.896472 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bdc76dd4-vqv5h"] Jul 01 17:48:52.856389 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:52.856356 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:48:52.857006 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:48:52.856419 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:49:03.699091 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:03.699060 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tp4vq" Jul 01 17:49:04.590624 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.590557 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-679b84f984-9x9l5" podUID="f4c85bc3-e547-46c4-8987-549f9adaf8d2" containerName="console" containerID="cri-o://1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db" gracePeriod=15 Jul 01 17:49:04.830633 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.830609 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:49:04.853719 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.853646 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4c85bc3-e547-46c4-8987-549f9adaf8d2" containerID="1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db" exitCode=0 Jul 01 17:49:04.853719 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.853707 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679b84f984-9x9l5" Jul 01 17:49:04.854100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.853744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679b84f984-9x9l5" event={"ID":"f4c85bc3-e547-46c4-8987-549f9adaf8d2","Type":"ContainerDied","Data":"1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db"} Jul 01 17:49:04.854100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.853840 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679b84f984-9x9l5" event={"ID":"f4c85bc3-e547-46c4-8987-549f9adaf8d2","Type":"ContainerDied","Data":"51d5ce30d95e35d4df1f24656b9ba6c3f7103fce2e5df56943b5be429ce77152"} Jul 01 17:49:04.854100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.853870 2564 scope.go:117] "RemoveContainer" containerID="1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db" Jul 01 17:49:04.862420 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.862399 2564 scope.go:117] "RemoveContainer" containerID="1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db" Jul 01 17:49:04.862711 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:49:04.862687 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db\": container with ID starting with 1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db not found: ID does not exist" containerID="1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db" Jul 01 17:49:04.862768 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.862724 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db"} err="failed to get container status \"1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db\": rpc error: code = NotFound desc = could not find container \"1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db\": container with ID starting with 1524df2b8647f26e864a2724aa3f670bddb03a2f038ea17528e571fc957ed0db not found: ID does not exist" Jul 01 17:49:04.907058 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907038 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-service-ca\") pod \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " Jul 01 17:49:04.907143 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907074 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-serving-cert\") pod \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " Jul 01 17:49:04.907143 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907091 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-config\") pod \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " Jul 01 17:49:04.907143 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907118 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-trusted-ca-bundle\") pod \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " Jul 01 17:49:04.907249 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907162 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-oauth-config\") pod \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " Jul 01 17:49:04.907249 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907239 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-oauth-serving-cert\") pod \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " Jul 01 17:49:04.907406 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907269 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwdjd\" (UniqueName: \"kubernetes.io/projected/f4c85bc3-e547-46c4-8987-549f9adaf8d2-kube-api-access-dwdjd\") pod \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\" (UID: \"f4c85bc3-e547-46c4-8987-549f9adaf8d2\") " Jul 01 17:49:04.907513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907485 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-config" (OuterVolumeSpecName: "console-config") pod "f4c85bc3-e547-46c4-8987-549f9adaf8d2" (UID: "f4c85bc3-e547-46c4-8987-549f9adaf8d2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:49:04.907594 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907572 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-service-ca" (OuterVolumeSpecName: "service-ca") pod "f4c85bc3-e547-46c4-8987-549f9adaf8d2" (UID: "f4c85bc3-e547-46c4-8987-549f9adaf8d2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:49:04.907642 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907586 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f4c85bc3-e547-46c4-8987-549f9adaf8d2" (UID: "f4c85bc3-e547-46c4-8987-549f9adaf8d2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:49:04.907911 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.907886 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f4c85bc3-e547-46c4-8987-549f9adaf8d2" (UID: "f4c85bc3-e547-46c4-8987-549f9adaf8d2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:49:04.909292 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.909273 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f4c85bc3-e547-46c4-8987-549f9adaf8d2" (UID: "f4c85bc3-e547-46c4-8987-549f9adaf8d2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:49:04.909751 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.909720 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f4c85bc3-e547-46c4-8987-549f9adaf8d2" (UID: "f4c85bc3-e547-46c4-8987-549f9adaf8d2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:49:04.909841 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:04.909764 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c85bc3-e547-46c4-8987-549f9adaf8d2-kube-api-access-dwdjd" (OuterVolumeSpecName: "kube-api-access-dwdjd") pod "f4c85bc3-e547-46c4-8987-549f9adaf8d2" (UID: "f4c85bc3-e547-46c4-8987-549f9adaf8d2"). InnerVolumeSpecName "kube-api-access-dwdjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:49:05.008610 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.008586 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-service-ca\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:05.008610 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.008606 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-serving-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:05.008730 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.008616 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-config\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:05.008730 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.008625 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-trusted-ca-bundle\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:05.008730 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.008633 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4c85bc3-e547-46c4-8987-549f9adaf8d2-console-oauth-config\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:05.008730 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.008641 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4c85bc3-e547-46c4-8987-549f9adaf8d2-oauth-serving-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:05.008730 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.008649 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwdjd\" (UniqueName: \"kubernetes.io/projected/f4c85bc3-e547-46c4-8987-549f9adaf8d2-kube-api-access-dwdjd\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:05.177826 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.177802 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679b84f984-9x9l5"] Jul 01 17:49:05.182429 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:05.182409 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-679b84f984-9x9l5"] Jul 01 17:49:06.382304 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:06.382268 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c85bc3-e547-46c4-8987-549f9adaf8d2" path="/var/lib/kubelet/pods/f4c85bc3-e547-46c4-8987-549f9adaf8d2/volumes" Jul 01 17:49:12.862087 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:12.862055 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:49:12.865992 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:12.865969 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79cd5dbfd6-mmcw8" Jul 01 17:49:15.917532 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:15.917485 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66bdc76dd4-vqv5h" podUID="b1397dc3-b66f-4655-826f-106c870303b9" containerName="console" containerID="cri-o://9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43" gracePeriod=15 Jul 01 17:49:16.173850 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.173799 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:49:16.290889 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.290866 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5n7v\" (UniqueName: \"kubernetes.io/projected/b1397dc3-b66f-4655-826f-106c870303b9-kube-api-access-h5n7v\") pod \"b1397dc3-b66f-4655-826f-106c870303b9\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " Jul 01 17:49:16.291014 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.290894 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-oauth-config\") pod \"b1397dc3-b66f-4655-826f-106c870303b9\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " Jul 01 17:49:16.291014 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.290949 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-service-ca\") pod \"b1397dc3-b66f-4655-826f-106c870303b9\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " Jul 01 17:49:16.291014 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.290966 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-serving-cert\") pod \"b1397dc3-b66f-4655-826f-106c870303b9\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " Jul 01 17:49:16.291125 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.291040 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-trusted-ca-bundle\") pod \"b1397dc3-b66f-4655-826f-106c870303b9\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " Jul 01 17:49:16.291125 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.291092 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-oauth-serving-cert\") pod \"b1397dc3-b66f-4655-826f-106c870303b9\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " Jul 01 17:49:16.291222 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.291146 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-console-config\") pod \"b1397dc3-b66f-4655-826f-106c870303b9\" (UID: \"b1397dc3-b66f-4655-826f-106c870303b9\") " Jul 01 17:49:16.291464 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.291425 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-service-ca" (OuterVolumeSpecName: "service-ca") pod "b1397dc3-b66f-4655-826f-106c870303b9" (UID: "b1397dc3-b66f-4655-826f-106c870303b9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:49:16.291464 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.291434 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b1397dc3-b66f-4655-826f-106c870303b9" (UID: "b1397dc3-b66f-4655-826f-106c870303b9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:49:16.291657 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.291479 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b1397dc3-b66f-4655-826f-106c870303b9" (UID: "b1397dc3-b66f-4655-826f-106c870303b9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:49:16.291657 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.291602 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-console-config" (OuterVolumeSpecName: "console-config") pod "b1397dc3-b66f-4655-826f-106c870303b9" (UID: "b1397dc3-b66f-4655-826f-106c870303b9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:49:16.293030 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.293008 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b1397dc3-b66f-4655-826f-106c870303b9" (UID: "b1397dc3-b66f-4655-826f-106c870303b9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:49:16.293490 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.293458 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b1397dc3-b66f-4655-826f-106c870303b9" (UID: "b1397dc3-b66f-4655-826f-106c870303b9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:49:16.293543 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.293517 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1397dc3-b66f-4655-826f-106c870303b9-kube-api-access-h5n7v" (OuterVolumeSpecName: "kube-api-access-h5n7v") pod "b1397dc3-b66f-4655-826f-106c870303b9" (UID: "b1397dc3-b66f-4655-826f-106c870303b9"). InnerVolumeSpecName "kube-api-access-h5n7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:49:16.392049 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.392028 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-oauth-serving-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:16.392049 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.392050 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-console-config\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:16.392176 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.392059 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5n7v\" (UniqueName: \"kubernetes.io/projected/b1397dc3-b66f-4655-826f-106c870303b9-kube-api-access-h5n7v\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:16.392176 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.392069 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-oauth-config\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:16.392176 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.392080 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-service-ca\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:16.392176 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.392089 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1397dc3-b66f-4655-826f-106c870303b9-console-serving-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:16.392176 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.392098 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1397dc3-b66f-4655-826f-106c870303b9-trusted-ca-bundle\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:49:16.906450 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.906414 2564 generic.go:356] "Generic (PLEG): container finished" podID="b1397dc3-b66f-4655-826f-106c870303b9" containerID="9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43" exitCode=0 Jul 01 17:49:16.906606 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.906466 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bdc76dd4-vqv5h" Jul 01 17:49:16.906606 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.906500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bdc76dd4-vqv5h" event={"ID":"b1397dc3-b66f-4655-826f-106c870303b9","Type":"ContainerDied","Data":"9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43"} Jul 01 17:49:16.906606 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.906558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bdc76dd4-vqv5h" event={"ID":"b1397dc3-b66f-4655-826f-106c870303b9","Type":"ContainerDied","Data":"5d9d8fbc404540464bc4071b06c99465f0b37e6844127379d6eef62f7e9c2e99"} Jul 01 17:49:16.906606 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.906585 2564 scope.go:117] "RemoveContainer" containerID="9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43" Jul 01 17:49:16.915140 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.915122 2564 scope.go:117] "RemoveContainer" containerID="9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43" Jul 01 17:49:16.915435 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:49:16.915417 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43\": container with ID starting with 9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43 not found: ID does not exist" containerID="9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43" Jul 01 17:49:16.915485 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.915443 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43"} err="failed to get container status \"9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43\": rpc error: code = NotFound desc = could not find container \"9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43\": container with ID starting with 9d85d2e565207dfc09daf96e11d0938a83ac5f1a3368dd59dc78d2b4846a5f43 not found: ID does not exist" Jul 01 17:49:16.925181 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.925149 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bdc76dd4-vqv5h"] Jul 01 17:49:16.928967 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:16.928945 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66bdc76dd4-vqv5h"] Jul 01 17:49:18.382848 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:49:18.382808 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1397dc3-b66f-4655-826f-106c870303b9" path="/var/lib/kubelet/pods/b1397dc3-b66f-4655-826f-106c870303b9/volumes" Jul 01 17:52:22.320028 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:52:22.319999 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:52:22.320638 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:52:22.320484 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:52:22.327779 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:52:22.327751 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 17:53:38.596610 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.596574 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:53:38.597100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.596941 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c85bc3-e547-46c4-8987-549f9adaf8d2" containerName="console" Jul 01 17:53:38.597100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.596956 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c85bc3-e547-46c4-8987-549f9adaf8d2" containerName="console" Jul 01 17:53:38.597100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.596968 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1397dc3-b66f-4655-826f-106c870303b9" containerName="console" Jul 01 17:53:38.597100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.596984 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1397dc3-b66f-4655-826f-106c870303b9" containerName="console" Jul 01 17:53:38.597100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.597036 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c85bc3-e547-46c4-8987-549f9adaf8d2" containerName="console" Jul 01 17:53:38.597100 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.597047 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1397dc3-b66f-4655-826f-106c870303b9" containerName="console" Jul 01 17:53:38.600224 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.600208 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.623234 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.623210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:53:38.623621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.623280 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:53:38.623621 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.623381 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:53:38.623780 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.623662 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:53:38.625083 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.624894 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:53:38.625219 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625192 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:53:38.625346 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625222 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:53:38.625346 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625335 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:53:38.625479 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625384 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbddm\"" Jul 01 17:53:38.625479 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:53:38.625479 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625393 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:53:38.625479 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625342 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:53:38.625669 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625573 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bitgedrb55unc\"" Jul 01 17:53:38.625791 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.625773 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:53:38.632869 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.632845 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:53:38.638485 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.638463 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:53:38.643326 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643417 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-web-config\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643417 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643489 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643489 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643489 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643489 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45214df5-19c9-417d-85b5-5d2e759aa326-config-out\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643607 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643607 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643607 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxc2p\" (UniqueName: \"kubernetes.io/projected/45214df5-19c9-417d-85b5-5d2e759aa326-kube-api-access-zxc2p\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643607 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45214df5-19c9-417d-85b5-5d2e759aa326-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643728 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643728 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643728 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643728 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643728 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643870 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643870 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643870 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-config\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.643870 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.643806 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.662255 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.662230 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:53:38.744558 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744697 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744697 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744697 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744697 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744697 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-config\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-web-config\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.744894 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.744970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45214df5-19c9-417d-85b5-5d2e759aa326-config-out\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.745000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.745030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.745054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc2p\" (UniqueName: \"kubernetes.io/projected/45214df5-19c9-417d-85b5-5d2e759aa326-kube-api-access-zxc2p\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.745084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45214df5-19c9-417d-85b5-5d2e759aa326-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.745109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745656 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.745632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.745921 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.745897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.748635 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.748609 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.749398 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.749286 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.749398 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.749303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.749915 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.749597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.749915 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.749702 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.749915 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.749707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45214df5-19c9-417d-85b5-5d2e759aa326-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.750669 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.750360 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.751065 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.751046 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-web-config\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.751305 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.751276 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45214df5-19c9-417d-85b5-5d2e759aa326-config-out\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.751507 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.751480 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.751585 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.751561 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45214df5-19c9-417d-85b5-5d2e759aa326-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.751679 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.751637 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.752046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.752023 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.752299 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.752275 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-config\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.752517 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.752497 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.753793 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.753758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.754477 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.754459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45214df5-19c9-417d-85b5-5d2e759aa326-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.759205 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.759183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxc2p\" (UniqueName: \"kubernetes.io/projected/45214df5-19c9-417d-85b5-5d2e759aa326-kube-api-access-zxc2p\") pod \"prometheus-k8s-0\" (UID: \"45214df5-19c9-417d-85b5-5d2e759aa326\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:38.909616 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:38.909533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:53:39.071485 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:39.071457 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:53:39.073727 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:53:39.073681 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45214df5_19c9_417d_85b5_5d2e759aa326.slice/crio-5747ca29cc29d8fcfac5933a2d2e944fb09c182efbf2524852f709410f9046af WatchSource:0}: Error finding container 5747ca29cc29d8fcfac5933a2d2e944fb09c182efbf2524852f709410f9046af: Status 404 returned error can't find the container with id 5747ca29cc29d8fcfac5933a2d2e944fb09c182efbf2524852f709410f9046af Jul 01 17:53:39.944054 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:39.944020 2564 generic.go:356] "Generic (PLEG): container finished" podID="45214df5-19c9-417d-85b5-5d2e759aa326" containerID="4be9f2bf1f63587d431672fa2dc76723974f74a0de173a06d9bc04ec7eaa0803" exitCode=0 Jul 01 17:53:39.944460 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:39.944106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45214df5-19c9-417d-85b5-5d2e759aa326","Type":"ContainerDied","Data":"4be9f2bf1f63587d431672fa2dc76723974f74a0de173a06d9bc04ec7eaa0803"} Jul 01 17:53:39.944460 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:39.944171 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45214df5-19c9-417d-85b5-5d2e759aa326","Type":"ContainerStarted","Data":"5747ca29cc29d8fcfac5933a2d2e944fb09c182efbf2524852f709410f9046af"} Jul 01 17:53:39.945351 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:39.945332 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:53:43.965651 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:43.965605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45214df5-19c9-417d-85b5-5d2e759aa326","Type":"ContainerStarted","Data":"bccf47f89512f92f69e00ef08ac092d6f6c486760442a22e30ef8ef9dc022565"} Jul 01 17:53:43.965929 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:43.965728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45214df5-19c9-417d-85b5-5d2e759aa326","Type":"ContainerStarted","Data":"300d2733daeae853d66fdd17d0ec36bfc21ad97119b46505384f7e1fdf55d0b4"} Jul 01 17:53:44.973477 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:44.973442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45214df5-19c9-417d-85b5-5d2e759aa326","Type":"ContainerStarted","Data":"efbcaf277341ca7517efaf6b3affcdaadf48bcfa4d51fc8ab881854054df4e54"} Jul 01 17:53:44.973846 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:44.973506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45214df5-19c9-417d-85b5-5d2e759aa326","Type":"ContainerStarted","Data":"05197459147c846b5b599e70630afc647bbe8d914b170fe08412741830a05c80"} Jul 01 17:53:44.973846 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:44.973538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45214df5-19c9-417d-85b5-5d2e759aa326","Type":"ContainerStarted","Data":"13dc64d205387e4fbb66466d51977b4921ba7107849b4b8a7c67e16db6f00747"} Jul 01 17:53:44.973846 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:44.973565 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45214df5-19c9-417d-85b5-5d2e759aa326","Type":"ContainerStarted","Data":"441233b727362a0fb1a3d020f6947983503a3aa86f2c618aec482fd2c0524e3b"} Jul 01 17:53:45.018606 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:45.018561 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.139406722 podStartE2EDuration="7.018545859s" totalImagesPullingTime="3.857714744s" totalInitContainerRuntime="21.424393ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:53:45.015746193 +0000 UTC m=+383.079782368" watchObservedRunningTime="2026-07-01 17:53:45.018545859 +0000 UTC m=+383.082582035" Jul 01 17:53:48.909671 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:53:48.909619 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:54:38.910470 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:54:38.910385 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:54:38.931388 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:54:38.931357 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:54:39.221377 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:54:39.221293 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:54:59.965095 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:54:59.965002 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6859ccd9b7-tjxll"] Jul 01 17:55:24.988126 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:24.988081 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6859ccd9b7-tjxll" podUID="9e9afa3c-f5cc-49e1-bd05-e34151221bb1" containerName="console" containerID="cri-o://0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772" gracePeriod=15 Jul 01 17:55:25.236466 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.236442 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:55:25.384613 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.384551 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-oauth-serving-cert\") pod \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " Jul 01 17:55:25.384613 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.384583 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-serving-cert\") pod \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " Jul 01 17:55:25.384613 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.384607 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-config\") pod \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " Jul 01 17:55:25.384849 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.384672 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-service-ca\") pod \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " Jul 01 17:55:25.384849 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.384699 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-trusted-ca-bundle\") pod \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " Jul 01 17:55:25.384849 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.384740 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6b82\" (UniqueName: \"kubernetes.io/projected/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-kube-api-access-m6b82\") pod \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " Jul 01 17:55:25.384849 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.384797 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-oauth-config\") pod \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\" (UID: \"9e9afa3c-f5cc-49e1-bd05-e34151221bb1\") " Jul 01 17:55:25.385120 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.385087 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e9afa3c-f5cc-49e1-bd05-e34151221bb1" (UID: "9e9afa3c-f5cc-49e1-bd05-e34151221bb1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:55:25.385178 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.385130 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-config" (OuterVolumeSpecName: "console-config") pod "9e9afa3c-f5cc-49e1-bd05-e34151221bb1" (UID: "9e9afa3c-f5cc-49e1-bd05-e34151221bb1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:55:25.385178 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.385144 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e9afa3c-f5cc-49e1-bd05-e34151221bb1" (UID: "9e9afa3c-f5cc-49e1-bd05-e34151221bb1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:55:25.385440 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.385406 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9e9afa3c-f5cc-49e1-bd05-e34151221bb1" (UID: "9e9afa3c-f5cc-49e1-bd05-e34151221bb1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:55:25.387676 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.387638 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e9afa3c-f5cc-49e1-bd05-e34151221bb1" (UID: "9e9afa3c-f5cc-49e1-bd05-e34151221bb1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:55:25.387778 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.387664 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e9afa3c-f5cc-49e1-bd05-e34151221bb1" (UID: "9e9afa3c-f5cc-49e1-bd05-e34151221bb1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:55:25.387778 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.387693 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-kube-api-access-m6b82" (OuterVolumeSpecName: "kube-api-access-m6b82") pod "9e9afa3c-f5cc-49e1-bd05-e34151221bb1" (UID: "9e9afa3c-f5cc-49e1-bd05-e34151221bb1"). InnerVolumeSpecName "kube-api-access-m6b82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:55:25.390759 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.390735 2564 generic.go:356] "Generic (PLEG): container finished" podID="9e9afa3c-f5cc-49e1-bd05-e34151221bb1" containerID="0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772" exitCode=0 Jul 01 17:55:25.390847 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.390774 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6859ccd9b7-tjxll" Jul 01 17:55:25.390847 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.390813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6859ccd9b7-tjxll" event={"ID":"9e9afa3c-f5cc-49e1-bd05-e34151221bb1","Type":"ContainerDied","Data":"0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772"} Jul 01 17:55:25.390919 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.390859 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6859ccd9b7-tjxll" event={"ID":"9e9afa3c-f5cc-49e1-bd05-e34151221bb1","Type":"ContainerDied","Data":"93acc6585a5e069e554dea5dae9aa30bf5291fe5b92f92262aac474b348f6ec4"} Jul 01 17:55:25.390919 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.390880 2564 scope.go:117] "RemoveContainer" containerID="0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772" Jul 01 17:55:25.402215 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.402200 2564 scope.go:117] "RemoveContainer" containerID="0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772" Jul 01 17:55:25.402518 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:55:25.402499 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772\": container with ID starting with 0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772 not found: ID does not exist" containerID="0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772" Jul 01 17:55:25.402579 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.402526 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772"} err="failed to get container status \"0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772\": rpc error: code = NotFound desc = could not find container \"0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772\": container with ID starting with 0b884b84d283c78689738bb3651aea6675482790df1f2902e646f37e65c2a772 not found: ID does not exist" Jul 01 17:55:25.416934 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.416911 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6859ccd9b7-tjxll"] Jul 01 17:55:25.426359 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.426340 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6859ccd9b7-tjxll"] Jul 01 17:55:25.485869 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.485846 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-oauth-serving-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:55:25.485951 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.485871 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-serving-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:55:25.485951 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.485883 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-config\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:55:25.485951 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.485897 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-service-ca\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:55:25.485951 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.485910 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-trusted-ca-bundle\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:55:25.485951 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.485922 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6b82\" (UniqueName: \"kubernetes.io/projected/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-kube-api-access-m6b82\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:55:25.485951 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:25.485935 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e9afa3c-f5cc-49e1-bd05-e34151221bb1-console-oauth-config\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:55:26.383464 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:55:26.383430 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e9afa3c-f5cc-49e1-bd05-e34151221bb1" path="/var/lib/kubelet/pods/9e9afa3c-f5cc-49e1-bd05-e34151221bb1/volumes" Jul 01 17:56:18.040137 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.040062 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nzktk"] Jul 01 17:56:18.040591 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.040401 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e9afa3c-f5cc-49e1-bd05-e34151221bb1" containerName="console" Jul 01 17:56:18.040591 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.040412 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e9afa3c-f5cc-49e1-bd05-e34151221bb1" containerName="console" Jul 01 17:56:18.040591 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.040462 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e9afa3c-f5cc-49e1-bd05-e34151221bb1" containerName="console" Jul 01 17:56:18.043155 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.043141 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:18.049819 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.049802 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 17:56:18.050652 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.050638 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 17:56:18.050708 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.050648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dlwsp\"" Jul 01 17:56:18.060127 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.060109 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nzktk"] Jul 01 17:56:18.182712 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.182680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx6jw\" (UniqueName: \"kubernetes.io/projected/63ad8de5-9acb-435c-a8b7-b2644f59c550-kube-api-access-nx6jw\") pod \"cert-manager-webhook-7dc76cbb94-nzktk\" (UID: \"63ad8de5-9acb-435c-a8b7-b2644f59c550\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:18.182841 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.182718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63ad8de5-9acb-435c-a8b7-b2644f59c550-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nzktk\" (UID: \"63ad8de5-9acb-435c-a8b7-b2644f59c550\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:18.283277 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.283247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63ad8de5-9acb-435c-a8b7-b2644f59c550-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nzktk\" (UID: \"63ad8de5-9acb-435c-a8b7-b2644f59c550\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:18.283389 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.283347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx6jw\" (UniqueName: \"kubernetes.io/projected/63ad8de5-9acb-435c-a8b7-b2644f59c550-kube-api-access-nx6jw\") pod \"cert-manager-webhook-7dc76cbb94-nzktk\" (UID: \"63ad8de5-9acb-435c-a8b7-b2644f59c550\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:18.293192 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.293124 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63ad8de5-9acb-435c-a8b7-b2644f59c550-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nzktk\" (UID: \"63ad8de5-9acb-435c-a8b7-b2644f59c550\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:18.293328 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.293298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx6jw\" (UniqueName: \"kubernetes.io/projected/63ad8de5-9acb-435c-a8b7-b2644f59c550-kube-api-access-nx6jw\") pod \"cert-manager-webhook-7dc76cbb94-nzktk\" (UID: \"63ad8de5-9acb-435c-a8b7-b2644f59c550\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:18.362911 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.362887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:18.503463 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.503361 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nzktk"] Jul 01 17:56:18.508192 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:56:18.508161 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63ad8de5_9acb_435c_a8b7_b2644f59c550.slice/crio-df6d840ef5d25b6804c09a8ffc9be2536912d5f24aeee62fbf66f980fcd27ef4 WatchSource:0}: Error finding container df6d840ef5d25b6804c09a8ffc9be2536912d5f24aeee62fbf66f980fcd27ef4: Status 404 returned error can't find the container with id df6d840ef5d25b6804c09a8ffc9be2536912d5f24aeee62fbf66f980fcd27ef4 Jul 01 17:56:18.597456 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:18.597399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" event={"ID":"63ad8de5-9acb-435c-a8b7-b2644f59c550","Type":"ContainerStarted","Data":"df6d840ef5d25b6804c09a8ffc9be2536912d5f24aeee62fbf66f980fcd27ef4"} Jul 01 17:56:21.263109 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.263072 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zss6b"] Jul 01 17:56:21.266876 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.266850 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" Jul 01 17:56:21.270512 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.270488 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mw7sv\"" Jul 01 17:56:21.294057 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.294036 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zss6b"] Jul 01 17:56:21.411795 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.411759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tqdb\" (UniqueName: \"kubernetes.io/projected/f859256c-3f5b-40bb-821b-cba8fcfce5a4-kube-api-access-9tqdb\") pod \"cert-manager-cainjector-5d99449ffd-zss6b\" (UID: \"f859256c-3f5b-40bb-821b-cba8fcfce5a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" Jul 01 17:56:21.411948 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.411818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f859256c-3f5b-40bb-821b-cba8fcfce5a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zss6b\" (UID: \"f859256c-3f5b-40bb-821b-cba8fcfce5a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" Jul 01 17:56:21.513186 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.513121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tqdb\" (UniqueName: \"kubernetes.io/projected/f859256c-3f5b-40bb-821b-cba8fcfce5a4-kube-api-access-9tqdb\") pod \"cert-manager-cainjector-5d99449ffd-zss6b\" (UID: \"f859256c-3f5b-40bb-821b-cba8fcfce5a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" Jul 01 17:56:21.513186 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.513159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f859256c-3f5b-40bb-821b-cba8fcfce5a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zss6b\" (UID: \"f859256c-3f5b-40bb-821b-cba8fcfce5a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" Jul 01 17:56:21.540984 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.540951 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f859256c-3f5b-40bb-821b-cba8fcfce5a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zss6b\" (UID: \"f859256c-3f5b-40bb-821b-cba8fcfce5a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" Jul 01 17:56:21.544416 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.544388 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tqdb\" (UniqueName: \"kubernetes.io/projected/f859256c-3f5b-40bb-821b-cba8fcfce5a4-kube-api-access-9tqdb\") pod \"cert-manager-cainjector-5d99449ffd-zss6b\" (UID: \"f859256c-3f5b-40bb-821b-cba8fcfce5a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" Jul 01 17:56:21.579219 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.579192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" Jul 01 17:56:21.720488 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:21.720417 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zss6b"] Jul 01 17:56:21.722493 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:56:21.722472 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf859256c_3f5b_40bb_821b_cba8fcfce5a4.slice/crio-025b72ff15f7f5506c1fb9f36b5d41ec312e50e7259ce8d202cb299c21c3ec92 WatchSource:0}: Error finding container 025b72ff15f7f5506c1fb9f36b5d41ec312e50e7259ce8d202cb299c21c3ec92: Status 404 returned error can't find the container with id 025b72ff15f7f5506c1fb9f36b5d41ec312e50e7259ce8d202cb299c21c3ec92 Jul 01 17:56:22.617158 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:22.617077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" event={"ID":"f859256c-3f5b-40bb-821b-cba8fcfce5a4","Type":"ContainerStarted","Data":"66809aee453cc7be9f0f334923ed04a0fa3995081ffd96d4e583037a21c9c983"} Jul 01 17:56:22.617158 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:22.617118 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" event={"ID":"f859256c-3f5b-40bb-821b-cba8fcfce5a4","Type":"ContainerStarted","Data":"025b72ff15f7f5506c1fb9f36b5d41ec312e50e7259ce8d202cb299c21c3ec92"} Jul 01 17:56:22.618628 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:22.618601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" event={"ID":"63ad8de5-9acb-435c-a8b7-b2644f59c550","Type":"ContainerStarted","Data":"66133caac350241d52cbf7fe4c35658861d481a94d5a8269c59ff71eba25a6fa"} Jul 01 17:56:22.618765 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:22.618709 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:22.639684 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:22.639643 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zss6b" podStartSLOduration=1.639630692 podStartE2EDuration="1.639630692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:56:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:56:22.638079059 +0000 UTC m=+540.702115233" watchObservedRunningTime="2026-07-01 17:56:22.639630692 +0000 UTC m=+540.703666864" Jul 01 17:56:22.662219 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:22.662178 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" podStartSLOduration=1.589631542 podStartE2EDuration="4.66216671s" totalImagesPullingTime="3.072535168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:56:22.660868003 +0000 UTC m=+540.724904198" watchObservedRunningTime="2026-07-01 17:56:22.66216671 +0000 UTC m=+540.726202876" Jul 01 17:56:28.625308 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:28.625276 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nzktk" Jul 01 17:56:37.505471 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.505436 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-sq7vx"] Jul 01 17:56:37.510108 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.510089 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-sq7vx" Jul 01 17:56:37.514020 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.514002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-j4wxk\"" Jul 01 17:56:37.526080 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.526059 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-sq7vx"] Jul 01 17:56:37.644454 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.644424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3bd4f80-3171-4e63-a5df-c256019e5ff4-bound-sa-token\") pod \"cert-manager-59c77684cc-sq7vx\" (UID: \"a3bd4f80-3171-4e63-a5df-c256019e5ff4\") " pod="cert-manager/cert-manager-59c77684cc-sq7vx" Jul 01 17:56:37.644567 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.644495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhsbk\" (UniqueName: \"kubernetes.io/projected/a3bd4f80-3171-4e63-a5df-c256019e5ff4-kube-api-access-qhsbk\") pod \"cert-manager-59c77684cc-sq7vx\" (UID: \"a3bd4f80-3171-4e63-a5df-c256019e5ff4\") " pod="cert-manager/cert-manager-59c77684cc-sq7vx" Jul 01 17:56:37.745254 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.745231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhsbk\" (UniqueName: \"kubernetes.io/projected/a3bd4f80-3171-4e63-a5df-c256019e5ff4-kube-api-access-qhsbk\") pod \"cert-manager-59c77684cc-sq7vx\" (UID: \"a3bd4f80-3171-4e63-a5df-c256019e5ff4\") " pod="cert-manager/cert-manager-59c77684cc-sq7vx" Jul 01 17:56:37.745386 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.745281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3bd4f80-3171-4e63-a5df-c256019e5ff4-bound-sa-token\") pod \"cert-manager-59c77684cc-sq7vx\" (UID: \"a3bd4f80-3171-4e63-a5df-c256019e5ff4\") " pod="cert-manager/cert-manager-59c77684cc-sq7vx" Jul 01 17:56:37.758778 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.758720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhsbk\" (UniqueName: \"kubernetes.io/projected/a3bd4f80-3171-4e63-a5df-c256019e5ff4-kube-api-access-qhsbk\") pod \"cert-manager-59c77684cc-sq7vx\" (UID: \"a3bd4f80-3171-4e63-a5df-c256019e5ff4\") " pod="cert-manager/cert-manager-59c77684cc-sq7vx" Jul 01 17:56:37.759404 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.759378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3bd4f80-3171-4e63-a5df-c256019e5ff4-bound-sa-token\") pod \"cert-manager-59c77684cc-sq7vx\" (UID: \"a3bd4f80-3171-4e63-a5df-c256019e5ff4\") " pod="cert-manager/cert-manager-59c77684cc-sq7vx" Jul 01 17:56:37.819852 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.819834 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-sq7vx" Jul 01 17:56:37.970876 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:37.970852 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-sq7vx"] Jul 01 17:56:37.973462 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:56:37.973429 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3bd4f80_3171_4e63_a5df_c256019e5ff4.slice/crio-7dc6211bce35d18ddadb3d5d670c322539971685e92bd50972bab2562ea83600 WatchSource:0}: Error finding container 7dc6211bce35d18ddadb3d5d670c322539971685e92bd50972bab2562ea83600: Status 404 returned error can't find the container with id 7dc6211bce35d18ddadb3d5d670c322539971685e92bd50972bab2562ea83600 Jul 01 17:56:38.686935 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:38.686886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-sq7vx" event={"ID":"a3bd4f80-3171-4e63-a5df-c256019e5ff4","Type":"ContainerStarted","Data":"53f35bb9d4105d20c9589ef73e274777d41f3003d022bd72c18c43e564c5f8e6"} Jul 01 17:56:38.687287 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:38.686945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-sq7vx" event={"ID":"a3bd4f80-3171-4e63-a5df-c256019e5ff4","Type":"ContainerStarted","Data":"7dc6211bce35d18ddadb3d5d670c322539971685e92bd50972bab2562ea83600"} Jul 01 17:56:38.709765 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:56:38.709716 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-sq7vx" podStartSLOduration=1.709701269 podStartE2EDuration="1.709701269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:56:38.70857602 +0000 UTC m=+556.772612208" watchObservedRunningTime="2026-07-01 17:56:38.709701269 +0000 UTC m=+556.773737441" Jul 01 17:57:00.366526 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.366488 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n"] Jul 01 17:57:00.371503 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.371481 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.378396 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.378368 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 17:57:00.379118 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.378773 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 17:57:00.379855 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.379835 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 17:57:00.379979 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.379898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rj6w8\"" Jul 01 17:57:00.415256 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.415228 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n"] Jul 01 17:57:00.416650 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.416632 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 17:57:00.425374 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.425345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee832a17-8152-4283-be66-1a18ffd3d74c-tmp\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.425499 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.425388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee832a17-8152-4283-be66-1a18ffd3d74c-webhook-cert\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.425499 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.425452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kxdt\" (UniqueName: \"kubernetes.io/projected/ee832a17-8152-4283-be66-1a18ffd3d74c-kube-api-access-9kxdt\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.425606 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.425569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee832a17-8152-4283-be66-1a18ffd3d74c-manifests\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.425655 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.425626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee832a17-8152-4283-be66-1a18ffd3d74c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.526219 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.526192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee832a17-8152-4283-be66-1a18ffd3d74c-tmp\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.526431 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.526235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee832a17-8152-4283-be66-1a18ffd3d74c-webhook-cert\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.526431 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.526299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kxdt\" (UniqueName: \"kubernetes.io/projected/ee832a17-8152-4283-be66-1a18ffd3d74c-kube-api-access-9kxdt\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.526431 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.526405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee832a17-8152-4283-be66-1a18ffd3d74c-manifests\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.526612 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.526444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee832a17-8152-4283-be66-1a18ffd3d74c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.526767 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.526739 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee832a17-8152-4283-be66-1a18ffd3d74c-manifests\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.528599 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.528572 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee832a17-8152-4283-be66-1a18ffd3d74c-tmp\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.528806 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.528787 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee832a17-8152-4283-be66-1a18ffd3d74c-webhook-cert\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.529053 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.529033 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee832a17-8152-4283-be66-1a18ffd3d74c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.539216 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.539197 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kxdt\" (UniqueName: \"kubernetes.io/projected/ee832a17-8152-4283-be66-1a18ffd3d74c-kube-api-access-9kxdt\") pod \"opendatahub-operator-controller-manager-c4bd7dbdc-g758n\" (UID: \"ee832a17-8152-4283-be66-1a18ffd3d74c\") " pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.683498 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.683409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:00.823676 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:00.823641 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n"] Jul 01 17:57:00.827366 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:00.827339 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee832a17_8152_4283_be66_1a18ffd3d74c.slice/crio-25a796d54a4cc92b31b60364fad822458b2abe7fa6b7d02ffb3acf26eeba24f4 WatchSource:0}: Error finding container 25a796d54a4cc92b31b60364fad822458b2abe7fa6b7d02ffb3acf26eeba24f4: Status 404 returned error can't find the container with id 25a796d54a4cc92b31b60364fad822458b2abe7fa6b7d02ffb3acf26eeba24f4 Jul 01 17:57:01.785506 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:01.785455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" event={"ID":"ee832a17-8152-4283-be66-1a18ffd3d74c","Type":"ContainerStarted","Data":"25a796d54a4cc92b31b60364fad822458b2abe7fa6b7d02ffb3acf26eeba24f4"} Jul 01 17:57:04.802979 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:04.802943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" event={"ID":"ee832a17-8152-4283-be66-1a18ffd3d74c","Type":"ContainerStarted","Data":"92040b49d84880cf4b2c408f476c104409a343a9d73c2c3a7e31f7630a7333f2"} Jul 01 17:57:05.809224 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:05.809191 2564 generic.go:356] "Generic (PLEG): container finished" podID="ee832a17-8152-4283-be66-1a18ffd3d74c" containerID="92040b49d84880cf4b2c408f476c104409a343a9d73c2c3a7e31f7630a7333f2" exitCode=0 Jul 01 17:57:05.809974 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:05.809255 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" event={"ID":"ee832a17-8152-4283-be66-1a18ffd3d74c","Type":"ContainerDied","Data":"92040b49d84880cf4b2c408f476c104409a343a9d73c2c3a7e31f7630a7333f2"} Jul 01 17:57:07.822626 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:07.822591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" event={"ID":"ee832a17-8152-4283-be66-1a18ffd3d74c","Type":"ContainerStarted","Data":"cc0cdfbe3098ab902d9b1d8c220d0368db2c6292524f84cae81bd2bf35ea2cb7"} Jul 01 17:57:07.823050 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:07.822725 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:07.869001 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:07.868935 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" podStartSLOduration=2.156602234 podStartE2EDuration="7.868919296s" totalImagesPullingTime="4.803869885s" totalInitContainerRuntime="908.447177ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:07.865177131 +0000 UTC m=+585.929213323" watchObservedRunningTime="2026-07-01 17:57:07.868919296 +0000 UTC m=+585.932955535" Jul 01 17:57:18.829978 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:18.829947 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c4bd7dbdc-g758n" Jul 01 17:57:22.091158 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.091116 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5687765f87-9swfl"] Jul 01 17:57:22.094664 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.094642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.097941 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.097911 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 17:57:22.098083 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.097922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-d9mr8\"" Jul 01 17:57:22.099257 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.099234 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 17:57:22.099388 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.099281 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 17:57:22.099388 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.099240 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 17:57:22.116526 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.116504 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5687765f87-9swfl"] Jul 01 17:57:22.203476 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.203455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qndqn\" (UniqueName: \"kubernetes.io/projected/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-kube-api-access-qndqn\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.203571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.203500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-tls-certs\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.203571 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.203531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-tmp\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.212389 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.212366 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wl8dp"] Jul 01 17:57:22.215628 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.215613 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:22.219594 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.219576 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 17:57:22.219827 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.219813 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cr4tx\"" Jul 01 17:57:22.230900 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.230877 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wl8dp"] Jul 01 17:57:22.304104 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.304075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-tmp\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.304208 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.304134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a558afb-ff5a-490b-ad45-e6c201c9efb9-cert\") pod \"odh-model-controller-6dc94f689f-wl8dp\" (UID: \"0a558afb-ff5a-490b-ad45-e6c201c9efb9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:22.304208 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.304190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qndqn\" (UniqueName: \"kubernetes.io/projected/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-kube-api-access-qndqn\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.304334 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.304276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-tls-certs\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.304399 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.304357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvkbp\" (UniqueName: \"kubernetes.io/projected/0a558afb-ff5a-490b-ad45-e6c201c9efb9-kube-api-access-wvkbp\") pod \"odh-model-controller-6dc94f689f-wl8dp\" (UID: \"0a558afb-ff5a-490b-ad45-e6c201c9efb9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:22.306352 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.306330 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-tmp\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.308256 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.308238 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 17:57:22.316362 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.316339 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-tls-certs\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.318640 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.318621 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 17:57:22.326922 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.326906 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 17:57:22.335737 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.335716 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qndqn\" (UniqueName: \"kubernetes.io/projected/0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2-kube-api-access-qndqn\") pod \"kube-auth-proxy-5687765f87-9swfl\" (UID: \"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2\") " pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.359566 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.359504 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:57:22.360228 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.360204 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 17:57:22.405308 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.405283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkbp\" (UniqueName: \"kubernetes.io/projected/0a558afb-ff5a-490b-ad45-e6c201c9efb9-kube-api-access-wvkbp\") pod \"odh-model-controller-6dc94f689f-wl8dp\" (UID: \"0a558afb-ff5a-490b-ad45-e6c201c9efb9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:22.405421 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.405338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a558afb-ff5a-490b-ad45-e6c201c9efb9-cert\") pod \"odh-model-controller-6dc94f689f-wl8dp\" (UID: \"0a558afb-ff5a-490b-ad45-e6c201c9efb9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:22.408125 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.408110 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-d9mr8\"" Jul 01 17:57:22.409191 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.409179 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 17:57:22.415678 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:57:22.415665 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 17:57:22.415733 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.415681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" Jul 01 17:57:22.415733 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:57:22.415712 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a558afb-ff5a-490b-ad45-e6c201c9efb9-cert podName:0a558afb-ff5a-490b-ad45-e6c201c9efb9 nodeName:}" failed. No retries permitted until 2026-07-01 17:57:22.915697914 +0000 UTC m=+600.979734065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0a558afb-ff5a-490b-ad45-e6c201c9efb9-cert") pod "odh-model-controller-6dc94f689f-wl8dp" (UID: "0a558afb-ff5a-490b-ad45-e6c201c9efb9") : secret "odh-model-controller-webhook-cert" not found Jul 01 17:57:22.433809 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.433782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkbp\" (UniqueName: \"kubernetes.io/projected/0a558afb-ff5a-490b-ad45-e6c201c9efb9-kube-api-access-wvkbp\") pod \"odh-model-controller-6dc94f689f-wl8dp\" (UID: \"0a558afb-ff5a-490b-ad45-e6c201c9efb9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:22.573575 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:22.573546 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffbdf13_c3ac_43d9_9cf9_3c86dbd527d2.slice/crio-f51bbdace735bbaa661398f20e13ba9825fe71a1e8d7c96ac605157258e7b6fe WatchSource:0}: Error finding container f51bbdace735bbaa661398f20e13ba9825fe71a1e8d7c96ac605157258e7b6fe: Status 404 returned error can't find the container with id f51bbdace735bbaa661398f20e13ba9825fe71a1e8d7c96ac605157258e7b6fe Jul 01 17:57:22.574332 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.574294 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5687765f87-9swfl"] Jul 01 17:57:22.892300 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:22.892271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" event={"ID":"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2","Type":"ContainerStarted","Data":"f51bbdace735bbaa661398f20e13ba9825fe71a1e8d7c96ac605157258e7b6fe"} Jul 01 17:57:23.010528 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.010502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a558afb-ff5a-490b-ad45-e6c201c9efb9-cert\") pod \"odh-model-controller-6dc94f689f-wl8dp\" (UID: \"0a558afb-ff5a-490b-ad45-e6c201c9efb9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:23.012889 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.012862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a558afb-ff5a-490b-ad45-e6c201c9efb9-cert\") pod \"odh-model-controller-6dc94f689f-wl8dp\" (UID: \"0a558afb-ff5a-490b-ad45-e6c201c9efb9\") " pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:23.128636 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.128611 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cr4tx\"" Jul 01 17:57:23.136388 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.136371 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:23.298422 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.298389 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-kbcpr"] Jul 01 17:57:23.302150 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.302127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:23.305289 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.305268 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wl8dp"] Jul 01 17:57:23.305951 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.305929 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 17:57:23.307631 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:23.307606 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a558afb_ff5a_490b_ad45_e6c201c9efb9.slice/crio-b09472d3c6d3c5f288991b6420c34b5b0de969018f8e1e95e0da993e1a201a01 WatchSource:0}: Error finding container b09472d3c6d3c5f288991b6420c34b5b0de969018f8e1e95e0da993e1a201a01: Status 404 returned error can't find the container with id b09472d3c6d3c5f288991b6420c34b5b0de969018f8e1e95e0da993e1a201a01 Jul 01 17:57:23.345838 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.345810 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-kbcpr"] Jul 01 17:57:23.414013 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.413950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dshxl\" (UniqueName: \"kubernetes.io/projected/b72297d0-2b31-4966-af30-ef8268402378-kube-api-access-dshxl\") pod \"model-serving-api-5dd488fc48-kbcpr\" (UID: \"b72297d0-2b31-4966-af30-ef8268402378\") " pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:23.414013 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.413985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b72297d0-2b31-4966-af30-ef8268402378-tls-certs\") pod \"model-serving-api-5dd488fc48-kbcpr\" (UID: \"b72297d0-2b31-4966-af30-ef8268402378\") " pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:23.515370 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.515231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b72297d0-2b31-4966-af30-ef8268402378-tls-certs\") pod \"model-serving-api-5dd488fc48-kbcpr\" (UID: \"b72297d0-2b31-4966-af30-ef8268402378\") " pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:23.515575 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:57:23.515385 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 01 17:57:23.515575 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.515412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dshxl\" (UniqueName: \"kubernetes.io/projected/b72297d0-2b31-4966-af30-ef8268402378-kube-api-access-dshxl\") pod \"model-serving-api-5dd488fc48-kbcpr\" (UID: \"b72297d0-2b31-4966-af30-ef8268402378\") " pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:23.515575 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:57:23.515451 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72297d0-2b31-4966-af30-ef8268402378-tls-certs podName:b72297d0-2b31-4966-af30-ef8268402378 nodeName:}" failed. No retries permitted until 2026-07-01 17:57:24.015428919 +0000 UTC m=+602.079465074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b72297d0-2b31-4966-af30-ef8268402378-tls-certs") pod "model-serving-api-5dd488fc48-kbcpr" (UID: "b72297d0-2b31-4966-af30-ef8268402378") : secret "model-serving-api-tls" not found Jul 01 17:57:23.546859 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.546830 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dshxl\" (UniqueName: \"kubernetes.io/projected/b72297d0-2b31-4966-af30-ef8268402378-kube-api-access-dshxl\") pod \"model-serving-api-5dd488fc48-kbcpr\" (UID: \"b72297d0-2b31-4966-af30-ef8268402378\") " pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:23.897617 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:23.897582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" event={"ID":"0a558afb-ff5a-490b-ad45-e6c201c9efb9","Type":"ContainerStarted","Data":"b09472d3c6d3c5f288991b6420c34b5b0de969018f8e1e95e0da993e1a201a01"} Jul 01 17:57:24.023583 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.023549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b72297d0-2b31-4966-af30-ef8268402378-tls-certs\") pod \"model-serving-api-5dd488fc48-kbcpr\" (UID: \"b72297d0-2b31-4966-af30-ef8268402378\") " pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:24.025999 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.025970 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b72297d0-2b31-4966-af30-ef8268402378-tls-certs\") pod \"model-serving-api-5dd488fc48-kbcpr\" (UID: \"b72297d0-2b31-4966-af30-ef8268402378\") " pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:24.118635 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.118604 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ct27c"] Jul 01 17:57:24.122598 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.122571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.130824 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.130802 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 17:57:24.131206 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.131083 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-29l8z\"" Jul 01 17:57:24.131206 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.131195 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 17:57:24.131438 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.131273 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 17:57:24.132433 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.132411 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 17:57:24.163110 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.163046 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ct27c"] Jul 01 17:57:24.225119 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.225090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-cacerts\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.225119 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.225117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9kh\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-kube-api-access-vz9kh\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.225306 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.225155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.225306 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.225236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-local-certs\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.225306 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.225289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-token\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.225472 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.225342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.225472 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.225373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.231022 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.231001 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:24.326051 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.326019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-cacerts\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.326985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.326070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9kh\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-kube-api-access-vz9kh\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.326985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.326150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.326985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.326199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-local-certs\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.326985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.326242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-token\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.326985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.326267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.326985 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.326295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.328373 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.328090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.333245 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.333219 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-cacerts\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.333927 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.333836 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-local-certs\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.333927 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.333905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.336208 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.336089 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.349430 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.349378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-token\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.362102 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.362075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9kh\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-kube-api-access-vz9kh\") pod \"istiod-openshift-gateway-7574459656-ct27c\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.396732 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.396709 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-kbcpr"] Jul 01 17:57:24.399452 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:24.399412 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72297d0_2b31_4966_af30_ef8268402378.slice/crio-e65c9466666357ff5f29f2ff7b40e1a9925fc6521cdc32eb49c014596f6a4fbc WatchSource:0}: Error finding container e65c9466666357ff5f29f2ff7b40e1a9925fc6521cdc32eb49c014596f6a4fbc: Status 404 returned error can't find the container with id e65c9466666357ff5f29f2ff7b40e1a9925fc6521cdc32eb49c014596f6a4fbc Jul 01 17:57:24.433776 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.433705 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:24.619381 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.619357 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ct27c"] Jul 01 17:57:24.621385 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:24.621362 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98fdd63_c3f5_43d2_a8f7_03425f561bdb.slice/crio-38c571fe26f4688f57d641dc50b64880d4c08e8b0f0adf7539de8bdb63c6b740 WatchSource:0}: Error finding container 38c571fe26f4688f57d641dc50b64880d4c08e8b0f0adf7539de8bdb63c6b740: Status 404 returned error can't find the container with id 38c571fe26f4688f57d641dc50b64880d4c08e8b0f0adf7539de8bdb63c6b740 Jul 01 17:57:24.903330 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.903290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" event={"ID":"b98fdd63-c3f5-43d2-a8f7-03425f561bdb","Type":"ContainerStarted","Data":"38c571fe26f4688f57d641dc50b64880d4c08e8b0f0adf7539de8bdb63c6b740"} Jul 01 17:57:24.904472 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:24.904448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" event={"ID":"b72297d0-2b31-4966-af30-ef8268402378","Type":"ContainerStarted","Data":"e65c9466666357ff5f29f2ff7b40e1a9925fc6521cdc32eb49c014596f6a4fbc"} Jul 01 17:57:25.361526 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.360984 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-65c88f69c5-jmppq"] Jul 01 17:57:25.370977 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.370951 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" Jul 01 17:57:25.374473 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.374448 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-b855k\"" Jul 01 17:57:25.374784 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.374582 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 17:57:25.380425 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.380404 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-65c88f69c5-jmppq"] Jul 01 17:57:25.538617 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.538583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d98176db-ea3e-49cf-bfc5-cadb385ff6dc-redirect-config\") pod \"dashboard-redirect-65c88f69c5-jmppq\" (UID: \"d98176db-ea3e-49cf-bfc5-cadb385ff6dc\") " pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" Jul 01 17:57:25.538793 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.538651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4rgh\" (UniqueName: \"kubernetes.io/projected/d98176db-ea3e-49cf-bfc5-cadb385ff6dc-kube-api-access-c4rgh\") pod \"dashboard-redirect-65c88f69c5-jmppq\" (UID: \"d98176db-ea3e-49cf-bfc5-cadb385ff6dc\") " pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" Jul 01 17:57:25.639997 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.639923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d98176db-ea3e-49cf-bfc5-cadb385ff6dc-redirect-config\") pod \"dashboard-redirect-65c88f69c5-jmppq\" (UID: \"d98176db-ea3e-49cf-bfc5-cadb385ff6dc\") " pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" Jul 01 17:57:25.639997 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.639991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4rgh\" (UniqueName: \"kubernetes.io/projected/d98176db-ea3e-49cf-bfc5-cadb385ff6dc-kube-api-access-c4rgh\") pod \"dashboard-redirect-65c88f69c5-jmppq\" (UID: \"d98176db-ea3e-49cf-bfc5-cadb385ff6dc\") " pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" Jul 01 17:57:25.641166 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.641116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d98176db-ea3e-49cf-bfc5-cadb385ff6dc-redirect-config\") pod \"dashboard-redirect-65c88f69c5-jmppq\" (UID: \"d98176db-ea3e-49cf-bfc5-cadb385ff6dc\") " pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" Jul 01 17:57:25.654374 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.654303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4rgh\" (UniqueName: \"kubernetes.io/projected/d98176db-ea3e-49cf-bfc5-cadb385ff6dc-kube-api-access-c4rgh\") pod \"dashboard-redirect-65c88f69c5-jmppq\" (UID: \"d98176db-ea3e-49cf-bfc5-cadb385ff6dc\") " pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" Jul 01 17:57:25.686426 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.686199 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" Jul 01 17:57:25.855184 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.855160 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 17:57:25.960121 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:25.960092 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-65c88f69c5-jmppq"] Jul 01 17:57:26.923743 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:26.923696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" event={"ID":"0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2","Type":"ContainerStarted","Data":"f3c122434c791311395a33545e2bd4e42f7f3ec4293b2bfabe59c07f6dc702ab"} Jul 01 17:57:27.270105 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:27.270065 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98176db_ea3e_49cf_bfc5_cadb385ff6dc.slice/crio-797aeb0650f667e0c55e2a7880d4f2deb57d8f05ede5d16da8ccaa8779c550aa WatchSource:0}: Error finding container 797aeb0650f667e0c55e2a7880d4f2deb57d8f05ede5d16da8ccaa8779c550aa: Status 404 returned error can't find the container with id 797aeb0650f667e0c55e2a7880d4f2deb57d8f05ede5d16da8ccaa8779c550aa Jul 01 17:57:27.930034 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:27.930003 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" event={"ID":"d98176db-ea3e-49cf-bfc5-cadb385ff6dc","Type":"ContainerStarted","Data":"797aeb0650f667e0c55e2a7880d4f2deb57d8f05ede5d16da8ccaa8779c550aa"} Jul 01 17:57:29.666099 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.666057 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 17:57:29.666457 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.666149 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 17:57:29.944483 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.944387 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" event={"ID":"b72297d0-2b31-4966-af30-ef8268402378","Type":"ContainerStarted","Data":"d7f21b3236ba580e97f29a7761f2259181881a2b3478f109c06edf090878bd06"} Jul 01 17:57:29.944695 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.944663 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:29.946788 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.946761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" event={"ID":"b98fdd63-c3f5-43d2-a8f7-03425f561bdb","Type":"ContainerStarted","Data":"10061790bad3fa8a61dac8158f943294d8aa52aa3211e06b5e2e8992fa883329"} Jul 01 17:57:29.947431 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.947357 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:29.949662 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.949637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" event={"ID":"0a558afb-ff5a-490b-ad45-e6c201c9efb9","Type":"ContainerStarted","Data":"7bdea088b00334cdf16ac6b8d14c7a0a4079d84af37da474a4a26a95c1128a8a"} Jul 01 17:57:29.949750 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.949706 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:29.977925 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.977863 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5687765f87-9swfl" podStartSLOduration=4.702899768 podStartE2EDuration="7.977841638s" totalImagesPullingTime="3.27494187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:26.959370651 +0000 UTC m=+605.023406845" watchObservedRunningTime="2026-07-01 17:57:29.977841638 +0000 UTC m=+608.041877812" Jul 01 17:57:29.978441 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:29.978406 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" podStartSLOduration=1.723427199 podStartE2EDuration="6.978394946s" totalImagesPullingTime="5.254967747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:29.975706891 +0000 UTC m=+608.039743065" watchObservedRunningTime="2026-07-01 17:57:29.978394946 +0000 UTC m=+608.042431117" Jul 01 17:57:30.011461 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:30.011393 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" podStartSLOduration=1.646744865 podStartE2EDuration="8.011372575s" totalImagesPullingTime="6.36462771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:30.009145954 +0000 UTC m=+608.073182128" watchObservedRunningTime="2026-07-01 17:57:30.011372575 +0000 UTC m=+608.075408766" Jul 01 17:57:30.051214 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:30.050006 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" podStartSLOduration=1.007638826 podStartE2EDuration="6.049988601s" totalImagesPullingTime="5.042349775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:30.048074 +0000 UTC m=+608.112110173" watchObservedRunningTime="2026-07-01 17:57:30.049988601 +0000 UTC m=+608.114024782" Jul 01 17:57:30.959893 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:30.959818 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ct27c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 17:57:30.960426 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:30.959908 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" podUID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:57:31.966982 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:31.966570 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ct27c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 17:57:31.966982 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:31.966628 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" podUID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:57:33.247521 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.247489 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9"] Jul 01 17:57:33.253660 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.253633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.301793 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.301744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6z5c9\"" Jul 01 17:57:33.320544 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.320513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.320713 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.320556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.320713 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.320612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfjnb\" (UniqueName: \"kubernetes.io/projected/0db15620-2b49-44c3-b00b-79e6d67415cd-kube-api-access-zfjnb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.320713 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.320700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.320885 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.320758 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.321045 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.320887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.321045 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.320949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.321045 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.320976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0db15620-2b49-44c3-b00b-79e6d67415cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.321222 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.321020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.333167 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.333134 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9"] Jul 01 17:57:33.422303 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0db15620-2b49-44c3-b00b-79e6d67415cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422753 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfjnb\" (UniqueName: \"kubernetes.io/projected/0db15620-2b49-44c3-b00b-79e6d67415cd-kube-api-access-zfjnb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422753 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422753 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.422912 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.422870 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.423295 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.423264 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0db15620-2b49-44c3-b00b-79e6d67415cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.423452 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.423352 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.423452 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.423279 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.423452 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.423266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.424996 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.424970 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.425237 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.425215 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.450744 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.450707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfjnb\" (UniqueName: \"kubernetes.io/projected/0db15620-2b49-44c3-b00b-79e6d67415cd-kube-api-access-zfjnb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.490046 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.490015 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0db15620-2b49-44c3-b00b-79e6d67415cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zqx9\" (UID: \"0db15620-2b49-44c3-b00b-79e6d67415cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.568292 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.568223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:33.838879 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.838797 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9"] Jul 01 17:57:33.843884 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:33.843855 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db15620_2b49_44c3_b00b_79e6d67415cd.slice/crio-a62caf26792d34379b1402d767efc0421565698381e28986870db51ef837964b WatchSource:0}: Error finding container a62caf26792d34379b1402d767efc0421565698381e28986870db51ef837964b: Status 404 returned error can't find the container with id a62caf26792d34379b1402d767efc0421565698381e28986870db51ef837964b Jul 01 17:57:33.983214 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.983169 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" event={"ID":"0db15620-2b49-44c3-b00b-79e6d67415cd","Type":"ContainerStarted","Data":"a62caf26792d34379b1402d767efc0421565698381e28986870db51ef837964b"} Jul 01 17:57:33.985024 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:33.984978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" event={"ID":"d98176db-ea3e-49cf-bfc5-cadb385ff6dc","Type":"ContainerStarted","Data":"c8ed574df82e448fc121d7355829c4bc51bcf3816c6b7aea1dfc8d4ae153481c"} Jul 01 17:57:34.045722 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.045657 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-65c88f69c5-jmppq" podStartSLOduration=2.669366938 podStartE2EDuration="9.045637547s" totalImagesPullingTime="6.376270609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:34.041698272 +0000 UTC m=+612.105734467" watchObservedRunningTime="2026-07-01 17:57:34.045637547 +0000 UTC m=+612.109673720" Jul 01 17:57:34.301484 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.301453 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zspw7"] Jul 01 17:57:34.306329 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.306291 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb"] Jul 01 17:57:34.306456 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.306407 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:34.309670 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.309649 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:34.317128 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.317105 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 01 17:57:34.317761 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.317742 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 01 17:57:34.318597 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.318577 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5c8z2\"" Jul 01 17:57:34.319260 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.319037 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-npwsf\"" Jul 01 17:57:34.327378 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.327355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zspw7"] Jul 01 17:57:34.330736 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.330714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs67b\" (UniqueName: \"kubernetes.io/projected/40a55f29-735b-4706-9f40-482edbcad9cf-kube-api-access-qs67b\") pod \"kserve-controller-manager-69fc866d76-zspw7\" (UID: \"40a55f29-735b-4706-9f40-482edbcad9cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:34.330814 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.330757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40a55f29-735b-4706-9f40-482edbcad9cf-cert\") pod \"kserve-controller-manager-69fc866d76-zspw7\" (UID: \"40a55f29-735b-4706-9f40-482edbcad9cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:34.330814 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.330810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf06a901-b779-4407-92a8-085417d78af0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lpdzb\" (UID: \"cf06a901-b779-4407-92a8-085417d78af0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:34.330889 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.330826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc69k\" (UniqueName: \"kubernetes.io/projected/cf06a901-b779-4407-92a8-085417d78af0-kube-api-access-zc69k\") pod \"llmisvc-controller-manager-864bfd7bc9-lpdzb\" (UID: \"cf06a901-b779-4407-92a8-085417d78af0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:34.339193 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.339167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb"] Jul 01 17:57:34.431692 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.431666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs67b\" (UniqueName: \"kubernetes.io/projected/40a55f29-735b-4706-9f40-482edbcad9cf-kube-api-access-qs67b\") pod \"kserve-controller-manager-69fc866d76-zspw7\" (UID: \"40a55f29-735b-4706-9f40-482edbcad9cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:34.431821 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.431708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40a55f29-735b-4706-9f40-482edbcad9cf-cert\") pod \"kserve-controller-manager-69fc866d76-zspw7\" (UID: \"40a55f29-735b-4706-9f40-482edbcad9cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:34.431821 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.431751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf06a901-b779-4407-92a8-085417d78af0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lpdzb\" (UID: \"cf06a901-b779-4407-92a8-085417d78af0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:34.431821 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.431776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc69k\" (UniqueName: \"kubernetes.io/projected/cf06a901-b779-4407-92a8-085417d78af0-kube-api-access-zc69k\") pod \"llmisvc-controller-manager-864bfd7bc9-lpdzb\" (UID: \"cf06a901-b779-4407-92a8-085417d78af0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:34.434248 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.434228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40a55f29-735b-4706-9f40-482edbcad9cf-cert\") pod \"kserve-controller-manager-69fc866d76-zspw7\" (UID: \"40a55f29-735b-4706-9f40-482edbcad9cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:34.434473 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.434451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf06a901-b779-4407-92a8-085417d78af0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lpdzb\" (UID: \"cf06a901-b779-4407-92a8-085417d78af0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:34.441455 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.441434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc69k\" (UniqueName: \"kubernetes.io/projected/cf06a901-b779-4407-92a8-085417d78af0-kube-api-access-zc69k\") pod \"llmisvc-controller-manager-864bfd7bc9-lpdzb\" (UID: \"cf06a901-b779-4407-92a8-085417d78af0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:34.443520 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.443499 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs67b\" (UniqueName: \"kubernetes.io/projected/40a55f29-735b-4706-9f40-482edbcad9cf-kube-api-access-qs67b\") pod \"kserve-controller-manager-69fc866d76-zspw7\" (UID: \"40a55f29-735b-4706-9f40-482edbcad9cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:34.617141 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.617064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:34.628439 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.628303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:34.821858 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:34.821813 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a55f29_735b_4706_9f40_482edbcad9cf.slice/crio-a842320ac3c56fadba047071dc2f3f42b3f62a4ac57151b6c3894e86753a35e3 WatchSource:0}: Error finding container a842320ac3c56fadba047071dc2f3f42b3f62a4ac57151b6c3894e86753a35e3: Status 404 returned error can't find the container with id a842320ac3c56fadba047071dc2f3f42b3f62a4ac57151b6c3894e86753a35e3 Jul 01 17:57:34.834066 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:57:34.834040 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf06a901_b779_4407_92a8_085417d78af0.slice/crio-1d46cd8f0d1b61f674fe28fb7d5db9e9f63786d05027bb4d8f7a77c81e725617 WatchSource:0}: Error finding container 1d46cd8f0d1b61f674fe28fb7d5db9e9f63786d05027bb4d8f7a77c81e725617: Status 404 returned error can't find the container with id 1d46cd8f0d1b61f674fe28fb7d5db9e9f63786d05027bb4d8f7a77c81e725617 Jul 01 17:57:34.955445 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.955377 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zspw7"] Jul 01 17:57:34.956988 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.956963 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb"] Jul 01 17:57:34.967179 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.967159 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:34.991430 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.991408 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" event={"ID":"cf06a901-b779-4407-92a8-085417d78af0","Type":"ContainerStarted","Data":"1d46cd8f0d1b61f674fe28fb7d5db9e9f63786d05027bb4d8f7a77c81e725617"} Jul 01 17:57:34.992542 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:34.992512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" event={"ID":"40a55f29-735b-4706-9f40-482edbcad9cf","Type":"ContainerStarted","Data":"a842320ac3c56fadba047071dc2f3f42b3f62a4ac57151b6c3894e86753a35e3"} Jul 01 17:57:37.647827 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:37.647790 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ct27c"] Jul 01 17:57:37.648257 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:37.648001 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" podUID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" containerName="discovery" containerID="cri-o://10061790bad3fa8a61dac8158f943294d8aa52aa3211e06b5e2e8992fa883329" gracePeriod=30 Jul 01 17:57:38.016451 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.016418 2564 generic.go:356] "Generic (PLEG): container finished" podID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" containerID="10061790bad3fa8a61dac8158f943294d8aa52aa3211e06b5e2e8992fa883329" exitCode=0 Jul 01 17:57:38.016597 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.016483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" event={"ID":"b98fdd63-c3f5-43d2-a8f7-03425f561bdb","Type":"ContainerDied","Data":"10061790bad3fa8a61dac8158f943294d8aa52aa3211e06b5e2e8992fa883329"} Jul 01 17:57:38.459359 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.459331 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:38.471157 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.471130 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz9kh\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-kube-api-access-vz9kh\") pod \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " Jul 01 17:57:38.471281 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.471217 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-cacerts\") pod \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " Jul 01 17:57:38.471281 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.471269 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-local-certs\") pod \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " Jul 01 17:57:38.471406 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.471338 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-dns-cert\") pod \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " Jul 01 17:57:38.471406 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.471402 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-ca-configmap\") pod \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " Jul 01 17:57:38.471513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.471463 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-token\") pod \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " Jul 01 17:57:38.471513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.471493 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-kubeconfig\") pod \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\" (UID: \"b98fdd63-c3f5-43d2-a8f7-03425f561bdb\") " Jul 01 17:57:38.472164 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.471910 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b98fdd63-c3f5-43d2-a8f7-03425f561bdb" (UID: "b98fdd63-c3f5-43d2-a8f7-03425f561bdb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:57:38.473962 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.473929 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b98fdd63-c3f5-43d2-a8f7-03425f561bdb" (UID: "b98fdd63-c3f5-43d2-a8f7-03425f561bdb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:57:38.473962 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.473948 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-cacerts" (OuterVolumeSpecName: "cacerts") pod "b98fdd63-c3f5-43d2-a8f7-03425f561bdb" (UID: "b98fdd63-c3f5-43d2-a8f7-03425f561bdb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:57:38.474151 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.473958 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-token" (OuterVolumeSpecName: "istio-token") pod "b98fdd63-c3f5-43d2-a8f7-03425f561bdb" (UID: "b98fdd63-c3f5-43d2-a8f7-03425f561bdb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:57:38.474382 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.474361 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-local-certs" (OuterVolumeSpecName: "local-certs") pod "b98fdd63-c3f5-43d2-a8f7-03425f561bdb" (UID: "b98fdd63-c3f5-43d2-a8f7-03425f561bdb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:57:38.474538 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.474518 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-kube-api-access-vz9kh" (OuterVolumeSpecName: "kube-api-access-vz9kh") pod "b98fdd63-c3f5-43d2-a8f7-03425f561bdb" (UID: "b98fdd63-c3f5-43d2-a8f7-03425f561bdb"). InnerVolumeSpecName "kube-api-access-vz9kh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:57:38.474632 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.474613 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b98fdd63-c3f5-43d2-a8f7-03425f561bdb" (UID: "b98fdd63-c3f5-43d2-a8f7-03425f561bdb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:57:38.572880 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.572847 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:57:38.572880 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.572880 2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-kubeconfig\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:57:38.573092 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.572893 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz9kh\" (UniqueName: \"kubernetes.io/projected/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-kube-api-access-vz9kh\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:57:38.573092 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.572903 2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-cacerts\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:57:38.573092 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.572911 2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-local-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:57:38.573092 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.572920 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-dns-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:57:38.573092 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:38.572932 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b98fdd63-c3f5-43d2-a8f7-03425f561bdb-istio-csr-ca-configmap\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:57:39.005225 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:39.004846 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 17:57:39.005225 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:39.004915 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 17:57:39.005225 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:39.004942 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 17:57:39.022010 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:39.021991 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" Jul 01 17:57:39.022094 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:39.022024 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" event={"ID":"b98fdd63-c3f5-43d2-a8f7-03425f561bdb","Type":"ContainerDied","Data":"38c571fe26f4688f57d641dc50b64880d4c08e8b0f0adf7539de8bdb63c6b740"} Jul 01 17:57:39.022094 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:39.022091 2564 scope.go:117] "RemoveContainer" containerID="10061790bad3fa8a61dac8158f943294d8aa52aa3211e06b5e2e8992fa883329" Jul 01 17:57:39.052501 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:39.051985 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ct27c"] Jul 01 17:57:39.053899 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:39.053879 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ct27c"] Jul 01 17:57:40.029376 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.029340 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" event={"ID":"40a55f29-735b-4706-9f40-482edbcad9cf","Type":"ContainerStarted","Data":"b31a6602d0d24028ba8694341888728b65e2f0d35286f08ed4aedf7381711cc5"} Jul 01 17:57:40.029813 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.029407 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:57:40.030874 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.030851 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" event={"ID":"0db15620-2b49-44c3-b00b-79e6d67415cd","Type":"ContainerStarted","Data":"ef1606b4324d5c0fa7288aad2909a25dcaa2d7e64c690c0da747e8b335463c44"} Jul 01 17:57:40.032194 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.032175 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" event={"ID":"cf06a901-b779-4407-92a8-085417d78af0","Type":"ContainerStarted","Data":"6d91697c6e0bd44d550aec37e69bc53d5075f96cef2ff1239299b6c5059166a2"} Jul 01 17:57:40.032301 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.032287 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:57:40.113949 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.113906 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" podStartSLOduration=1.930607179 podStartE2EDuration="6.11389298s" totalImagesPullingTime="4.183285801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:40.106036797 +0000 UTC m=+618.170072982" watchObservedRunningTime="2026-07-01 17:57:40.11389298 +0000 UTC m=+618.177929153" Jul 01 17:57:40.190203 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.190164 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" podStartSLOduration=1.970629045 podStartE2EDuration="6.190152731s" totalImagesPullingTime="4.219523686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:40.153226611 +0000 UTC m=+618.217262784" watchObservedRunningTime="2026-07-01 17:57:40.190152731 +0000 UTC m=+618.254188904" Jul 01 17:57:40.383656 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.383590 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" path="/var/lib/kubelet/pods/b98fdd63-c3f5-43d2-a8f7-03425f561bdb/volumes" Jul 01 17:57:40.569369 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.569339 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:40.573892 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.573871 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:40.616792 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.616750 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" podStartSLOduration=2.458288159 podStartE2EDuration="7.616736581s" totalImagesPullingTime="5.158448422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:57:40.191288125 +0000 UTC m=+618.255324299" watchObservedRunningTime="2026-07-01 17:57:40.616736581 +0000 UTC m=+618.680772754" Jul 01 17:57:40.960519 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.960493 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-wl8dp" Jul 01 17:57:40.962889 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:40.962865 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-kbcpr" Jul 01 17:57:41.038079 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:41.038052 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:41.038948 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:41.038929 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zqx9" Jul 01 17:57:42.967452 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:42.967418 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ct27c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 01 17:57:42.967909 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:57:42.967472 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ct27c" podUID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.29:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 01 17:58:11.039866 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:11.039773 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpdzb" Jul 01 17:58:11.042899 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:11.042880 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-zspw7" Jul 01 17:58:22.691543 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.691467 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hzvwq"] Jul 01 17:58:22.691873 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.691858 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" containerName="discovery" Jul 01 17:58:22.691873 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.691871 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" containerName="discovery" Jul 01 17:58:22.691942 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.691936 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b98fdd63-c3f5-43d2-a8f7-03425f561bdb" containerName="discovery" Jul 01 17:58:22.694611 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.694591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" Jul 01 17:58:22.697599 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.697573 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 17:58:22.699069 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.699044 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 17:58:22.699232 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.699083 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6md6r\"" Jul 01 17:58:22.709180 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.709129 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hzvwq"] Jul 01 17:58:22.825485 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.825450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgzx4\" (UniqueName: \"kubernetes.io/projected/20ada75a-7f46-4055-926e-b5c6bbc06c6a-kube-api-access-jgzx4\") pod \"kuadrant-operator-catalog-hzvwq\" (UID: \"20ada75a-7f46-4055-926e-b5c6bbc06c6a\") " pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" Jul 01 17:58:22.926149 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.926121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgzx4\" (UniqueName: \"kubernetes.io/projected/20ada75a-7f46-4055-926e-b5c6bbc06c6a-kube-api-access-jgzx4\") pod \"kuadrant-operator-catalog-hzvwq\" (UID: \"20ada75a-7f46-4055-926e-b5c6bbc06c6a\") " pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" Jul 01 17:58:22.936764 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:22.936745 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgzx4\" (UniqueName: \"kubernetes.io/projected/20ada75a-7f46-4055-926e-b5c6bbc06c6a-kube-api-access-jgzx4\") pod \"kuadrant-operator-catalog-hzvwq\" (UID: \"20ada75a-7f46-4055-926e-b5c6bbc06c6a\") " pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" Jul 01 17:58:23.008429 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.008404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" Jul 01 17:58:23.036489 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.036463 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hzvwq"] Jul 01 17:58:23.139378 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.139357 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hzvwq"] Jul 01 17:58:23.141512 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:58:23.141482 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ada75a_7f46_4055_926e_b5c6bbc06c6a.slice/crio-6cd2013f9e1734025579e432168bde3d4a7f72a63c7ad3b80aa1791e471447c5 WatchSource:0}: Error finding container 6cd2013f9e1734025579e432168bde3d4a7f72a63c7ad3b80aa1791e471447c5: Status 404 returned error can't find the container with id 6cd2013f9e1734025579e432168bde3d4a7f72a63c7ad3b80aa1791e471447c5 Jul 01 17:58:23.247150 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.247119 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lfh2s"] Jul 01 17:58:23.250474 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.250459 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:23.258023 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.257995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" event={"ID":"20ada75a-7f46-4055-926e-b5c6bbc06c6a","Type":"ContainerStarted","Data":"6cd2013f9e1734025579e432168bde3d4a7f72a63c7ad3b80aa1791e471447c5"} Jul 01 17:58:23.282600 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.282550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lfh2s"] Jul 01 17:58:23.329891 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.329871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqqw\" (UniqueName: \"kubernetes.io/projected/adaa9907-3966-42a7-aa01-30032ded90c6-kube-api-access-vvqqw\") pod \"kuadrant-operator-catalog-lfh2s\" (UID: \"adaa9907-3966-42a7-aa01-30032ded90c6\") " pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:23.430719 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.430662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqqw\" (UniqueName: \"kubernetes.io/projected/adaa9907-3966-42a7-aa01-30032ded90c6-kube-api-access-vvqqw\") pod \"kuadrant-operator-catalog-lfh2s\" (UID: \"adaa9907-3966-42a7-aa01-30032ded90c6\") " pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:23.442233 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.442210 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqqw\" (UniqueName: \"kubernetes.io/projected/adaa9907-3966-42a7-aa01-30032ded90c6-kube-api-access-vvqqw\") pod \"kuadrant-operator-catalog-lfh2s\" (UID: \"adaa9907-3966-42a7-aa01-30032ded90c6\") " pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:23.560343 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.560267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:23.690434 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:23.690405 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lfh2s"] Jul 01 17:58:23.692101 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:58:23.692077 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadaa9907_3966_42a7_aa01_30032ded90c6.slice/crio-2314f8047cd458b7694bed79a4783b46506f3e8da5ffc85b5b7bf9fa57b7a7c4 WatchSource:0}: Error finding container 2314f8047cd458b7694bed79a4783b46506f3e8da5ffc85b5b7bf9fa57b7a7c4: Status 404 returned error can't find the container with id 2314f8047cd458b7694bed79a4783b46506f3e8da5ffc85b5b7bf9fa57b7a7c4 Jul 01 17:58:24.264383 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:24.264351 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" event={"ID":"adaa9907-3966-42a7-aa01-30032ded90c6","Type":"ContainerStarted","Data":"2314f8047cd458b7694bed79a4783b46506f3e8da5ffc85b5b7bf9fa57b7a7c4"} Jul 01 17:58:26.277169 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.277132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" event={"ID":"20ada75a-7f46-4055-926e-b5c6bbc06c6a","Type":"ContainerStarted","Data":"aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f"} Jul 01 17:58:26.277169 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.277150 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" podUID="20ada75a-7f46-4055-926e-b5c6bbc06c6a" containerName="registry-server" containerID="cri-o://aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f" gracePeriod=2 Jul 01 17:58:26.278795 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.278766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" event={"ID":"adaa9907-3966-42a7-aa01-30032ded90c6","Type":"ContainerStarted","Data":"93a02f9bfa78c2ecf259d8cd192fe0593faac36603e2d83d0f9be3678722c390"} Jul 01 17:58:26.296923 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.296886 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" podStartSLOduration=1.778272729 podStartE2EDuration="4.29687362s" totalImagesPullingTime="2.518600891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:58:26.296205876 +0000 UTC m=+664.360242068" watchObservedRunningTime="2026-07-01 17:58:26.29687362 +0000 UTC m=+664.360909818" Jul 01 17:58:26.316364 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.316305 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" podStartSLOduration=1.3531169730000001 podStartE2EDuration="3.316291831s" totalImagesPullingTime="1.963174858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:58:26.31546663 +0000 UTC m=+664.379502804" watchObservedRunningTime="2026-07-01 17:58:26.316291831 +0000 UTC m=+664.380328004" Jul 01 17:58:26.523566 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.523545 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" Jul 01 17:58:26.657550 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.657489 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgzx4\" (UniqueName: \"kubernetes.io/projected/20ada75a-7f46-4055-926e-b5c6bbc06c6a-kube-api-access-jgzx4\") pod \"20ada75a-7f46-4055-926e-b5c6bbc06c6a\" (UID: \"20ada75a-7f46-4055-926e-b5c6bbc06c6a\") " Jul 01 17:58:26.659503 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.659476 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ada75a-7f46-4055-926e-b5c6bbc06c6a-kube-api-access-jgzx4" (OuterVolumeSpecName: "kube-api-access-jgzx4") pod "20ada75a-7f46-4055-926e-b5c6bbc06c6a" (UID: "20ada75a-7f46-4055-926e-b5c6bbc06c6a"). InnerVolumeSpecName "kube-api-access-jgzx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:58:26.758488 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:26.758466 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgzx4\" (UniqueName: \"kubernetes.io/projected/20ada75a-7f46-4055-926e-b5c6bbc06c6a-kube-api-access-jgzx4\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:58:27.284626 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.284592 2564 generic.go:356] "Generic (PLEG): container finished" podID="20ada75a-7f46-4055-926e-b5c6bbc06c6a" containerID="aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f" exitCode=0 Jul 01 17:58:27.285055 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.284634 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" Jul 01 17:58:27.285055 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.284673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" event={"ID":"20ada75a-7f46-4055-926e-b5c6bbc06c6a","Type":"ContainerDied","Data":"aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f"} Jul 01 17:58:27.285055 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.284729 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hzvwq" event={"ID":"20ada75a-7f46-4055-926e-b5c6bbc06c6a","Type":"ContainerDied","Data":"6cd2013f9e1734025579e432168bde3d4a7f72a63c7ad3b80aa1791e471447c5"} Jul 01 17:58:27.285055 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.284766 2564 scope.go:117] "RemoveContainer" containerID="aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f" Jul 01 17:58:27.294235 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.294217 2564 scope.go:117] "RemoveContainer" containerID="aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f" Jul 01 17:58:27.294513 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:58:27.294493 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f\": container with ID starting with aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f not found: ID does not exist" containerID="aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f" Jul 01 17:58:27.294572 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.294523 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f"} err="failed to get container status \"aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f\": rpc error: code = NotFound desc = could not find container \"aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f\": container with ID starting with aeae6589707ef50a6f2734674b4d51cb199d4c8b17e2eaacb9fbf16641e7dd4f not found: ID does not exist" Jul 01 17:58:27.309106 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.309084 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hzvwq"] Jul 01 17:58:27.314717 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:27.314697 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hzvwq"] Jul 01 17:58:28.382330 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:28.382285 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ada75a-7f46-4055-926e-b5c6bbc06c6a" path="/var/lib/kubelet/pods/20ada75a-7f46-4055-926e-b5c6bbc06c6a/volumes" Jul 01 17:58:33.560577 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:33.560539 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:33.561036 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:33.560592 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:33.583644 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:33.583620 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:34.339550 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:34.339523 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lfh2s" Jul 01 17:58:54.597158 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.597122 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww"] Jul 01 17:58:54.597690 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.597671 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ada75a-7f46-4055-926e-b5c6bbc06c6a" containerName="registry-server" Jul 01 17:58:54.597740 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.597692 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ada75a-7f46-4055-926e-b5c6bbc06c6a" containerName="registry-server" Jul 01 17:58:54.597794 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.597781 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ada75a-7f46-4055-926e-b5c6bbc06c6a" containerName="registry-server" Jul 01 17:58:54.600964 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.600947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:58:54.604277 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.604261 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lb9f9\"" Jul 01 17:58:54.618505 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.618483 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww"] Jul 01 17:58:54.676420 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.676396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrhc\" (UniqueName: \"kubernetes.io/projected/fd16e4f6-7ffb-4096-9a26-dc763931995b-kube-api-access-pqrhc\") pod \"limitador-operator-controller-manager-859d7b78bd-7spww\" (UID: \"fd16e4f6-7ffb-4096-9a26-dc763931995b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:58:54.776817 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.776794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrhc\" (UniqueName: \"kubernetes.io/projected/fd16e4f6-7ffb-4096-9a26-dc763931995b-kube-api-access-pqrhc\") pod \"limitador-operator-controller-manager-859d7b78bd-7spww\" (UID: \"fd16e4f6-7ffb-4096-9a26-dc763931995b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:58:54.786674 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.786646 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrhc\" (UniqueName: \"kubernetes.io/projected/fd16e4f6-7ffb-4096-9a26-dc763931995b-kube-api-access-pqrhc\") pod \"limitador-operator-controller-manager-859d7b78bd-7spww\" (UID: \"fd16e4f6-7ffb-4096-9a26-dc763931995b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:58:54.910941 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:54.910879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:58:55.049796 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:55.049774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww"] Jul 01 17:58:55.052296 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:58:55.052262 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd16e4f6_7ffb_4096_9a26_dc763931995b.slice/crio-7661f34db7038e2a17839385f05a52c0284814b17389d0e8b32d3ace24a51b75 WatchSource:0}: Error finding container 7661f34db7038e2a17839385f05a52c0284814b17389d0e8b32d3ace24a51b75: Status 404 returned error can't find the container with id 7661f34db7038e2a17839385f05a52c0284814b17389d0e8b32d3ace24a51b75 Jul 01 17:58:55.054676 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:55.054657 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:58:55.421746 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:55.421715 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" event={"ID":"fd16e4f6-7ffb-4096-9a26-dc763931995b","Type":"ContainerStarted","Data":"7661f34db7038e2a17839385f05a52c0284814b17389d0e8b32d3ace24a51b75"} Jul 01 17:58:57.435999 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:57.435966 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" event={"ID":"fd16e4f6-7ffb-4096-9a26-dc763931995b","Type":"ContainerStarted","Data":"29ae3c8725b37b63530b689dbbc96afe09c4d01476204b24d1fdabb77cd059f7"} Jul 01 17:58:57.436385 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:57.436033 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:58:57.456585 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:57.456537 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" podStartSLOduration=1.5990855800000001 podStartE2EDuration="3.45652484s" totalImagesPullingTime="1.85743926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:58:57.456146206 +0000 UTC m=+695.520182379" watchObservedRunningTime="2026-07-01 17:58:57.45652484 +0000 UTC m=+695.520561012" Jul 01 17:58:58.108496 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.108461 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj"] Jul 01 17:58:58.112017 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.112002 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" Jul 01 17:58:58.115361 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.115339 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 17:58:58.116000 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.115984 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dl7jn\"" Jul 01 17:58:58.149764 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.147904 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj"] Jul 01 17:58:58.210126 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.210100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b77pl\" (UniqueName: \"kubernetes.io/projected/e8df1e50-b3c8-4d60-a803-9af9d0a1ed65-kube-api-access-b77pl\") pod \"dns-operator-controller-manager-864dd78c4c-gjknj\" (UID: \"e8df1e50-b3c8-4d60-a803-9af9d0a1ed65\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" Jul 01 17:58:58.310684 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.310660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b77pl\" (UniqueName: \"kubernetes.io/projected/e8df1e50-b3c8-4d60-a803-9af9d0a1ed65-kube-api-access-b77pl\") pod \"dns-operator-controller-manager-864dd78c4c-gjknj\" (UID: \"e8df1e50-b3c8-4d60-a803-9af9d0a1ed65\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" Jul 01 17:58:58.330725 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.330701 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b77pl\" (UniqueName: \"kubernetes.io/projected/e8df1e50-b3c8-4d60-a803-9af9d0a1ed65-kube-api-access-b77pl\") pod \"dns-operator-controller-manager-864dd78c4c-gjknj\" (UID: \"e8df1e50-b3c8-4d60-a803-9af9d0a1ed65\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" Jul 01 17:58:58.421570 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.421522 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" Jul 01 17:58:58.565565 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:58.565415 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj"] Jul 01 17:58:58.568196 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:58:58.568163 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8df1e50_b3c8_4d60_a803_9af9d0a1ed65.slice/crio-cacc7a4c7aa28817e78e8853dd5e36ea3024fd960995a2e32e9d05ed723f85b6 WatchSource:0}: Error finding container cacc7a4c7aa28817e78e8853dd5e36ea3024fd960995a2e32e9d05ed723f85b6: Status 404 returned error can't find the container with id cacc7a4c7aa28817e78e8853dd5e36ea3024fd960995a2e32e9d05ed723f85b6 Jul 01 17:58:59.310229 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.310196 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84bff57b9d-sj6cx"] Jul 01 17:58:59.315745 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.315725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.324591 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.324571 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 17:58:59.326150 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.326131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 17:58:59.326231 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.326181 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 17:58:59.326270 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.326246 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 17:58:59.326474 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.326459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d4smv\"" Jul 01 17:58:59.330109 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.330093 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 17:58:59.333170 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.333156 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 17:58:59.333226 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.333157 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 17:58:59.348464 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.348441 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84bff57b9d-sj6cx"] Jul 01 17:58:59.351838 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.351820 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 17:58:59.418856 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.418828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-console-config\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.419013 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.418882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7dt6\" (UniqueName: \"kubernetes.io/projected/3d7e6001-c957-44ae-aca9-8024b7700864-kube-api-access-z7dt6\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.419013 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.418938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-trusted-ca-bundle\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.419139 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.419025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d7e6001-c957-44ae-aca9-8024b7700864-console-oauth-config\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.419139 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.419079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d7e6001-c957-44ae-aca9-8024b7700864-console-serving-cert\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.419139 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.419122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-oauth-serving-cert\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.419259 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.419153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-service-ca\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.448053 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.448025 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" event={"ID":"e8df1e50-b3c8-4d60-a803-9af9d0a1ed65","Type":"ContainerStarted","Data":"cacc7a4c7aa28817e78e8853dd5e36ea3024fd960995a2e32e9d05ed723f85b6"} Jul 01 17:58:59.519691 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.519662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7dt6\" (UniqueName: \"kubernetes.io/projected/3d7e6001-c957-44ae-aca9-8024b7700864-kube-api-access-z7dt6\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.519811 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.519700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-trusted-ca-bundle\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.519811 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.519737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d7e6001-c957-44ae-aca9-8024b7700864-console-oauth-config\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.519811 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.519777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d7e6001-c957-44ae-aca9-8024b7700864-console-serving-cert\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.519811 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.519809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-oauth-serving-cert\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.520124 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.519846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-service-ca\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.520124 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.519887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-console-config\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.520594 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.520550 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-oauth-serving-cert\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.520756 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.520737 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-trusted-ca-bundle\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.520822 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.520744 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-console-config\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.520863 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.520823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d7e6001-c957-44ae-aca9-8024b7700864-service-ca\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.522372 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.522348 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d7e6001-c957-44ae-aca9-8024b7700864-console-oauth-config\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.522454 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.522422 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d7e6001-c957-44ae-aca9-8024b7700864-console-serving-cert\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.528223 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.528207 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7dt6\" (UniqueName: \"kubernetes.io/projected/3d7e6001-c957-44ae-aca9-8024b7700864-kube-api-access-z7dt6\") pod \"console-84bff57b9d-sj6cx\" (UID: \"3d7e6001-c957-44ae-aca9-8024b7700864\") " pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.625503 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.625437 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:58:59.761610 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:58:59.761579 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84bff57b9d-sj6cx"] Jul 01 17:58:59.763990 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:58:59.763955 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7e6001_c957_44ae_aca9_8024b7700864.slice/crio-e0b3081f11d4ccdc2a13b08a7a61758182159081fd39c4298f531c0bbbabe029 WatchSource:0}: Error finding container e0b3081f11d4ccdc2a13b08a7a61758182159081fd39c4298f531c0bbbabe029: Status 404 returned error can't find the container with id e0b3081f11d4ccdc2a13b08a7a61758182159081fd39c4298f531c0bbbabe029 Jul 01 17:59:00.460234 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:00.460192 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bff57b9d-sj6cx" event={"ID":"3d7e6001-c957-44ae-aca9-8024b7700864","Type":"ContainerStarted","Data":"6c362d4363fa41484de3c5ca5b874eb21fcf8987cef44b183b1ca8c1308e0e3c"} Jul 01 17:59:00.460417 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:00.460264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bff57b9d-sj6cx" event={"ID":"3d7e6001-c957-44ae-aca9-8024b7700864","Type":"ContainerStarted","Data":"e0b3081f11d4ccdc2a13b08a7a61758182159081fd39c4298f531c0bbbabe029"} Jul 01 17:59:00.487086 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:00.487029 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84bff57b9d-sj6cx" podStartSLOduration=1.487011384 podStartE2EDuration="1.487011384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:00.486422395 +0000 UTC m=+698.550458612" watchObservedRunningTime="2026-07-01 17:59:00.487011384 +0000 UTC m=+698.551047556" Jul 01 17:59:02.471862 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:02.471823 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" event={"ID":"e8df1e50-b3c8-4d60-a803-9af9d0a1ed65","Type":"ContainerStarted","Data":"8ee2615abb2978c9b0befb9faff505ce4daba19d8fd344b353ede40ae549cc38"} Jul 01 17:59:02.472298 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:02.471893 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" Jul 01 17:59:02.499423 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:02.499377 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" podStartSLOduration=1.594101094 podStartE2EDuration="4.499364375s" totalImagesPullingTime="2.905263281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:02.497512282 +0000 UTC m=+700.561548455" watchObservedRunningTime="2026-07-01 17:59:02.499364375 +0000 UTC m=+700.563400547" Jul 01 17:59:02.980205 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:02.980172 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6"] Jul 01 17:59:02.983889 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:02.983868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:02.988395 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:02.988375 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2cjqn\"" Jul 01 17:59:03.007630 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.007610 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6"] Jul 01 17:59:03.057986 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.057964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef374dd2-8637-4ffc-b910-b7ad0d19a094-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" (UID: \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:03.058091 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.058003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzp4r\" (UniqueName: \"kubernetes.io/projected/ef374dd2-8637-4ffc-b910-b7ad0d19a094-kube-api-access-vzp4r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" (UID: \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:03.158829 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.158791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef374dd2-8637-4ffc-b910-b7ad0d19a094-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" (UID: \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:03.158955 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.158839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzp4r\" (UniqueName: \"kubernetes.io/projected/ef374dd2-8637-4ffc-b910-b7ad0d19a094-kube-api-access-vzp4r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" (UID: \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:03.159145 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.159115 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef374dd2-8637-4ffc-b910-b7ad0d19a094-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" (UID: \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:03.169142 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.169117 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzp4r\" (UniqueName: \"kubernetes.io/projected/ef374dd2-8637-4ffc-b910-b7ad0d19a094-kube-api-access-vzp4r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" (UID: \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:03.293702 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.293647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:03.449211 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.449187 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6"] Jul 01 17:59:03.450282 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:59:03.450252 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef374dd2_8637_4ffc_b910_b7ad0d19a094.slice/crio-9d5b42edcf2576f4d8f30c8b5a4ee409980b691cc0e0a590c66998a83969907f WatchSource:0}: Error finding container 9d5b42edcf2576f4d8f30c8b5a4ee409980b691cc0e0a590c66998a83969907f: Status 404 returned error can't find the container with id 9d5b42edcf2576f4d8f30c8b5a4ee409980b691cc0e0a590c66998a83969907f Jul 01 17:59:03.478763 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:03.478733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" event={"ID":"ef374dd2-8637-4ffc-b910-b7ad0d19a094","Type":"ContainerStarted","Data":"9d5b42edcf2576f4d8f30c8b5a4ee409980b691cc0e0a590c66998a83969907f"} Jul 01 17:59:07.206033 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.205996 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp"] Jul 01 17:59:07.209926 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.209904 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" Jul 01 17:59:07.213274 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.213254 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tls62\"" Jul 01 17:59:07.228428 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.228403 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp"] Jul 01 17:59:07.306904 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.306862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5vnj\" (UniqueName: \"kubernetes.io/projected/b2f66815-760b-409f-aeb6-8f0cc5ad7945-kube-api-access-v5vnj\") pod \"authorino-operator-75cc8d5cb7-t8rcp\" (UID: \"b2f66815-760b-409f-aeb6-8f0cc5ad7945\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" Jul 01 17:59:07.408186 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.408157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5vnj\" (UniqueName: \"kubernetes.io/projected/b2f66815-760b-409f-aeb6-8f0cc5ad7945-kube-api-access-v5vnj\") pod \"authorino-operator-75cc8d5cb7-t8rcp\" (UID: \"b2f66815-760b-409f-aeb6-8f0cc5ad7945\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" Jul 01 17:59:07.425769 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.425742 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5vnj\" (UniqueName: \"kubernetes.io/projected/b2f66815-760b-409f-aeb6-8f0cc5ad7945-kube-api-access-v5vnj\") pod \"authorino-operator-75cc8d5cb7-t8rcp\" (UID: \"b2f66815-760b-409f-aeb6-8f0cc5ad7945\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" Jul 01 17:59:07.523284 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.523259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" Jul 01 17:59:07.669471 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:07.669449 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp"] Jul 01 17:59:07.671200 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:59:07.671150 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f66815_760b_409f_aeb6_8f0cc5ad7945.slice/crio-8d7fa882383254ecd022858e9e075b831699d185c590e2f0fc106a1508b2e348 WatchSource:0}: Error finding container 8d7fa882383254ecd022858e9e075b831699d185c590e2f0fc106a1508b2e348: Status 404 returned error can't find the container with id 8d7fa882383254ecd022858e9e075b831699d185c590e2f0fc106a1508b2e348 Jul 01 17:59:08.444680 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:08.444651 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:08.510986 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:08.510952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" event={"ID":"b2f66815-760b-409f-aeb6-8f0cc5ad7945","Type":"ContainerStarted","Data":"8d7fa882383254ecd022858e9e075b831699d185c590e2f0fc106a1508b2e348"} Jul 01 17:59:09.521458 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:09.521422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" event={"ID":"ef374dd2-8637-4ffc-b910-b7ad0d19a094","Type":"ContainerStarted","Data":"4f15048bdb94a92b29db712ccb36ef6736bf18cce0cba96573ea2dceca5dbb00"} Jul 01 17:59:09.521912 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:09.521657 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:09.551962 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:09.550508 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" podStartSLOduration=1.681487583 podStartE2EDuration="7.550493887s" totalImagesPullingTime="5.869006304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:09.548773264 +0000 UTC m=+707.612809438" watchObservedRunningTime="2026-07-01 17:59:09.550493887 +0000 UTC m=+707.614530061" Jul 01 17:59:09.626368 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:09.626282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:59:09.626368 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:09.626360 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:59:09.632471 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:09.632442 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:59:10.532434 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:10.532404 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84bff57b9d-sj6cx" Jul 01 17:59:11.533516 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:11.533479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" event={"ID":"b2f66815-760b-409f-aeb6-8f0cc5ad7945","Type":"ContainerStarted","Data":"fe910ce3ff2a6d24f8cd7994e2cded5a12deaa9d85894137a4d1f6a338c5b09b"} Jul 01 17:59:11.533873 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:11.533625 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" Jul 01 17:59:11.565513 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:11.565472 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" podStartSLOduration=1.2386753480000001 podStartE2EDuration="4.565456344s" totalImagesPullingTime="3.326780996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:11.565411719 +0000 UTC m=+709.629447913" watchObservedRunningTime="2026-07-01 17:59:11.565456344 +0000 UTC m=+709.629492516" Jul 01 17:59:13.481186 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:13.481156 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gjknj" Jul 01 17:59:20.528866 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:20.528834 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:22.445400 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.445372 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6"] Jul 01 17:59:22.445771 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.445537 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" containerName="manager" containerID="cri-o://4f15048bdb94a92b29db712ccb36ef6736bf18cce0cba96573ea2dceca5dbb00" gracePeriod=2 Jul 01 17:59:22.456413 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.456386 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6"] Jul 01 17:59:22.457080 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.457049 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ef374dd2-8637-4ffc-b910-b7ad0d19a094\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\": pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:22.474752 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.474590 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww"] Jul 01 17:59:22.474852 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.474799 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" containerName="manager" containerID="cri-o://29ae3c8725b37b63530b689dbbc96afe09c4d01476204b24d1fdabb77cd059f7" gracePeriod=2 Jul 01 17:59:22.476932 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.476911 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp"] Jul 01 17:59:22.477454 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.477433 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" containerName="manager" Jul 01 17:59:22.477454 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.477455 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" containerName="manager" Jul 01 17:59:22.477597 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.477544 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" containerName="manager" Jul 01 17:59:22.480888 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.480870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:22.495048 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.495029 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww"] Jul 01 17:59:22.497409 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.497389 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp"] Jul 01 17:59:22.503350 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.503297 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fd16e4f6-7ffb-4096-9a26-dc763931995b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-7spww\": pods \"limitador-operator-controller-manager-859d7b78bd-7spww\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:22.506240 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.506214 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6"] Jul 01 17:59:22.506543 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.506514 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:22.507001 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.506977 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" containerName="manager" Jul 01 17:59:22.507093 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.507003 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" containerName="manager" Jul 01 17:59:22.507164 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.507127 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" containerName="manager" Jul 01 17:59:22.510614 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.510594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" Jul 01 17:59:22.527277 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.527218 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6"] Jul 01 17:59:22.537721 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.537679 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7spww\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:22.540345 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.540302 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8rcp" Jul 01 17:59:22.540955 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.540928 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:22.542563 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.542541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhb4w\" (UniqueName: \"kubernetes.io/projected/e0f78155-9bd8-451d-bf17-655b67fe0808-kube-api-access-xhb4w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r2qvp\" (UID: \"e0f78155-9bd8-451d-bf17-655b67fe0808\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:22.542672 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.542587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0f78155-9bd8-451d-bf17-655b67fe0808-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r2qvp\" (UID: \"e0f78155-9bd8-451d-bf17-655b67fe0808\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:22.542672 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.542635 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsv7b\" (UniqueName: \"kubernetes.io/projected/a8d47252-d7cc-425d-b3e6-86eed5d908b5-kube-api-access-fsv7b\") pod \"limitador-operator-controller-manager-859d7b78bd-bzbt6\" (UID: \"a8d47252-d7cc-425d-b3e6-86eed5d908b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" Jul 01 17:59:22.573165 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.573137 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7spww\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:22.575959 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.575935 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:22.598374 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.598347 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd16e4f6-7ffb-4096-9a26-dc763931995b" containerID="29ae3c8725b37b63530b689dbbc96afe09c4d01476204b24d1fdabb77cd059f7" exitCode=0 Jul 01 17:59:22.600265 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.600245 2564 generic.go:356] "Generic (PLEG): container finished" podID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" containerID="4f15048bdb94a92b29db712ccb36ef6736bf18cce0cba96573ea2dceca5dbb00" exitCode=0 Jul 01 17:59:22.644659 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.644068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhb4w\" (UniqueName: \"kubernetes.io/projected/e0f78155-9bd8-451d-bf17-655b67fe0808-kube-api-access-xhb4w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r2qvp\" (UID: \"e0f78155-9bd8-451d-bf17-655b67fe0808\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:22.644659 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.644117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0f78155-9bd8-451d-bf17-655b67fe0808-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r2qvp\" (UID: \"e0f78155-9bd8-451d-bf17-655b67fe0808\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:22.644659 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.644153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsv7b\" (UniqueName: \"kubernetes.io/projected/a8d47252-d7cc-425d-b3e6-86eed5d908b5-kube-api-access-fsv7b\") pod \"limitador-operator-controller-manager-859d7b78bd-bzbt6\" (UID: \"a8d47252-d7cc-425d-b3e6-86eed5d908b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" Jul 01 17:59:22.644659 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.644629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0f78155-9bd8-451d-bf17-655b67fe0808-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r2qvp\" (UID: \"e0f78155-9bd8-451d-bf17-655b67fe0808\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:22.655625 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.655590 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsv7b\" (UniqueName: \"kubernetes.io/projected/a8d47252-d7cc-425d-b3e6-86eed5d908b5-kube-api-access-fsv7b\") pod \"limitador-operator-controller-manager-859d7b78bd-bzbt6\" (UID: \"a8d47252-d7cc-425d-b3e6-86eed5d908b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" Jul 01 17:59:22.655876 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.655853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhb4w\" (UniqueName: \"kubernetes.io/projected/e0f78155-9bd8-451d-bf17-655b67fe0808-kube-api-access-xhb4w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r2qvp\" (UID: \"e0f78155-9bd8-451d-bf17-655b67fe0808\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:22.718755 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.718734 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:22.722103 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.722082 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:22.722259 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.722236 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7spww\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:22.725715 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.725692 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:22.729367 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.729346 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7spww\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:22.732601 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:22.732582 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:22.745043 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.745024 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef374dd2-8637-4ffc-b910-b7ad0d19a094-extensions-socket-volume\") pod \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\" (UID: \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\") " Jul 01 17:59:22.745122 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.745096 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqrhc\" (UniqueName: \"kubernetes.io/projected/fd16e4f6-7ffb-4096-9a26-dc763931995b-kube-api-access-pqrhc\") pod \"fd16e4f6-7ffb-4096-9a26-dc763931995b\" (UID: \"fd16e4f6-7ffb-4096-9a26-dc763931995b\") " Jul 01 17:59:22.745178 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.745136 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzp4r\" (UniqueName: \"kubernetes.io/projected/ef374dd2-8637-4ffc-b910-b7ad0d19a094-kube-api-access-vzp4r\") pod \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\" (UID: \"ef374dd2-8637-4ffc-b910-b7ad0d19a094\") " Jul 01 17:59:22.745432 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.745406 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef374dd2-8637-4ffc-b910-b7ad0d19a094-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef374dd2-8637-4ffc-b910-b7ad0d19a094" (UID: "ef374dd2-8637-4ffc-b910-b7ad0d19a094"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:59:22.747049 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.747029 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd16e4f6-7ffb-4096-9a26-dc763931995b-kube-api-access-pqrhc" (OuterVolumeSpecName: "kube-api-access-pqrhc") pod "fd16e4f6-7ffb-4096-9a26-dc763931995b" (UID: "fd16e4f6-7ffb-4096-9a26-dc763931995b"). InnerVolumeSpecName "kube-api-access-pqrhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:59:22.747126 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.747045 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef374dd2-8637-4ffc-b910-b7ad0d19a094-kube-api-access-vzp4r" (OuterVolumeSpecName: "kube-api-access-vzp4r") pod "ef374dd2-8637-4ffc-b910-b7ad0d19a094" (UID: "ef374dd2-8637-4ffc-b910-b7ad0d19a094"). InnerVolumeSpecName "kube-api-access-vzp4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:59:22.846470 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.846445 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzp4r\" (UniqueName: \"kubernetes.io/projected/ef374dd2-8637-4ffc-b910-b7ad0d19a094-kube-api-access-vzp4r\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:59:22.846470 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.846468 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef374dd2-8637-4ffc-b910-b7ad0d19a094-extensions-socket-volume\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:59:22.846586 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.846477 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqrhc\" (UniqueName: \"kubernetes.io/projected/fd16e4f6-7ffb-4096-9a26-dc763931995b-kube-api-access-pqrhc\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:59:22.878277 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.878258 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:22.884032 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:22.884018 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" Jul 01 17:59:23.045913 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.045883 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp"] Jul 01 17:59:23.053952 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:59:23.053920 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f78155_9bd8_451d_bf17_655b67fe0808.slice/crio-9fe9346b25022d10247e45ca7f53f2f78b4a0727cfda1c1e565cb6b443d097ff WatchSource:0}: Error finding container 9fe9346b25022d10247e45ca7f53f2f78b4a0727cfda1c1e565cb6b443d097ff: Status 404 returned error can't find the container with id 9fe9346b25022d10247e45ca7f53f2f78b4a0727cfda1c1e565cb6b443d097ff Jul 01 17:59:23.061241 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:59:23.061220 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d47252_d7cc_425d_b3e6_86eed5d908b5.slice/crio-6d7c4c95a1303c745da9b9f86a303c40e383538adabaaa73cd3e0c0e595bd1f8 WatchSource:0}: Error finding container 6d7c4c95a1303c745da9b9f86a303c40e383538adabaaa73cd3e0c0e595bd1f8: Status 404 returned error can't find the container with id 6d7c4c95a1303c745da9b9f86a303c40e383538adabaaa73cd3e0c0e595bd1f8 Jul 01 17:59:23.061525 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.061498 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6"] Jul 01 17:59:23.613357 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.613300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" event={"ID":"e0f78155-9bd8-451d-bf17-655b67fe0808","Type":"ContainerStarted","Data":"b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213"} Jul 01 17:59:23.613770 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.613405 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" event={"ID":"e0f78155-9bd8-451d-bf17-655b67fe0808","Type":"ContainerStarted","Data":"9fe9346b25022d10247e45ca7f53f2f78b4a0727cfda1c1e565cb6b443d097ff"} Jul 01 17:59:23.613770 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.613519 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:23.614954 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.614933 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" event={"ID":"a8d47252-d7cc-425d-b3e6-86eed5d908b5","Type":"ContainerStarted","Data":"d8abe6a823c2ed384d4ce734822c78cb38aa50a21b7b3cc6561ce1ada7e1229b"} Jul 01 17:59:23.615040 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.614967 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" event={"ID":"a8d47252-d7cc-425d-b3e6-86eed5d908b5","Type":"ContainerStarted","Data":"6d7c4c95a1303c745da9b9f86a303c40e383538adabaaa73cd3e0c0e595bd1f8"} Jul 01 17:59:23.615040 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.614994 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" Jul 01 17:59:23.616064 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:23.616037 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7spww\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:23.616251 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.616238 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:23.616307 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.616253 2564 scope.go:117] "RemoveContainer" containerID="29ae3c8725b37b63530b689dbbc96afe09c4d01476204b24d1fdabb77cd059f7" Jul 01 17:59:23.617818 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.617799 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:23.618764 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:23.618740 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:23.626436 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.626419 2564 scope.go:117] "RemoveContainer" containerID="4f15048bdb94a92b29db712ccb36ef6736bf18cce0cba96573ea2dceca5dbb00" Jul 01 17:59:23.646489 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.646451 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" podStartSLOduration=1.646439919 podStartE2EDuration="1.646439919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:23.646186454 +0000 UTC m=+721.710222653" watchObservedRunningTime="2026-07-01 17:59:23.646439919 +0000 UTC m=+721.710476092" Jul 01 17:59:23.682120 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.682080 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" podStartSLOduration=1.682067827 podStartE2EDuration="1.682067827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:23.680969985 +0000 UTC m=+721.745006159" watchObservedRunningTime="2026-07-01 17:59:23.682067827 +0000 UTC m=+721.746104001" Jul 01 17:59:23.684137 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:23.684117 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7spww\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:23.688350 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:23.688328 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:23.728531 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.728479 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8"] Jul 01 17:59:23.734421 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.734405 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:23.753068 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.753044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8"] Jul 01 17:59:23.755175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.755128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/673d386f-575b-4baa-a407-49495350f85d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mlbr8\" (UID: \"673d386f-575b-4baa-a407-49495350f85d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:23.755175 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.755166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hz22\" (UniqueName: \"kubernetes.io/projected/673d386f-575b-4baa-a407-49495350f85d-kube-api-access-6hz22\") pod \"kuadrant-operator-controller-manager-86878c769f-mlbr8\" (UID: \"673d386f-575b-4baa-a407-49495350f85d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:23.771953 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:23.771927 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7spww\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7spww" Jul 01 17:59:23.775193 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:23.775171 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f4jq6\" is forbidden: User \"system:node:ip-10-0-136-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-118.ec2.internal' and this object" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4jq6" Jul 01 17:59:23.856069 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.856038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/673d386f-575b-4baa-a407-49495350f85d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mlbr8\" (UID: \"673d386f-575b-4baa-a407-49495350f85d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:23.856203 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.856079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hz22\" (UniqueName: \"kubernetes.io/projected/673d386f-575b-4baa-a407-49495350f85d-kube-api-access-6hz22\") pod \"kuadrant-operator-controller-manager-86878c769f-mlbr8\" (UID: \"673d386f-575b-4baa-a407-49495350f85d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:23.856441 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.856421 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/673d386f-575b-4baa-a407-49495350f85d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mlbr8\" (UID: \"673d386f-575b-4baa-a407-49495350f85d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:23.885695 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:23.885676 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hz22\" (UniqueName: \"kubernetes.io/projected/673d386f-575b-4baa-a407-49495350f85d-kube-api-access-6hz22\") pod \"kuadrant-operator-controller-manager-86878c769f-mlbr8\" (UID: \"673d386f-575b-4baa-a407-49495350f85d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:24.044983 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:24.044959 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:24.198143 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:24.198112 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8"] Jul 01 17:59:24.199434 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:59:24.199405 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod673d386f_575b_4baa_a407_49495350f85d.slice/crio-11aff9a2eaf3aed424078be12d31144d5614b2393734f8105e6e4f926f52e469 WatchSource:0}: Error finding container 11aff9a2eaf3aed424078be12d31144d5614b2393734f8105e6e4f926f52e469: Status 404 returned error can't find the container with id 11aff9a2eaf3aed424078be12d31144d5614b2393734f8105e6e4f926f52e469 Jul 01 17:59:24.382940 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:24.382874 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef374dd2-8637-4ffc-b910-b7ad0d19a094" path="/var/lib/kubelet/pods/ef374dd2-8637-4ffc-b910-b7ad0d19a094/volumes" Jul 01 17:59:24.383198 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:24.383185 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd16e4f6-7ffb-4096-9a26-dc763931995b" path="/var/lib/kubelet/pods/fd16e4f6-7ffb-4096-9a26-dc763931995b/volumes" Jul 01 17:59:24.625594 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:24.625558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" event={"ID":"673d386f-575b-4baa-a407-49495350f85d","Type":"ContainerStarted","Data":"ed32e28a16fb6a72747eee8c25bd8d0a0d35c377d039d3fa25330da2dd50b865"} Jul 01 17:59:24.626049 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:24.625632 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:24.626049 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:24.625662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" event={"ID":"673d386f-575b-4baa-a407-49495350f85d","Type":"ContainerStarted","Data":"11aff9a2eaf3aed424078be12d31144d5614b2393734f8105e6e4f926f52e469"} Jul 01 17:59:24.697551 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:24.697361 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" podStartSLOduration=1.697338848 podStartE2EDuration="1.697338848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:24.691777659 +0000 UTC m=+722.755813832" watchObservedRunningTime="2026-07-01 17:59:24.697338848 +0000 UTC m=+722.761375021" Jul 01 17:59:34.630269 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:34.630236 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bzbt6" Jul 01 17:59:34.630732 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:34.630303 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:35.636118 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:35.636089 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mlbr8" Jul 01 17:59:35.701436 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:35.701405 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp"] Jul 01 17:59:35.701635 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:35.701612 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" podUID="e0f78155-9bd8-451d-bf17-655b67fe0808" containerName="manager" containerID="cri-o://b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213" gracePeriod=10 Jul 01 17:59:35.957286 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:35.957261 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:36.059897 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.059862 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhb4w\" (UniqueName: \"kubernetes.io/projected/e0f78155-9bd8-451d-bf17-655b67fe0808-kube-api-access-xhb4w\") pod \"e0f78155-9bd8-451d-bf17-655b67fe0808\" (UID: \"e0f78155-9bd8-451d-bf17-655b67fe0808\") " Jul 01 17:59:36.060034 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.059977 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0f78155-9bd8-451d-bf17-655b67fe0808-extensions-socket-volume\") pod \"e0f78155-9bd8-451d-bf17-655b67fe0808\" (UID: \"e0f78155-9bd8-451d-bf17-655b67fe0808\") " Jul 01 17:59:36.060360 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.060331 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0f78155-9bd8-451d-bf17-655b67fe0808-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e0f78155-9bd8-451d-bf17-655b67fe0808" (UID: "e0f78155-9bd8-451d-bf17-655b67fe0808"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:59:36.061878 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.061854 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f78155-9bd8-451d-bf17-655b67fe0808-kube-api-access-xhb4w" (OuterVolumeSpecName: "kube-api-access-xhb4w") pod "e0f78155-9bd8-451d-bf17-655b67fe0808" (UID: "e0f78155-9bd8-451d-bf17-655b67fe0808"). InnerVolumeSpecName "kube-api-access-xhb4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:59:36.160903 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.160879 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhb4w\" (UniqueName: \"kubernetes.io/projected/e0f78155-9bd8-451d-bf17-655b67fe0808-kube-api-access-xhb4w\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:59:36.160903 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.160900 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0f78155-9bd8-451d-bf17-655b67fe0808-extensions-socket-volume\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 17:59:36.693521 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.693443 2564 generic.go:356] "Generic (PLEG): container finished" podID="e0f78155-9bd8-451d-bf17-655b67fe0808" containerID="b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213" exitCode=0 Jul 01 17:59:36.693521 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.693483 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" Jul 01 17:59:36.693521 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.693514 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" event={"ID":"e0f78155-9bd8-451d-bf17-655b67fe0808","Type":"ContainerDied","Data":"b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213"} Jul 01 17:59:36.693976 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.693558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp" event={"ID":"e0f78155-9bd8-451d-bf17-655b67fe0808","Type":"ContainerDied","Data":"9fe9346b25022d10247e45ca7f53f2f78b4a0727cfda1c1e565cb6b443d097ff"} Jul 01 17:59:36.693976 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.693578 2564 scope.go:117] "RemoveContainer" containerID="b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213" Jul 01 17:59:36.702460 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.702245 2564 scope.go:117] "RemoveContainer" containerID="b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213" Jul 01 17:59:36.702674 ip-10-0-136-118 kubenswrapper[2564]: E0701 17:59:36.702656 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213\": container with ID starting with b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213 not found: ID does not exist" containerID="b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213" Jul 01 17:59:36.702726 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.702682 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213"} err="failed to get container status \"b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213\": rpc error: code = NotFound desc = could not find container \"b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213\": container with ID starting with b4890ccf3d6c5a99d406a26e4bea513df23e6d5bb4ddfe477922d407a424d213 not found: ID does not exist" Jul 01 17:59:36.724421 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.724398 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp"] Jul 01 17:59:36.728872 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:36.728851 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r2qvp"] Jul 01 17:59:38.383904 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:38.383869 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f78155-9bd8-451d-bf17-655b67fe0808" path="/var/lib/kubelet/pods/e0f78155-9bd8-451d-bf17-655b67fe0808/volumes" Jul 01 17:59:52.142853 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.142811 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4"] Jul 01 17:59:52.144139 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.144108 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f78155-9bd8-451d-bf17-655b67fe0808" containerName="manager" Jul 01 17:59:52.144139 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.144139 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f78155-9bd8-451d-bf17-655b67fe0808" containerName="manager" Jul 01 17:59:52.144404 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.144386 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f78155-9bd8-451d-bf17-655b67fe0808" containerName="manager" Jul 01 17:59:52.147867 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.147841 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.150735 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.150710 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9scvh\"" Jul 01 17:59:52.158956 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.158932 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4"] Jul 01 17:59:52.289596 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.289770 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.289770 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.289770 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.289916 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289777 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.289916 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.289916 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.289916 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.289916 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.289867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqqdj\" (UniqueName: \"kubernetes.io/projected/e8e58b5a-52a9-40b6-934a-3568ea071dcf-kube-api-access-jqqdj\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.390718 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.390689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqqdj\" (UniqueName: \"kubernetes.io/projected/e8e58b5a-52a9-40b6-934a-3568ea071dcf-kube-api-access-jqqdj\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.390880 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.390741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.390880 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.390789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.390880 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.390813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.390880 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.390837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.390880 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.390877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.391152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.390953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.391152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.391013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.391152 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.391055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.391309 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.391285 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.391411 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.391375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.391470 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.391412 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.391470 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.391431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.391653 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.391632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.393191 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.393120 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.393472 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.393452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.399778 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.399756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e58b5a-52a9-40b6-934a-3568ea071dcf-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.400064 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.400042 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqqdj\" (UniqueName: \"kubernetes.io/projected/e8e58b5a-52a9-40b6-934a-3568ea071dcf-kube-api-access-jqqdj\") pod \"maas-default-gateway-openshift-default-56654dcf7-876q4\" (UID: \"e8e58b5a-52a9-40b6-934a-3568ea071dcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.459264 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.459242 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:52.611487 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.611459 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4"] Jul 01 17:59:52.613017 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:59:52.612991 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e58b5a_52a9_40b6_934a_3568ea071dcf.slice/crio-d2079366172045e20aa4840358d114ac86271c0330cc60f39fb49c5b11821636 WatchSource:0}: Error finding container d2079366172045e20aa4840358d114ac86271c0330cc60f39fb49c5b11821636: Status 404 returned error can't find the container with id d2079366172045e20aa4840358d114ac86271c0330cc60f39fb49c5b11821636 Jul 01 17:59:52.614983 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.614953 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 17:59:52.615086 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.615029 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 17:59:52.615086 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.615076 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 17:59:52.782719 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.782687 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" event={"ID":"e8e58b5a-52a9-40b6-934a-3568ea071dcf","Type":"ContainerStarted","Data":"36639e7f32f2dd7fffa2462fceb5cf25dabfb622ffb9bb94f20b80077d61ca51"} Jul 01 17:59:52.782901 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.782741 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" event={"ID":"e8e58b5a-52a9-40b6-934a-3568ea071dcf","Type":"ContainerStarted","Data":"d2079366172045e20aa4840358d114ac86271c0330cc60f39fb49c5b11821636"} Jul 01 17:59:52.808089 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:52.808036 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" podStartSLOduration=0.808015791 podStartE2EDuration="808.015791ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:52.805360047 +0000 UTC m=+750.869396218" watchObservedRunningTime="2026-07-01 17:59:52.808015791 +0000 UTC m=+750.872051967" Jul 01 17:59:53.460178 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:53.460148 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:53.464491 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:53.464468 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:53.788720 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:53.788696 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:53.789724 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:53.789702 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-876q4" Jul 01 17:59:54.868282 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:54.868253 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bkmdv"] Jul 01 17:59:54.871271 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:54.871255 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bkmdv" Jul 01 17:59:54.874685 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:54.874666 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lwfv5\"" Jul 01 17:59:54.887430 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:54.887408 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bkmdv"] Jul 01 17:59:55.012725 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:55.012700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tzdk\" (UniqueName: \"kubernetes.io/projected/cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d-kube-api-access-2tzdk\") pod \"authorino-75d556bd77-bkmdv\" (UID: \"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d\") " pod="kuadrant-system/authorino-75d556bd77-bkmdv" Jul 01 17:59:55.113254 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:55.113230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzdk\" (UniqueName: \"kubernetes.io/projected/cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d-kube-api-access-2tzdk\") pod \"authorino-75d556bd77-bkmdv\" (UID: \"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d\") " pod="kuadrant-system/authorino-75d556bd77-bkmdv" Jul 01 17:59:55.122656 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:55.122605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tzdk\" (UniqueName: \"kubernetes.io/projected/cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d-kube-api-access-2tzdk\") pod \"authorino-75d556bd77-bkmdv\" (UID: \"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d\") " pod="kuadrant-system/authorino-75d556bd77-bkmdv" Jul 01 17:59:55.180515 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:55.180477 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bkmdv" Jul 01 17:59:55.318085 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:55.318063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bkmdv"] Jul 01 17:59:55.320201 ip-10-0-136-118 kubenswrapper[2564]: W0701 17:59:55.320166 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbff47fb_0b5e_45ec_9068_b8a7a3b11d6d.slice/crio-6b06bbe88a8f4a3f29101b58c6fe17c4a009ada80aec52aa06365cb93154662a WatchSource:0}: Error finding container 6b06bbe88a8f4a3f29101b58c6fe17c4a009ada80aec52aa06365cb93154662a: Status 404 returned error can't find the container with id 6b06bbe88a8f4a3f29101b58c6fe17c4a009ada80aec52aa06365cb93154662a Jul 01 17:59:55.800968 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:55.800933 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bkmdv" event={"ID":"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d","Type":"ContainerStarted","Data":"6b06bbe88a8f4a3f29101b58c6fe17c4a009ada80aec52aa06365cb93154662a"} Jul 01 17:59:58.824659 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:58.824583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bkmdv" event={"ID":"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d","Type":"ContainerStarted","Data":"276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27"} Jul 01 17:59:58.843362 ip-10-0-136-118 kubenswrapper[2564]: I0701 17:59:58.843297 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bkmdv" podStartSLOduration=1.646192058 podStartE2EDuration="4.843283274s" totalImagesPullingTime="3.197091216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:59:58.839967665 +0000 UTC m=+756.904003838" watchObservedRunningTime="2026-07-01 17:59:58.843283274 +0000 UTC m=+756.907319447" Jul 01 18:00:15.481397 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.481362 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-4mlwp"] Jul 01 18:00:15.485576 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.485554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:15.488439 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.488413 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 18:00:15.496406 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.496385 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4mlwp"] Jul 01 18:00:15.590171 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.590036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1db89b39-6a50-4b9f-9250-22837531e7c1-data\") pod \"postgres-69fb4594cf-4mlwp\" (UID: \"1db89b39-6a50-4b9f-9250-22837531e7c1\") " pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:15.590171 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.590087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8hdf\" (UniqueName: \"kubernetes.io/projected/1db89b39-6a50-4b9f-9250-22837531e7c1-kube-api-access-g8hdf\") pod \"postgres-69fb4594cf-4mlwp\" (UID: \"1db89b39-6a50-4b9f-9250-22837531e7c1\") " pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:15.690916 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.690892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1db89b39-6a50-4b9f-9250-22837531e7c1-data\") pod \"postgres-69fb4594cf-4mlwp\" (UID: \"1db89b39-6a50-4b9f-9250-22837531e7c1\") " pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:15.691017 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.690921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8hdf\" (UniqueName: \"kubernetes.io/projected/1db89b39-6a50-4b9f-9250-22837531e7c1-kube-api-access-g8hdf\") pod \"postgres-69fb4594cf-4mlwp\" (UID: \"1db89b39-6a50-4b9f-9250-22837531e7c1\") " pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:15.691277 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.691259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1db89b39-6a50-4b9f-9250-22837531e7c1-data\") pod \"postgres-69fb4594cf-4mlwp\" (UID: \"1db89b39-6a50-4b9f-9250-22837531e7c1\") " pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:15.701238 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.701218 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8hdf\" (UniqueName: \"kubernetes.io/projected/1db89b39-6a50-4b9f-9250-22837531e7c1-kube-api-access-g8hdf\") pod \"postgres-69fb4594cf-4mlwp\" (UID: \"1db89b39-6a50-4b9f-9250-22837531e7c1\") " pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:15.797072 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.797019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:15.934382 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:15.934355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4mlwp"] Jul 01 18:00:15.935950 ip-10-0-136-118 kubenswrapper[2564]: W0701 18:00:15.935921 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db89b39_6a50_4b9f_9250_22837531e7c1.slice/crio-24733c9468e22f8fdabab4e8175d798ecf18f6eba0d8afc5d3c5d50223f7537d WatchSource:0}: Error finding container 24733c9468e22f8fdabab4e8175d798ecf18f6eba0d8afc5d3c5d50223f7537d: Status 404 returned error can't find the container with id 24733c9468e22f8fdabab4e8175d798ecf18f6eba0d8afc5d3c5d50223f7537d Jul 01 18:00:16.933611 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:16.933576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4mlwp" event={"ID":"1db89b39-6a50-4b9f-9250-22837531e7c1","Type":"ContainerStarted","Data":"24733c9468e22f8fdabab4e8175d798ecf18f6eba0d8afc5d3c5d50223f7537d"} Jul 01 18:00:20.961227 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:20.961185 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4mlwp" event={"ID":"1db89b39-6a50-4b9f-9250-22837531e7c1","Type":"ContainerStarted","Data":"401dcf72eb7bac486404ea8d57f6c6e2e2e8f0afc7cbbc9c13372d9f75d7a42b"} Jul 01 18:00:20.961637 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:20.961366 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:20.980649 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:20.980602 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-4mlwp" podStartSLOduration=2.003191079 podStartE2EDuration="5.980589012s" totalImagesPullingTime="3.977397933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:00:20.979453481 +0000 UTC m=+779.043489677" watchObservedRunningTime="2026-07-01 18:00:20.980589012 +0000 UTC m=+779.044625185" Jul 01 18:00:26.997087 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:26.997058 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-4mlwp" Jul 01 18:00:59.069157 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.069080 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:00:59.072383 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.072362 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 18:00:59.075524 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.075500 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-l76vh\"" Jul 01 18:00:59.075643 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.075498 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 18:00:59.075643 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.075565 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 18:00:59.075778 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.075643 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 18:00:59.082733 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.082710 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:00:59.153354 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.153309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs77g\" (UniqueName: \"kubernetes.io/projected/3492c323-18fe-40f0-8b27-5df801808849-kube-api-access-hs77g\") pod \"maas-keycloak-0\" (UID: \"3492c323-18fe-40f0-8b27-5df801808849\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:00:59.254009 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.253986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs77g\" (UniqueName: \"kubernetes.io/projected/3492c323-18fe-40f0-8b27-5df801808849-kube-api-access-hs77g\") pod \"maas-keycloak-0\" (UID: \"3492c323-18fe-40f0-8b27-5df801808849\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:00:59.263661 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.263641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs77g\" (UniqueName: \"kubernetes.io/projected/3492c323-18fe-40f0-8b27-5df801808849-kube-api-access-hs77g\") pod \"maas-keycloak-0\" (UID: \"3492c323-18fe-40f0-8b27-5df801808849\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:00:59.382662 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.382599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 18:00:59.520256 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:00:59.520232 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:00:59.523040 ip-10-0-136-118 kubenswrapper[2564]: W0701 18:00:59.523003 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3492c323_18fe_40f0_8b27_5df801808849.slice/crio-e5e11e501699797b870085cdf9824ef0a8361c969bab2a84e8a59685d7612db0 WatchSource:0}: Error finding container e5e11e501699797b870085cdf9824ef0a8361c969bab2a84e8a59685d7612db0: Status 404 returned error can't find the container with id e5e11e501699797b870085cdf9824ef0a8361c969bab2a84e8a59685d7612db0 Jul 01 18:01:00.188798 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:00.188755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3492c323-18fe-40f0-8b27-5df801808849","Type":"ContainerStarted","Data":"e5e11e501699797b870085cdf9824ef0a8361c969bab2a84e8a59685d7612db0"} Jul 01 18:01:06.236903 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:06.236866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3492c323-18fe-40f0-8b27-5df801808849","Type":"ContainerStarted","Data":"8648787d6d0f078a2adbf6b34f2977e7717b6028ec6fbe776511e3fac3848175"} Jul 01 18:01:06.261079 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:06.261019 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.334129516 podStartE2EDuration="7.260998825s" totalImagesPullingTime="5.926869309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:01:06.257749439 +0000 UTC m=+824.321785614" watchObservedRunningTime="2026-07-01 18:01:06.260998825 +0000 UTC m=+824.325034998" Jul 01 18:01:06.385179 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:06.385123 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:06.388411 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:06.388385 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 18:01:07.383930 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:07.383872 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:08.385686 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:08.383914 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:09.383362 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:09.383289 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 18:01:09.383739 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:09.383699 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:10.387935 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:10.387895 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:11.383802 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:11.383749 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:12.393611 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:12.393568 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:13.383096 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:13.383055 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:14.383284 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:14.383238 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:15.383557 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:15.383507 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:16.383271 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:16.383218 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:17.383208 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:17.383163 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:18.383679 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:18.383637 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 01 18:01:19.507151 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:19.507100 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 18:01:19.523747 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:19.523699 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="3492c323-18fe-40f0-8b27-5df801808849" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:01:29.513648 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:29.513615 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 18:01:32.486330 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:32.486285 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bkmdv"] Jul 01 18:01:32.486706 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:32.486466 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bkmdv" podUID="cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d" containerName="authorino" containerID="cri-o://276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27" gracePeriod=30 Jul 01 18:01:32.737360 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:32.737295 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bkmdv" Jul 01 18:01:32.822109 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:32.822081 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tzdk\" (UniqueName: \"kubernetes.io/projected/cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d-kube-api-access-2tzdk\") pod \"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d\" (UID: \"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d\") " Jul 01 18:01:32.824031 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:32.824000 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d-kube-api-access-2tzdk" (OuterVolumeSpecName: "kube-api-access-2tzdk") pod "cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d" (UID: "cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d"). InnerVolumeSpecName "kube-api-access-2tzdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:01:32.923756 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:32.923730 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tzdk\" (UniqueName: \"kubernetes.io/projected/cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d-kube-api-access-2tzdk\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\"" Jul 01 18:01:33.436882 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.436840 2564 generic.go:356] "Generic (PLEG): container finished" podID="cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d" containerID="276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27" exitCode=0 Jul 01 18:01:33.437080 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.436950 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bkmdv" Jul 01 18:01:33.437080 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.436981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bkmdv" event={"ID":"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d","Type":"ContainerDied","Data":"276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27"} Jul 01 18:01:33.437080 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.437033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bkmdv" event={"ID":"cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d","Type":"ContainerDied","Data":"6b06bbe88a8f4a3f29101b58c6fe17c4a009ada80aec52aa06365cb93154662a"} Jul 01 18:01:33.437080 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.437056 2564 scope.go:117] "RemoveContainer" containerID="276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27" Jul 01 18:01:33.447392 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.447373 2564 scope.go:117] "RemoveContainer" containerID="276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27" Jul 01 18:01:33.447676 ip-10-0-136-118 kubenswrapper[2564]: E0701 18:01:33.447648 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27\": container with ID starting with 276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27 not found: ID does not exist" containerID="276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27" Jul 01 18:01:33.447767 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.447686 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27"} err="failed to get container status \"276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27\": rpc error: code = NotFound desc = could not find container \"276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27\": container with ID starting with 276e8cab078a6f5aac0c3cf2a024ab6917d0946529d9a23552ae8ba264b8af27 not found: ID does not exist" Jul 01 18:01:33.465921 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.465890 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bkmdv"] Jul 01 18:01:33.471439 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:33.471413 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bkmdv"] Jul 01 18:01:34.383231 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:01:34.383189 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d" path="/var/lib/kubelet/pods/cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d/volumes" Jul 01 18:02:22.398690 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:02:22.398607 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 18:02:22.399197 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:02:22.398717 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 18:07:22.433634 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:07:22.433550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 18:07:22.434301 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:07:22.434286 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 18:12:03.721925 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:03.721896 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-65c88f69c5-jmppq_d98176db-ea3e-49cf-bfc5-cadb385ff6dc/nginx/0.log" Jul 01 18:12:03.956597 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:03.956569 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-zspw7_40a55f29-735b-4706-9f40-482edbcad9cf/manager/0.log" Jul 01 18:12:04.066054 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:04.066028 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lpdzb_cf06a901-b779-4407-92a8-085417d78af0/manager/0.log" Jul 01 18:12:04.287696 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:04.287668 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-kbcpr_b72297d0-2b31-4966-af30-ef8268402378/server/0.log" Jul 01 18:12:04.417556 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:04.417498 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-wl8dp_0a558afb-ff5a-490b-ad45-e6c201c9efb9/manager/0.log" Jul 01 18:12:04.645948 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:04.645921 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c4bd7dbdc-g758n_ee832a17-8152-4283-be66-1a18ffd3d74c/copy-manifests/0.log" Jul 01 18:12:04.653275 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:04.653253 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c4bd7dbdc-g758n_ee832a17-8152-4283-be66-1a18ffd3d74c/manager/0.log" Jul 01 18:12:04.897878 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:04.897840 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4mlwp_1db89b39-6a50-4b9f-9250-22837531e7c1/postgres/0.log" Jul 01 18:12:06.249982 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:06.249948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t8rcp_b2f66815-760b-409f-aeb6-8f0cc5ad7945/manager/0.log" Jul 01 18:12:06.366117 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:06.366090 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gjknj_e8df1e50-b3c8-4d60-a803-9af9d0a1ed65/manager/0.log" Jul 01 18:12:06.592582 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:06.592506 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lfh2s_adaa9907-3966-42a7-aa01-30032ded90c6/registry-server/0.log" Jul 01 18:12:06.705955 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:06.705919 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mlbr8_673d386f-575b-4baa-a407-49495350f85d/manager/0.log" Jul 01 18:12:06.927645 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:06.927550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bzbt6_a8d47252-d7cc-425d-b3e6-86eed5d908b5/manager/0.log" Jul 01 18:12:07.266294 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:07.266251 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49zqx9_0db15620-2b49-44c3-b00b-79e6d67415cd/istio-proxy/0.log" Jul 01 18:12:07.486776 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:07.486747 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687765f87-9swfl_0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2/kube-auth-proxy/0.log" Jul 01 18:12:07.705024 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:07.704946 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-876q4_e8e58b5a-52a9-40b6-934a-3568ea071dcf/istio-proxy/0.log" Jul 01 18:12:14.920551 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:14.920520 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ww66v_d5ca0dc4-4f82-4ed1-bc82-396932e508f0/global-pull-secret-syncer/0.log" Jul 01 18:12:15.051803 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:15.051776 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zpbhg_601316e7-6c4e-4ba1-ad0a-a2125b2aeaf5/konnectivity-agent/0.log" Jul 01 18:12:15.102028 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:15.102002 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-118.ec2.internal_6bfb7656da3d3c6e9389e9a4775b6152/haproxy/0.log" Jul 01 18:12:19.408283 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:19.408257 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t8rcp_b2f66815-760b-409f-aeb6-8f0cc5ad7945/manager/0.log" Jul 01 18:12:19.436051 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:19.436023 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gjknj_e8df1e50-b3c8-4d60-a803-9af9d0a1ed65/manager/0.log" Jul 01 18:12:19.522053 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:19.522029 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lfh2s_adaa9907-3966-42a7-aa01-30032ded90c6/registry-server/0.log" Jul 01 18:12:19.556490 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:19.556442 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mlbr8_673d386f-575b-4baa-a407-49495350f85d/manager/0.log" Jul 01 18:12:19.610372 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:19.610348 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bzbt6_a8d47252-d7cc-425d-b3e6-86eed5d908b5/manager/0.log" Jul 01 18:12:21.381455 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.381369 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80686061-9e4e-420d-b30d-99e600516c02/alertmanager/0.log" Jul 01 18:12:21.406221 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.406194 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80686061-9e4e-420d-b30d-99e600516c02/config-reloader/0.log" Jul 01 18:12:21.430032 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.430004 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80686061-9e4e-420d-b30d-99e600516c02/kube-rbac-proxy-web/0.log" Jul 01 18:12:21.456411 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.456392 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80686061-9e4e-420d-b30d-99e600516c02/kube-rbac-proxy/0.log" Jul 01 18:12:21.482195 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.482173 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80686061-9e4e-420d-b30d-99e600516c02/kube-rbac-proxy-metric/0.log" Jul 01 18:12:21.508260 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.508240 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80686061-9e4e-420d-b30d-99e600516c02/prom-label-proxy/0.log" Jul 01 18:12:21.535324 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.535290 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80686061-9e4e-420d-b30d-99e600516c02/init-config-reloader/0.log" Jul 01 18:12:21.603368 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.603344 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pwn87_16f8d71d-947c-45b7-bbfb-9b38fcf8cc34/kube-state-metrics/0.log" Jul 01 18:12:21.629037 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.629015 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pwn87_16f8d71d-947c-45b7-bbfb-9b38fcf8cc34/kube-rbac-proxy-main/0.log" Jul 01 18:12:21.656425 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.656376 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pwn87_16f8d71d-947c-45b7-bbfb-9b38fcf8cc34/kube-rbac-proxy-self/0.log" Jul 01 18:12:21.701091 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.701070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79cd5dbfd6-mmcw8_bedc4684-3a59-49fe-a40f-9f47009efb38/metrics-server/0.log" Jul 01 18:12:21.748126 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.748106 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-66qrf_2a41f888-5095-4905-ae99-a09736bf5ad8/monitoring-plugin/0.log" Jul 01 18:12:21.981941 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:21.981908 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-68f7f_bdb01fd8-737b-4955-8687-24000a9d7ef2/node-exporter/0.log" Jul 01 18:12:22.011926 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.011903 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-68f7f_bdb01fd8-737b-4955-8687-24000a9d7ef2/kube-rbac-proxy/0.log" Jul 01 18:12:22.036483 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.036466 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-68f7f_bdb01fd8-737b-4955-8687-24000a9d7ef2/init-textfile/0.log" Jul 01 18:12:22.072490 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.072471 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-qqb47_7bcd944e-87b0-45c6-aff6-0a49fe114f25/kube-rbac-proxy-main/0.log" Jul 01 18:12:22.096421 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.096390 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-qqb47_7bcd944e-87b0-45c6-aff6-0a49fe114f25/kube-rbac-proxy-self/0.log" Jul 01 18:12:22.127304 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.127283 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-qqb47_7bcd944e-87b0-45c6-aff6-0a49fe114f25/openshift-state-metrics/0.log" Jul 01 18:12:22.169498 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.169477 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45214df5-19c9-417d-85b5-5d2e759aa326/prometheus/0.log" Jul 01 18:12:22.194913 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.194852 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45214df5-19c9-417d-85b5-5d2e759aa326/config-reloader/0.log" Jul 01 18:12:22.217560 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.217532 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45214df5-19c9-417d-85b5-5d2e759aa326/thanos-sidecar/0.log" Jul 01 18:12:22.248493 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.248473 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45214df5-19c9-417d-85b5-5d2e759aa326/kube-rbac-proxy-web/0.log" Jul 01 18:12:22.279256 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.279235 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45214df5-19c9-417d-85b5-5d2e759aa326/kube-rbac-proxy/0.log" Jul 01 18:12:22.307588 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.307565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45214df5-19c9-417d-85b5-5d2e759aa326/kube-rbac-proxy-thanos/0.log" Jul 01 18:12:22.335832 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.335816 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45214df5-19c9-417d-85b5-5d2e759aa326/init-config-reloader/0.log" Jul 01 18:12:22.367587 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.367562 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-6hpck_9379bfbb-ea6b-4dbe-8e9c-52e9062481b0/prometheus-operator/0.log" Jul 01 18:12:22.389487 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.389469 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-6hpck_9379bfbb-ea6b-4dbe-8e9c-52e9062481b0/kube-rbac-proxy/0.log" Jul 01 18:12:22.419281 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.419259 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-9mjhh_4cdddd34-629b-4064-81d4-a25552ed01c8/prometheus-operator-admission-webhook/0.log" Jul 01 18:12:22.455781 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.455719 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854fd9878f-nq65g_e0aac86c-7725-4be9-a885-add6abfd655f/telemeter-client/0.log" Jul 01 18:12:22.476193 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.476175 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 18:12:22.477976 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.477957 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdxnd_d6423e5c-8d79-422f-a2a9-16ecdca417d0/ovn-acl-logging/0.log" Jul 01 18:12:22.484775 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.484752 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854fd9878f-nq65g_e0aac86c-7725-4be9-a885-add6abfd655f/reload/0.log" Jul 01 18:12:22.517513 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.517488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854fd9878f-nq65g_e0aac86c-7725-4be9-a885-add6abfd655f/kube-rbac-proxy/0.log" Jul 01 18:12:22.552982 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.552957 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5547bcdb64-d28vg_b4202fe3-d19d-424a-a0cb-62a4858ed33d/thanos-query/0.log" Jul 01 18:12:22.577602 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.577578 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5547bcdb64-d28vg_b4202fe3-d19d-424a-a0cb-62a4858ed33d/kube-rbac-proxy-web/0.log" Jul 01 18:12:22.603263 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.603243 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5547bcdb64-d28vg_b4202fe3-d19d-424a-a0cb-62a4858ed33d/kube-rbac-proxy/0.log" Jul 01 18:12:22.629229 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.629211 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5547bcdb64-d28vg_b4202fe3-d19d-424a-a0cb-62a4858ed33d/prom-label-proxy/0.log" Jul 01 18:12:22.656200 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.656181 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5547bcdb64-d28vg_b4202fe3-d19d-424a-a0cb-62a4858ed33d/kube-rbac-proxy-rules/0.log" Jul 01 18:12:22.681958 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:22.681939 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5547bcdb64-d28vg_b4202fe3-d19d-424a-a0cb-62a4858ed33d/kube-rbac-proxy-metrics/0.log" Jul 01 18:12:25.088491 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.088455 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84bff57b9d-sj6cx_3d7e6001-c957-44ae-aca9-8024b7700864/console/0.log" Jul 01 18:12:25.254766 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.254734 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8"] Jul 01 18:12:25.255280 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.255253 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d" containerName="authorino" Jul 01 18:12:25.255280 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.255274 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d" containerName="authorino" Jul 01 18:12:25.255460 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.255410 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbff47fb-0b5e-45ec-9068-b8a7a3b11d6d" containerName="authorino" Jul 01 18:12:25.258731 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.258710 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.261637 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.261618 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vx88s\"/\"kube-root-ca.crt\"" Jul 01 18:12:25.263004 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.262983 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vx88s\"/\"default-dockercfg-vdbtk\"" Jul 01 18:12:25.263102 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.262992 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vx88s\"/\"openshift-service-ca.crt\"" Jul 01 18:12:25.268101 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.268080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8"] Jul 01 18:12:25.287998 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.287975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-lib-modules\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.288099 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.288004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6db4\" (UniqueName: \"kubernetes.io/projected/96896d05-c100-4361-b52a-441755b61bfb-kube-api-access-c6db4\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.288099 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.288034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-proc\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.288177 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.288131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-sys\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.288209 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.288183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-podres\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.388783 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.388727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-podres\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.388783 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.388780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-lib-modules\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.388905 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.388875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-lib-modules\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.388905 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.388878 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-podres\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.388972 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.388916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6db4\" (UniqueName: \"kubernetes.io/projected/96896d05-c100-4361-b52a-441755b61bfb-kube-api-access-c6db4\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.388972 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.388953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-proc\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.389059 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.388991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-sys\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.389110 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.389062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-sys\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.389110 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.389085 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/96896d05-c100-4361-b52a-441755b61bfb-proc\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.398485 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.398464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6db4\" (UniqueName: \"kubernetes.io/projected/96896d05-c100-4361-b52a-441755b61bfb-kube-api-access-c6db4\") pod \"perf-node-gather-daemonset-7p6c8\" (UID: \"96896d05-c100-4361-b52a-441755b61bfb\") " pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.570195 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.570169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:25.916325 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.916290 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8"] Jul 01 18:12:25.918218 ip-10-0-136-118 kubenswrapper[2564]: W0701 18:12:25.918194 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod96896d05_c100_4361_b52a_441755b61bfb.slice/crio-a14af78e2f1eddb4c4a6888dbb7289b2f963703c28b51726b6848f42acc8519a WatchSource:0}: Error finding container a14af78e2f1eddb4c4a6888dbb7289b2f963703c28b51726b6848f42acc8519a: Status 404 returned error can't find the container with id a14af78e2f1eddb4c4a6888dbb7289b2f963703c28b51726b6848f42acc8519a Jul 01 18:12:25.967795 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:25.967771 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" event={"ID":"96896d05-c100-4361-b52a-441755b61bfb","Type":"ContainerStarted","Data":"a14af78e2f1eddb4c4a6888dbb7289b2f963703c28b51726b6848f42acc8519a"} Jul 01 18:12:26.827455 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:26.827425 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qq72d_02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9/dns/0.log" Jul 01 18:12:26.855110 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:26.855084 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qq72d_02c57aeb-52b0-4ccb-87f7-6fa4b84d4ef9/kube-rbac-proxy/0.log" Jul 01 18:12:26.975517 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:26.975482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" event={"ID":"96896d05-c100-4361-b52a-441755b61bfb","Type":"ContainerStarted","Data":"dfeda7b542c25d41874e3c5b5bd1820b9d8d5b13d413b568f3d0861ee139c0bd"} Jul 01 18:12:26.975653 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:26.975601 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:26.996429 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:26.996386 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" podStartSLOduration=1.9963728889999999 podStartE2EDuration="1.996372889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:12:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:12:26.995081847 +0000 UTC m=+1505.059118021" watchObservedRunningTime="2026-07-01 18:12:26.996372889 +0000 UTC m=+1505.060409061" Jul 01 18:12:27.036571 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:27.036550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwj6r_b245e59d-dbcb-4f33-bff1-ce335c189944/dns-node-resolver/0.log" Jul 01 18:12:27.723237 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:27.723205 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pms5d_56dba866-0ae2-4f09-8844-c88073be934a/node-ca/0.log" Jul 01 18:12:28.705265 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:28.705230 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49zqx9_0db15620-2b49-44c3-b00b-79e6d67415cd/istio-proxy/0.log" Jul 01 18:12:28.793690 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:28.793661 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687765f87-9swfl_0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2/kube-auth-proxy/0.log" Jul 01 18:12:28.852932 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:28.852908 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-876q4_e8e58b5a-52a9-40b6-934a-3568ea071dcf/istio-proxy/0.log" Jul 01 18:12:29.541822 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:29.541793 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xxm9n_ad93e5e9-caa5-4767-bd42-51e57510e4f3/serve-healthcheck-canary/0.log" Jul 01 18:12:30.236749 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:30.236723 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfrvq_cf01d151-3bde-4729-ac33-cad72a028d08/kube-rbac-proxy/0.log" Jul 01 18:12:30.265722 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:30.265694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfrvq_cf01d151-3bde-4729-ac33-cad72a028d08/exporter/0.log" Jul 01 18:12:30.292037 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:30.292010 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfrvq_cf01d151-3bde-4729-ac33-cad72a028d08/extractor/0.log" Jul 01 18:12:32.510452 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.510420 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-65c88f69c5-jmppq_d98176db-ea3e-49cf-bfc5-cadb385ff6dc/nginx/0.log" Jul 01 18:12:32.600485 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.600456 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-zspw7_40a55f29-735b-4706-9f40-482edbcad9cf/manager/0.log" Jul 01 18:12:32.637810 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.637789 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lpdzb_cf06a901-b779-4407-92a8-085417d78af0/manager/0.log" Jul 01 18:12:32.696774 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.696755 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-kbcpr_b72297d0-2b31-4966-af30-ef8268402378/server/0.log" Jul 01 18:12:32.765342 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.765261 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-wl8dp_0a558afb-ff5a-490b-ad45-e6c201c9efb9/manager/0.log" Jul 01 18:12:32.844667 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.844645 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c4bd7dbdc-g758n_ee832a17-8152-4283-be66-1a18ffd3d74c/manager/0.log" Jul 01 18:12:32.872379 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.872362 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c4bd7dbdc-g758n_ee832a17-8152-4283-be66-1a18ffd3d74c/copy-manifests/0.log" Jul 01 18:12:32.980334 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.980290 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4mlwp_1db89b39-6a50-4b9f-9250-22837531e7c1/postgres/0.log" Jul 01 18:12:32.990777 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:32.990756 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vx88s/perf-node-gather-daemonset-7p6c8" Jul 01 18:12:35.539372 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:35.539303 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49zqx9_0db15620-2b49-44c3-b00b-79e6d67415cd/istio-proxy/0.log" Jul 01 18:12:35.589270 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:35.589245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687765f87-9swfl_0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2/kube-auth-proxy/0.log" Jul 01 18:12:35.629893 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:35.629870 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-876q4_e8e58b5a-52a9-40b6-934a-3568ea071dcf/istio-proxy/0.log" Jul 01 18:12:36.786934 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:36.786903 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49zqx9_0db15620-2b49-44c3-b00b-79e6d67415cd/istio-proxy/0.log" Jul 01 18:12:36.834609 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:36.834587 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687765f87-9swfl_0ffbdf13-c3ac-43d9-9cf9-3c86dbd527d2/kube-auth-proxy/0.log" Jul 01 18:12:36.878281 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:36.878260 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-876q4_e8e58b5a-52a9-40b6-934a-3568ea071dcf/istio-proxy/0.log" Jul 01 18:12:41.603050 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:41.602969 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7mkmk_1f7ee57d-7372-46b4-b0a0-0d18dc009c9c/kube-multus/0.log" Jul 01 18:12:41.823398 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:41.823363 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvrbz_a59d66bc-3586-4c9a-93f9-79ec1c600e8c/kube-multus-additional-cni-plugins/0.log" Jul 01 18:12:41.851737 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:41.851692 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvrbz_a59d66bc-3586-4c9a-93f9-79ec1c600e8c/egress-router-binary-copy/0.log" Jul 01 18:12:41.878029 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:41.877950 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvrbz_a59d66bc-3586-4c9a-93f9-79ec1c600e8c/cni-plugins/0.log" Jul 01 18:12:41.907276 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:41.907249 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvrbz_a59d66bc-3586-4c9a-93f9-79ec1c600e8c/bond-cni-plugin/0.log" Jul 01 18:12:41.931884 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:41.931865 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvrbz_a59d66bc-3586-4c9a-93f9-79ec1c600e8c/routeoverride-cni/0.log" Jul 01 18:12:41.956588 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:41.956568 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvrbz_a59d66bc-3586-4c9a-93f9-79ec1c600e8c/whereabouts-cni-bincopy/0.log" Jul 01 18:12:41.980098 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:41.980080 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvrbz_a59d66bc-3586-4c9a-93f9-79ec1c600e8c/whereabouts-cni/0.log" Jul 01 18:12:42.378266 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:42.378229 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v7sf7_12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e/network-metrics-daemon/0.log" Jul 01 18:12:42.399758 ip-10-0-136-118 kubenswrapper[2564]: I0701 18:12:42.399733 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v7sf7_12eca6e8-6fb7-49e2-b94b-ae8f5818ae9e/kube-rbac-proxy/0.log"